…AI-generated summary Long-term memory is crucial for agents in specialized web environments , where success depends on recalling interface affordances, state dynamics, workflows, and recurring failure modes. However, existing memory benchmark…
…benchmark, achieving 89% information-retention score , using LLMs from 7-14B tiers. Collectively, these findings underscore the potential of PAI-2 to serve as a foundational model for next-generation personalized AI…
…We introduce MLS-Bench , a benchmark for evaluating whether AI systems can invent generalizable and scalable ML methods . MLS-Bench contains 140 tasks across 12 domains, each requiring an agent to improve…
Papers arxiv:2605.11378 An Empirical Study of Automating Agent Evaluation Published on May 12 Submitted by Sangmin Woo on May 14 Amazon Authors: , , , , , , , , , , , , , , , , Abstract Automated agent evaluation using AI assistants requires…
…AI-generated summary Tool-augmented LLM agents tend to call tools indiscriminately, even when the model can answer directly. Each unnecessary call wastes API fees and latency, yet no existing benchmark systematically…
…multi-agent system that detects fabricated citations by classifying them into a 12-code taxonomy and using structured extraction, evidence retrieval, and specialized classifiers for real, potential, and hallucinated citations. AI-generated…
…visual-native agent harness with image bank reference protocol enables reusable intermediate visual evidence and closed-loop data generation that improves multimodal deep search performance across multiple benchmarks. AI-generated summary Multimodal…
…An Open Benchmark for Instructional Computer Vision Problem Solving with Human-AI Collaborative Preferences (2026) GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillation (2026) Generation Navigator: A State…
…Xingyuan Hua , , Abstract Agents use variational inference to evaluate exploratory actions and selectively explore only when uncertainty is high, improving performance on text-based and GUI-based benchmarks. AI-generated summary Recent…
…It is training-free, with no benchmark- or model-specific adaptation, yet it beats a recent prior agent by +11.2 points on 20 benchmarks and improves consistently across six VLM backbones…
