…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Real-world data analysis is inherently iterative, yet existing benchmarks mostly evaluate isolated or short interactive tasks, leaving agents' ability to track evolving analytical…
…Overall, RoboStressBench provides a principled evaluation framework for diagnosing and improving VLM perception under real-world physical stress, supporting the development of more reliable embodied AI systems. View arXiv page View PDF…
…Furthermore, we create a dataset of 600 tasks modeled after real-world rescue cases and propose a robust set of evaluation metrics. We evaluate diverse baselines, ranging from traditional heuristics to advanced…
…A Benchmark for Evaluating World Models in Robotic Manipulation (2026) GEM-4D: Geometry-Enhanced Video World Models for Robot Manipulation (2026) RoboTrustBench: Benchmarking the Trustworthiness of Video World Models for Robotic Manipulation…
…A Large-Scale Benchmark for Real-World Speech Recognition in India (2026) NVBench: A Benchmark for Speech Synthesis with Non-Verbal Vocalizations (2026) AnimeScore: A Preference-Based Dataset and Framework for Evaluating…
…Despite its importance, existing relevant benchmarks largely evaluate agents on pre-specified or synthesized files with limited real-world dependencies, leaving workspace-level evaluation underexplored. To this end, we introduce Workspace-Bench…
…Towards Trustworthy Evaluation of Autonomous Agents (2026) AlphaEval: Evaluating Agents in Production (2026) ClawBench: Can AI Agents Complete Everyday Online Tasks? (2026) OccuBench: Evaluating AI Agents on Real-World Professional Tasks via…
…PatRe comprises 480 real-world cases and supports both oracle and retrieval-simulated evaluation settings. Our benchmark reframes patent examination as a dynamic, multi-turn process of justification and response. Extensive experiments…
…Nguyen , Raghav Mehndiratta , Lindsay Devon Brin , , Hari Subramani , Anil Madamala , Sridhar Krishna Nemala , Abstract EVA-Bench presents a comprehensive evaluation framework for voice agents that simulates realistic conversations and measures performance across…
…Unlike prior work that focuses on limited datasets or settings, MMDG-Bench unifies evaluation across multiple tasks, modalities, and real-world challenges, including corruption robustness, missing modalities, and model trustworthiness. the take…