…for evaluating LLM agents' ability to adaptively plan under progressively revealed world and user constraints through multi-turn interactions. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Planning for real-world problems…
…a unified evaluation suite for image editing and reward modeling. Edit-Compass contains 2,388 carefully annotated instances spanning six progressively challenging task categories, covering capabilities such as world knowledge reasoning, visual…
…Jiahao Ying , Boxian Ai , , , Abstract OpenSkillEval is an automatic evaluation framework that assesses skill-augmented agent systems and skills across diverse real-world applications, revealing that skill availability doesn't guarantee effective…
…View arXiv page View PDF Add to collection Community NVIDIA OmniDreams is an action-conditioned foundation generative world model that provides real-time, photorealistic, and reactive simulation environments for training and evaluating…
…Benchmarking LLM Agents on Real-World Personal Applications via Environment Simulation Published on Jun 1 Submitted by WENHAO WANG on Jun 2 Authors: , , , , , , , , , , , Abstract MCP-Persona benchmark evaluates agent performance on personalized…
…Can AI Agents Complete Real-World Post-Production Tasks? (2026) WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation (2026) AlphaEval: Evaluating Agents in Production (2026) RealClawBench: Live OpenClaw Benchmarks from…
…By temporally reversing real-world videos at zero cost as natural counterfactual samples, YoCausal establishes an arbitrarily extensible evaluation protocol. Level 1 introduces the Reverse Surprise Index (RSI), quantifying arrow-of-time…
…To systematically evaluate such proactive personalization in realistic interactions, we propose Ψ-Bench, a benchmark for assessing LLMs ' ability to influence realistic users through conversation. We design three real-world interaction scenarios…
…A Comprehensive Framework for Evaluating LLMs in Realistic Interactions (2026) T1-Bench: Benchmarking Multi-Scenario Agents in Real-World Domains (2026) WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation (2026…
…Environments and Evaluations for Stateful Agentic Planning and Tool Use in Enterprise Settings (2026) OccuBench: Evaluating AI Agents on Real-World Professional Tasks via Language Environment Simulation (2026) Vision2Web: A Hierarchical Benchmark…