…We introduce RobotValues , a benchmark to evaluate household robot planners in 10K value-conflict scenarios . Each instance consists of a realistic household image with multiple plausible robot actions that prioritize different human…
…We additionally include real-to-sim-to-real experiments on a mobile manipulator to assess the correspondence between simulation and real-world physical interaction. KinDER is fully open-sourced and intended to…
…However, existing robotic memory benchmarks still lack multimodal annotations for memory formation, provide limited task coverage and structural complexity, and remain restricted to simulation without real-world evaluation . We address this gap…
…lack the robustness to recover from their own errors, hindering real-world deployment. To bridge this gap at both the evaluation and data levels, we introduce GUI-RobustEval and propose Robustness-driven…
…between benchmark evaluation and production performance for LLM kernel agents by providing a representative set of architectures and a production-grade inference framework that aligns evaluation with real-world deployment. AI-generated…
…No existing benchmark evaluates this capability stack: in-the-wild videos lack verifiable ground truth for causal and strategic questions, while synthetic environments sacrifice the complexity of real multi-agent systems. To…
…A Massive Multi-Task Omni Understanding and Reasoning Benchmark for Long and Complex Real-World Videos (2026) AVGen-Bench: A Task-Driven Benchmark for Multi-Granular Evaluation of Text-to-Audio-Video…
…Benchmarking Continual Learning Methods for Agent Skill Generation on Real-World Tasks (2026) SkillX: Automatically Constructing Skill Knowledge Bases for Agents (2026) SkillClaw: Let Skills Evolve Collectively with Agentic Evolver (2026) Please…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct While video streaming understanding has made significant strides, real-world applications, such as live sports broadcasting, autonomous driving, and multi-screen collaboration, inherently demand…
…Evaluating LLM Safety in Real-World Financial Scenarios (2026) SoK: Robustness in Large Language Models against Jailbreak Attacks (2026) MultiBreak: A Scalable and Diverse Multi-turn Jailbreak Benchmark for Evaluating LLM Safety…