…Multi-Modal Memory Evaluation through Cognitively-Grounded Video Tasks Published on Jun 3 Submitted by Huang Jie on Jun 4 PKU-VaLuE-Lab Authors: , , , , , , Abstract Multi-modal models exhibit significant limitations in…
…Evaluating Open-World Exploration of MLLM Agents in Minecraft Published on May 29 Submitted by Tianjie Ju on Jun 2 Authors: , , , , , , , , , Abstract MineExplorer benchmark evaluates multimodal large language models' open-world exploration…
…by the Semantic Scholar API IndicSafe: A Benchmark for Evaluating Multilingual LLM Safety in South Asia (2026) ML-Bench&Guard: Policy-Grounded Multilingual Safety Benchmark and Guardrail for Large Language Models (2026…
…Evaluating Multimodal Large Language Models on Real-World University-Level STEM Student Handwritten Solutions Published on Apr 30 Submitted by Weiyu Sun on May 8 Authors: Weiyu Sun , , , , , Abstract EDU-CIRCUIT-HW…
…Are Current Agents Capable of Autonomous Agent Development? Published on Jun 3 Submitted by Xinyu Lu on Jun 3 Authors: Xinyu Lu , , , , , , , , , , Abstract The Meta-Agent Challenge evaluates AI models' ability to…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct A growing failure mode in agent evaluation and training is that models can achieve high evaluation scores by exploiting shortcuts instead of solving the…
…2 Submitted by Jongwon Lim on Jun 5 Seoul National University Authors: Jongwook Han , , Abstract RobotValues benchmark evaluates household robot planners in value-conflict scenarios, revealing that vision-language models exhibit default…
…May 11 Submitted by Keming Wu on May 12 UniX Lab Authors: , , , , , , Zuhao Yang , , , , , Ping Nie , , Abstract WorldReasonBench and WorldRewardBench are introduced as benchmarks for evaluating video generation models' ability to reason…
…The following papers were recommended by the Semantic Scholar API Omni-WorldBench: Towards a Comprehensive Interaction-Centric Evaluation for World Models (2026) WorldMark: A Unified Benchmark Suite for Interactive Video World Models…
…The following papers were recommended by the Semantic Scholar API Systematic Capability Benchmarking of Frontier Large Language Models for Offensive Cyber Tasks (2026) CyberCertBench: Evaluating LLMs in Cybersecurity Certification Knowledge (2026) Evaluating…