…Evaluating Adaptive Planning in Large Language Model Agents under World and User Constraints Published on Jun 4 Submitted by Jeff on Jun 5 University of Illinois at Urbana-Champaign Authors: , , , , , , , , , , Abstract AdaPlanBench…
…Benchmarking Agentic Procedural 3D Modeling Via Code Published on May 31 Submitted by taesiri on Jun 2 Deepmind Authors: Yipeng Gao , , , , , , , Abstract Vision-language models are evaluated for procedural 3D modeling tasks…
…where a model repurposes available objects by reasoning about their affordances and attributes rather than relying on canonical usage. As a first step, we introduce CreativityBench , a benchmark for evaluating affordance-based…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Measuring structured object understanding in vision foundation models remains challenging due to inconsistent evaluation protocols and limited part-level supervision . Semantic correspondence (SC) evaluates…
…Procedural generation with configurable complexity enables an effectively infinite, contamination-resistant evaluation suite, and deterministic pixel-level evaluation eliminates reliance on bias-prone judge models. Across 11 image editing models, we find…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Charts are a primary medium for conveying quantitative and relational information, yet systematically evaluating chart parsing models remains difficult. Existing benchmarks focus on narrow…
…The following papers were recommended by the Semantic Scholar API BenHalluEval: A Multi-Task Hallucination Evaluation Framework for Large Language Models on Bengali (2026) Cultural Benchmarking of LLMs in Standard and Dialectal…
…The following papers were recommended by the Semantic Scholar API HealthAdminBench: Evaluating Computer-Use Agents on Healthcare Administration Tasks (2026) Medical Reasoning with Large Language Models: A Survey and MR-Bench (2026…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Recent multimodal large language models have demonstrated strong reasoning ability, yet their reliability as automated evaluators remains limited by a critical weakness: when visual…
…AI-generated summary Crowdsourced pairwise evaluation has emerged as a scalable approach for assessing foundation models. However, applying it to Text to Speech (TTS) introduces high variance due to linguistic diversity and…