…A multi-scale study further examines how model performance changes as balanced training data increases from 1K, 10K to 100K images. Urban-ImageNet provides a unified, theory-grounded, multi-city benchmark for…
…Yulu Pan , Han Yi , Seongsu Ha , , , , Abstract Strategic Video Intelligence requires understanding, causal reasoning, and planning capabilities that current benchmarks fail to evaluate adequately, leading to significant performance gaps in complex cognitive…
…Our CAFE provides a controlled benchmark for diagnosing whether promptable segmentation models perform concept-faithful grounding rather than shortcut-driven mask retrieval. View arXiv page View PDF Project page GitHub 4 Add…
…On the Failure of Long-Horizon Agentic Data Analysis Published on May 28 Submitted by Ningyu Zhang on Jun 1 Ant Group Authors: , , , , , , Ningyu Zhang Abstract LongDS benchmark evaluates agents' ability to…
…Experiments demonstrate that our dataset and the model trained on it achieve substantially better performance than all existing baselines on both OpenVE-Bench and Sparkle-Bench. Our proposed dataset, benchmark, and model…
Papers arxiv:2605.03941 A Benchmark for Interactive World Models with a Unified Action Generation Framework Published on May 5 Submitted by taesiri on May 6 Authors: , , , , , , , , , , Abstract A comprehensive benchmark named…
…cost-performance trade-offs. In this paper, we present OpenSkillEval, an automatic evaluation framework for both skill-augmented agent systems and the skills themselves. Instead of relying on static benchmarks, OpenSkillEval automatically…
…Yichen Feng , , , , , , Hang Hua , , , , , , , , , , Abstract Current multimodal models struggle to match human expert aesthetic judgment in comparative image selection tasks, as demonstrated by the Visual Aesthetic Benchmark which reveals significant performance gaps…
…The benchmark is built from 33 white papers , covering more than 10 image types and comprising 2,053 VQA instances . Experimental results reveal a substantial performance gap between open-weight and proprietary…
…Seungone Kim Abstract Korean web-browsing agent benchmark K-BrowseComp evaluates frontier LLMs' capabilities with 400 problems, showing significant performance gaps compared to English benchmarks and highlighting the need for more robust…
