…Rather than treating urban imagery as generic scene data, Urban-ImageNet evaluates whether machine perception models can capture spatial, social, and functional distinctions that are central to urban studies. The benchmark supports…
…foundation generative world model trained from the Cosmos diffusion model, enables real-time action-conditioned video generation for autonomous driving policy evaluation in complex, unseen scenarios. Generated by Qwen/Qwen2.5-Coder…
…is introduced to systematically evaluate speech modification capabilities across atomic and compositional tasks. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Instruction-guided speech editing requires a model to modify specified speech…
…of model capabilities across heterogeneous evaluation settings, a signal rich enough to learn from directly. By learning a performance-aware latent space over model--dataset--metric tuples , ModelLens ranks unseen models on…
…Social deduction games have become a popular testbed for evaluating reasoning, deception, coordination, and belief modeling in large language models. However, most environments evaluate agents primarily through game outcomes like win rates…
…The following papers were recommended by the Semantic Scholar API Beyond Rating: A Comprehensive Evaluation and Benchmark for AI Reviews (2026) Teaching Language Models to Check Grounded Claim Factuality with Human Test…
…Can Video Generation Models Dream Executable Robot Manipulation? Published on Jun 4 Submitted by Rui Zhao on Jun 5 Authors: , , , , , , , , Abstract Video generation models were evaluated through robotic manipulation tasks to assess…
…narratives, necessitating benchmarks that evaluate psychological trajectory alignment rather than static factual recall, with ArcANE demonstrating superior performance when character arc information is conditioned into models. Generated by Qwen/Qwen2.5-Coder…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct As video diffusion models (VDMs) advance toward world models , a key question arises: do they truly understand causality , or merely overfit to statistical temporal…
…principled evaluation. We systematically review text world models for LLM-based agents , organized around a formal framework and the agent lifecycle: (1) Foundations, defining text world models and characterizing them by state…