…A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation (2026) Vision2Web: A Hierarchical Benchmark for Visual Website Development with Agent Verification (2026) Coding with Eyes: Visual Feedback Unlocks Reliable GUI…
…Furthermore, existing benchmarks focus predominantly on action recognition , often neglecting critical real-world challenges such as input corruptions, missing modalities, and model trustworthiness. This lack of standardization obscures a reliable assessment of…
…The release contains 105 tasks spanning controlled business services and local workspace repair, and evaluates 13 frontier models under a shared public pass rule. Experiments reveal that reliable workflow automation remains far…
…preserves a reliable reward signal; and to avoid systematically incorrect invariance, correctness-conditioned regularization restricts enforcement to successful trajectories. On Qwen3-VL 4B/8B across seven multimodal reasoning benchmarks, our method improves…
…We present PaperFit, a vision-in-the-loop agent that iteratively renders pages, diagnoses defects, and applies constrained repairs. To benchmark VTO, we construct PaperFit-Bench with 200 papers across 10 venue…
…We introduce MLS-Bench , a benchmark for evaluating whether AI systems can invent generalizable and scalable ML methods . MLS-Bench contains 140 tasks across 12 domains, each requiring an agent to improve…
…We propose When2Tool, a benchmark of 18 environments (15 single-hop, 3 multi-hop) spanning three categories of tool necessity -- computational scale, knowledge boundaries, and execution reliability -- each with controlled difficulty levels…
…Our experiments and ablations demonstrate positive scaling trends, strong cross-lingual transfer when training on diverse preferences, and the importance of multi-criteria training for reliable code reward modeling. View arXiv page…
…As a first step, we introduce CreativityBench , a benchmark for evaluating affordance-based creativity in LLMs. To this end, we build a large-scale affordance knowledge base (KB) with 4K entities and…
…TrackCraft3R achieves state-of-the-art performance on standard sparse and dense 3D tracking benchmarks, while running 1.3x faster and using 4.6x less peak memory than the strongest prior method…