…Petersburg Game Published on Jun 3 Submitted by BruceLyu on Jun 4 Authors: , , , , , Abstract Large language models exhibit surface-level human-like risk decisions in the St. Petersburg game without consistent human…
…Evaluating LLM Agents for Forward-Looking AI Research Judgment Published on Jun 4 Submitted by BruceLyu on Jun 5 Authors: , , , , Abstract ForeSci is a temporally controlled benchmark that evaluates LLM agents' ability…
…The following papers were recommended by the Semantic Scholar API Character Beyond Speech: Leveraging Role-Playing Evaluation in Audio Large Language Models via Reinforcement Learning (2026) Beyond Transcription: Unified Audio Schema for…
…Our evaluation shows that current frontier models are far from representation-invariant reasoners : performance degrades on average as information moves from language to diagrams, with visual variable grounding as the most critical…
…highly amenable to diffusion modeling. To optimize computational efficiency, we leverage an asymmetric and attention-free encoder-decoder backbone to minimize encoding overhead. We present a comprehensive evaluation of Qwen-Image-VAE…
…Evaluating Coding Agent Application Platforms as Virtual Software Agencies Published on May 6 Submitted by Nilesh Trivedi on May 7 QwikBuild Authors: , Nilesh Trivedi , Abstract A comprehensive evaluation framework called SWE-WebDev…
…The generation pipeline leverages a vision-language model (VLM) to design and compose subtasks, generates full trajectories through atomic functions , and provides memory-related annotations , including subtask instructions and native keyframe annotations…
…Benchmarking Multimodal Long-Term Memory in Large Vision-Language Models Published on May 14 Submitted by Zhaowei Wang on May 15 NVIDIA Authors: Xiyu Ren , , Yiming Du , , , , , , , , , , , Abstract A new benchmark evaluates…
…Submitted by Shivam Kumar on May 14 Authors: Shivam Kumar Abstract ShapeCodeBench presents a synthetic benchmark for perception-to-program reconstruction where models generate executable drawing programs from raster images, evaluated on…
…A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels Published on May 6 Submitted by Jintao Zhang on May 8 Tsinghua University Authors: , Jintao Zhang , , , , Abstract KernelBench-X benchmark reveals that task…