…VSTAT consists of 834 clips drawn from both synthetic and real-world videos, paired with 1,500 questions that cannot be answered from any single frame or short segment, requiring continuous perception…
…Lift is greatest on interpretation-required questions , where providing an interpretive layer enables model behavior that extracted facts or raw corpus do not. Conversely, on recall-required questions , this layer can interfere…
…A natural question follows: how well do these models reflect the physical world when their generated videos leave the screen and enter reality? We propose robotic manipulation as a concrete, measurable window…
…AI-generated summary Self-consistency detects hallucinations by generating multiple sampled answers to a question and measuring agreement, but this requires repeated decoding and can be sensitive to lexical variation. Semantic self…
…View arXiv page View PDF Add to collection Community Can large language models detect and report their own internal states? A number of studies have argued that the answer to this question…
…Unlike holistic scalar rewards, DVReward utilizes an LLM to decompose complex user requests into atomic, verifiable semantic and quality questions, which are then evaluated by a general MLLM to provide reliable and…
…Songlin Bai , Xintong Wang , , , , , , , , , , , , , Liang Ding Abstract IndustryBench evaluates industrial procurement question answering systems in Chinese against national standards, revealing significant gaps in safety compliance and highlighting the need for safety-aware…
…AI-generated summary LLM-powered multi-agent systems can now automate the full research pipeline from ideation to paper writing, but a fundamental question remains: automation for whom? Researchers operate under different…
…AI-generated summary LLM-based Triton kernel generation has attracted significant interest, yet a fundamental empirical question remains unanswered: where does this capability break down, and why? We present KernelBench-X , a…
…View arXiv page View PDF Add to collection Community For questions contact astrlrd@nebius.com Get this paper in your agent: hf papers read 2605.10453 Don't have the latest CLI…