…Sleeper Attack on Large Language Model Agents (2026) AgentCanary: A Security Evaluation Framework for Autonomous AI Agents in Real Executable Environments (2026) Benchmarking Autonomous Agents against Temporal, Spatial, and Semantic Evasions (2026…
…Evaluating Long-Term Agent Memory Toward Experienced Colleagues Published on May 12 Submitted by Di Wu on May 13 UCLA NLP Authors: , , , , , , Abstract A new benchmark called LongMemEval-V2 is introduced to…
…Evaluating 7 models from 4 families, safety improves by 9--52% as the number of preceding regular agentic tasks increases from zero to twenty. Representation analysis confirms that model hidden states gradually…
…However, scalable development around these environments remains constrained by the absence of a systematic framework, especially one for synthesizing verifiable training data and integrating it with agent training and diagnostic evaluation . To…
…model by RoboArena at the time the technical report was written. To accelerate open research and deployment in Physical AI , we make our code, model checkpoints, curated synthetic datasets, and evaluation benchmark…
…A Multitask Benchmark and Model for Code Search Published on May 6 Submitted by Ziyin Zhang on May 11 high-quality llm benchmarks Authors: , , , Ziyin Zhang , , , Hang Yu Abstract A new code…
…designing the prompts, tools, orchestration logic, and evaluation criteria that make a foundation model effective. We present a two-level framework that automates this process. At the first level, the Harness Evolution…
…To bridge this gap, we introduce ViMU, the first benchmark designed to systematically evaluate the subtext understanding capabilities of frontier models in videos. ViMU assesses whether video understanding models can go beyond…
…with absent-persona hallucination and larger models do not always achieve higher Cal, exposing calibration as a separate evaluation axis; and (iii) SFT is bounded by the difficulty of constructing annotated ground…
Papers arxiv:2605.30219 When Should Models Change Their Minds? Contextual Belief Management in Large Language Models Published on May 28 Submitted by Ningyu Zhang on May 29 Zhejiang University Authors: , , , , , , , , Abstract…