Search: AI agent benchmarks

Paper page - LongHorizon-Harness: Advancing Long-Horizon Agents for Real-World Tasks

…https://lh-harness.pages.dev Interesting approach! Separating task state from execution and verifying it independently seems like a practical way to improve reliability for long-horizon AI agents. The benchmark improvements…

Aug 4, 2026

Paper page - SkillHarm: Lifecycle-Aware Skill-Based Attacks via Automated Construction

…Sleeper Attack on Large Language Model Agents (2026) AgentCanary: A Security Evaluation Framework for Autonomous AI Agents in Real Executable Environments (2026) Benchmarking Autonomous Agents against Temporal, Spatial, and Semantic Evasions (2026…

Jun 10, 2026

Paper page - MemLens: Benchmarking Multimodal Long-Term Memory in Large Vision-Language Models

…128K Context (2026) OMIBench: Benchmarking Olympiad-Level Multi-Image Reasoning in Large Vision-Language Model (2026) MemMachine: A Ground-Truth-Preserving Memory System for Personalized AI Agents (2026) TTF: Temporal Token Fusion…

May 15, 2026

Paper page - MedSkillAudit: A Domain-Specific Audit Framework for Medical Research Agent Skills

…Agent skills are increasingly deployed as modular, reusable capability units in AI agent systems. Medical research agent skills require safeguards beyond general-purpose evaluation, including scientific integrity, methodological validity, reproducibility, and boundary…

May 7, 2026

Paper page - SWE-Review: Closing the Loop on Issue Resolution with Agentic Code Review

…Benchmarking Coding Agents on Multi-Bug Software Maintenance (2026) SWE-Explore: Benchmarking How Coding Agents Explore Repositories (2026) Socratic-SWE: Self-Evolving Coding Agents via Trace-Derived Agent Skills (2026) Please give…

Jul 8, 2026

Paper page - GameCraft-Bench: Can Agents Build Playable Games End-to-End in a Real Game Engine?

…We instantiate this framework as GameCraft-Bench , a benchmark comprising 140 Godot tasks across 15 game families. Evaluations of frontier coding agents show that end-to-end game generation remains highly challenging…

Jun 17, 2026

Paper page - Building to the Test: Coding Agents Deliver What You Check, Not What You Requested

…Benchmarking AI Agents on Property-Based Testing (2026) CrackMeBench: Binary Reverse Engineering for Agents (2026) Code Isn't Memory: A Structural Codebase Index Inside a Coding Agent (2026) Ambig-DS: A Benchmark…

Jul 2, 2026

Paper page - Fewer Clarifications, Better Code: Benchmarking Cross-Session Personalized Ambiguity Adaptation in Coding Assistants

…Benchmarking General AI Agents Across Diverse Scenarios (2026) Regression Accumulation in Multi-Turn LLM Programming Conversations (2026) Please give a thumbs up to this comment if you found it helpful! If you…

Aug 3, 2026

Paper page - Ideas Have Genomes: Benchmarking Scientific Lineage Reasoning and Lineage-Grounded Idea Generation

…Benchmarking Agent Self-Evolution via Ability Transfer (2026) SWE-Explore: Benchmarking How Coding Agents Explore Repositories (2026) What Resolve Rate Hides: Trajectory Structure Diagnostics for Coding Agents (2026) AtomicCommitBench: Can Coding Agents…

Jul 10, 2026

Paper page - ExplainBench: Evaluating Code Explanations from Agents

…Despite this, there are no benchmarks that evaluate the trustworthiness of agent-generated explanations. To bridge this gap, we propose ExplainBench , a benchmark to automatically evaluate explanations from coding agents. ExplainBench is…

Aug 5, 2026

Followed topics

Search