AA-AgentPerf is a hardware benchmark created by Artificial Analysis that measures the number of concurrent AI agents an inference system can support while meeting predefined, model-specific performance service level objective (SLO) tiers. An SLO is defined as a specific threshold of output token speed and time-to-first-token (TTFT). The benchmark results are normalized per accelerator and per megawatt to enable comparison across hardware configurations.
NVIDIA Achieves Leading Agentic Coding Performance on First Agentic AI Benchmark | NVIDIA Technical Blog…A Multi-Turn Benchmark for Evaluating Agentic Time Series Reasoning (2026) ProofAgent Harness: Open Infrastructure for Adversarial Evaluation of AI Agents (2026) Agent^2 RL-Bench: Can LLM Agents Engineer Agentic RL…
…web-browsing agent benchmark K-BrowseComp evaluates frontier LLMs' capabilities with 400 problems, showing significant performance gaps compared to English benchmarks and highlighting the need for more robust Korean AI development. Generated…
…Towards Proactive Document-Guided Actions in GUI Agents (2026) TOBench: A Task-Oriented Omni-Modal Benchmark for Real-World Tool-Using Agents (2026) Workspace-Bench 1.0: Benchmarking AI Agents on Workspace…
…A Benchmark for General-Purpose Terminal-Use Agents Published on Jun 26 Submitted by taesiri on Jun 30 AI at Meta Authors: Shoufa Chen , , Xuan Yang , , Yuren Cong , , , , , Abstract TUA-Bench presents…
Benchmarking AI agent retrieval strategies on Kubernetes bug fixes
submitted by /u/ZealousidealHunter80 to r/cybersecurity [link] [comments]
Someone modelled sugarcane farming as an integer program. See, sugarcane only grows next to water. Water costs one tile and can feed at most four cane tiles. The layout therefore becomes a coverage problem with a genuine…
Hi HN! Sina here. i wanted to share this open source project (apache 2.0) that i've been working on for the past month or so. it's called hotcell and it lets you create/pause/manage sandboxes on any device (your laptop, …
I built ZaGuu, an arena where AI agents play strategy games, negotiate, cooperate, betray, and build public records.The first game is Bank Heist, a Split-or-Steal style game where agents negotiate before making a final d…
…While companies struggle to quantify AI's impacts and deliver a meaningful ROI, Song believes the focus should be real-world impact rather than benchmark scores. AI agents should augment – not replace…
…in useful AI for enterprises. Harness Engineering, Not Fine-Tuning LangChain’s team ran Nemotron 3 Ultra against its public Deep Agents benchmark suite, then analyzed the deep agent’s execution traces…
…Benchmarking Persistent Sycophancy in Stateful Personal Agents (2026) EvoClawBench: Can Agents Learn Reusable Skills from Their Own Runs? (2026) Do Agent Benchmarks Measure Capability? Protocol Validity in the Age of Agentic AI…
Papers arxiv:2604.09408 HiL-Bench (Human-in-Loop Benchmark): Do Agents Know When to Ask for Help? Published on Apr 29 Submitted by Tu Trinh on May 5 Scale AI Authors…
…To address this gap, we present AutoMedBench, a workflow-aware benchmark for autonomous medical-AI research across diverse medical imaging and multimodal inference tasks, organizing agent execution into a unified five-stage…
…AI-generated summary LLM-based agents for GPU kernel generation are advancing rapidly, yet their progress is fundamentally constrained by the benchmarks they optimize against. Existing benchmarks are poorly aligned with production…
