Scale AI with Sovereignty, Control, and Choice
…With agentic AI, the metrics for tracking success are even more complex. But benchmarks don't answer the question that actually matters: Should you undertake this effort and is it viable for…
Search
All sources
huggingface.co
54
amd.com
33
developer.nvidia.com
9
wccftech.com
4
techcrunch.com
4
blogs.nvidia.com
3
semiwiki.com
2
neowin.net
2
techradar.com
1
arstechnica.com
1
cloud.google.com
1
wired.com
1
People also ask
What is AA-AgentPerf?
AA-AgentPerf is a hardware benchmark created by Artificial Analysis that measures the number of concurrent AI agents an inference system can support while meeting predefined, model-specific performance service level objective (SLO) tiers. An SLO is defined as a specific threshold of output token speed and time-to-first-token (TTFT). The benchmark results are normalized per accelerator and per megawatt to enable comparison across hardware configurations.
NVIDIA Achieves Leading Agentic Coding Performance on First Agentic AI Benchmark | NVIDIA Technical BlogVideos
More videosTop stories
Developing NVIDIA Holoscan Applications with CLI, Skills, and AI Coding Agents | NVIDIA Technical Blog
2d agoPaper page - SWE-Bench ProMax: Benchmarking Agents on Large-Scale Multilingual Code Refactoring
1w agoPaper page - Multi-Agent Forensic Reasoning for Generalizable Deepfake Video Detection
1w agoPaper page - Do AI Personas Grow? Analyzing and Benchmarking Personality Evolution in LLM Agents After Life Events
1w agoPaper page - WildClawBench: A Benchmark for Real-World, Long-Horizon Agent Evaluation
…A Live Agent Benchmark for Evolving Real-World Workflows (2026) Beyond Binary Correctness: Scaling Evaluation of Long-Horizon Agents on Subjective Enterprise Tasks (2026) AcademiClaw: When Students Set Challenges for AI Agents…
Paper page - EMBL AI Librarian: Life-Sciences Knowledge Layer for AI Agents
Papers arxiv:2607.28229 EMBL AI Librarian: Life-Sciences Knowledge Layer for AI Agents Published on Jul 30 Submitted by Luigi Sigillo on Aug 3 European Molecular Biology Laboratory Authors: Luigi Sigillo…
Paper page - OSWorld2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks
…Benchmarking Desktop Agents on Professional Workflows and Human-in-the-Loop Collaboration (2026) TUA-Bench: A Benchmark for General-Purpose Terminal-Use Agents (2026) MacAgentBench: Benchmarking AI Agents on Real-World macOS…
Discussions and forums
Benchmarking AI agent retrieval strategies on Kubernetes bug fixes
Benchmarking AI agent retrieval strategies on Kubernetes bug fixes
2
Open-source benchmark for AI pentesting agents on real infrastructure
submitted by /u/ZealousidealHunter80 to r/cybersecurity [link] [comments]
People are using Minecraft farms as AI agent benchmarks
Someone modelled sugarcane farming as an integer program. See, sugarcane only grows next to water. Water costs one tile and can feed at most four cane tiles. The layout therefore becomes a coverage problem with a genuine…
Show HN: Hotcell – local sandboxes for AI agents
Hi HN! Sina here. i wanted to share this open source project (apache 2.0) that i've been working on for the past month or so. it's called hotcell and it lets you create/pause/manage sandboxes on any device (your laptop, …
2
3
ZaGuu – an arena where AI agents play negotiation games and build identities
I built ZaGuu, an arena where AI agents play strategy games, negotiate, cooperate, betray, and build public records.The first game is Bank Heist, a Split-or-Steal style game where agents negotiate before making a final d…
1
1
Paper page - UniClawBench: A Universal Benchmark for Proactive Agents on Real-World Tasks
…Benchmarking Multilingual Long-Horizon LLM Agents (2026) Workflow-GYM: Towards Long-Horizon Evaluation of Computer-use Agentic tasks in Real-World Professional Fields (2026) MacAgentBench: Benchmarking AI Agents on Real-World macOS…
Create a LangChain Deep Agents Harness Profile for NVIDIA Nemotron 3 Ultra to Improve Performance | NVIDIA Technical Blog
Agentic AI / Generative AI Create a LangChain Deep Agents Harness Profile for NVIDIA Nemotron 3 Ultra to Improve Performance Learn how to use harness engineering to improve agent accuracy without fine-tuning…
A Java library just tried to trick AI coding agents into deleting your tests, and it almost worked
The latest flare-up in the debate over AI-assisted coding did not come from a new model release or a benchmark result. It came from a single line of text buried…
Simplifying Enterprise AI with Nutanix Enterprise AI
…With agentic AI, the metrics for tracking success are even more complex. But benchmarks don't answer the question that actually matters: Should you undertake this effort and is it viable for…
Modernize Virtualization and Enable AI with Red Hat OpenShift
…With agentic AI, the metrics for tracking success are even more complex. But benchmarks don't answer the question that actually matters: Should you undertake this effort and is it viable for…
Paper page - MCP-Persona: Benchmarking LLM Agents on Real-World Personal Applications via Environment Simulation
…Benchmarking AI Agents on Workspace Tasks with Large-Scale File Dependencies (2026) VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions (2026) SimuWoB: Simulating Real-World Mobile Apps…