AA-AgentPerf is a hardware benchmark created by Artificial Analysis that measures the number of concurrent AI agents an inference system can support while meeting predefined, model-specific performance service level objective (SLO) tiers. An SLO is defined as a specific threshold of output token speed and time-to-first-token (TTFT). The benchmark results are normalized per accelerator and per megawatt to enable comparison across hardware configurations.
NVIDIA Achieves Leading Agentic Coding Performance on First Agentic AI Benchmark | NVIDIA Technical Blog…Benchmarking leading agentic frameworks and LLM backbones reveals that existing systems remain far from reliable on real-world memory tasks , highlighting the need for new architectures for grounded AI memory that can…
…In recent months, Benchmark backed two Series B startups: Gumloop , a platform that allows enterprises to create AI agents without writing code, and Monaco, an AI-native sales and CRM platform. Benchmark…
…This conclusion is further supported by evaluation on open-source safety benchmarks (AgentHarm, Agent Safety Bench) and utility benchmarks (BFCL, API-Bank), confirming that warming up the agent with regular agentic tasks…
…AI-generated summary With the advancement of multimodal large language models (MLLMs) and coding agents , the website development has shifted from manual programming to agent-based project-level code synthesis. Existing benchmarks…
Benchmarking AI agent retrieval strategies on Kubernetes bug fixes
submitted by /u/ZealousidealHunter80 to r/cybersecurity [link] [comments]
Someone modelled sugarcane farming as an integer program. See, sugarcane only grows next to water. Water costs one tile and can feed at most four cane tiles. The layout therefore becomes a coverage problem with a genuine…
Hi HN! Sina here. i wanted to share this open source project (apache 2.0) that i've been working on for the past month or so. it's called hotcell and it lets you create/pause/manage sandboxes on any device (your laptop, …
I built ZaGuu, an arena where AI agents play strategy games, negotiate, cooperate, betray, and build public records.The first game is Bank Heist, a Split-or-Steal style game where agents negotiate before making a final d…
…https://lh-harness.pages.dev Interesting approach! Separating task state from execution and verifying it independently seems like a practical way to improve reliability for long-horizon AI agents. The benchmark improvements…
…Sleeper Attack on Large Language Model Agents (2026) AgentCanary: A Security Evaluation Framework for Autonomous AI Agents in Real Executable Environments (2026) Benchmarking Autonomous Agents against Temporal, Spatial, and Semantic Evasions (2026…
…It's a CPU that is purpose-built for Agentic AI and Inference domains. Now, the first benchmarks of NVIDIA's Vera CPU have been published by Phoronix , and they showcase a…
…July 23, 2026 Benchmarking AI Systems: from Model Metrics to Real-World Performance The agentic AI stack has evolved to fast multi-model orchestration, tool-augmented reasoning, and long-running inference chains…
…July 23, 2026 Benchmarking AI Systems: from Model Metrics to Real-World Performance The agentic AI stack has evolved to fast multi-model orchestration, tool-augmented reasoning, and long-running inference chains…
To show you the most relevant results, we’ve omitted some entries very similar to those already shown. Repeat the search with the omitted results included.
