…frameworks and benchmarks were created using data from game jam competitions to evaluate code generation and project-level programming capabilities. Generated by Qwen/Qwen2.5-Coder-32B-Instruct Current AI-driven game…
…We address these demands with a closed agent loop in which a VLM orchestrates heterogeneous robot capabilities as interruptible tools . Unlike in virtual AI agents, the timing of decisions, actions and tool…
…AI-generated summary Voice agents , artificial intelligence systems that conduct spoken conversations to complete tasks, are increasingly deployed across enterprise applications. However, no existing benchmark jointly addresses two core evaluation challenges: generating…
…A Document Parsing Benchmark for AI Agents (2026) Self-Ensembling Vision-Language Models for Chart Data Extraction (2026) Dr. DocBench: A Comprehensive Benchmark for Expert-Level and Difficult Document Parsing (2026) ABot…
…Towards Medical AutoResearch with Agentic AI Models (2026) Towards Autonomous and Auditable Medical Imaging Model Development (2026) HealthAgentBench: A Unified Benchmark Suite of Realistic Agentic Healthcare Environments for Challenging Frontier AI Agents…
…Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits (2026) CuTeGen: An LLM-Based Agentic Framework for Generation and Optimization of High-Performance GPU Kernels using CuTe (2026) CuBridge…
…Memory-as-Embedding Routing for Long-Term Conversational Agents (2026) MEMTIER: Tiered Memory Architecture and Retrieval Bottleneck Analysis for Long-Running Autonomous AI Agents (2026) EviMem: Evidence-Gap-Driven Iterative Retrieval for…
…Based on the same pipeline and a disjoint test pool, we further construct SkillEval , a held-out executable benchmark for evaluating skill use. Experiments across diverse models, benchmarks, and agent harnesses show…
…Self-Improving Web Agent via Cognitive-Aware Exploration (2026) Continual Learning Bench: Evaluating Frontier AI Systems in Real-World Stateful Environments (2026) AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real…
…Memory Organization and Retrieval via Adaptive Graph Intelligence for LLM Conversational Agents (2026) EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective (2026) GAM: Hierarchical Graph-based Agentic Memory for LLM Agents…