…In this paper, we present OpenSkillEval, an automatic evaluation framework for both skill-augmented agent systems and the skills themselves. Instead of relying on static benchmarks, OpenSkillEval automatically constructs realistic task instances…
…We present FinanceHarness , a harness that runs finance-oriented tools and practitioner-guided workflows, automating financial deep research end to end: environment and data construction, the agent execution loop , and reward modeling…
…We observed improvements in Agent's environment interaction KPI such as tool success rate and tool parameter accuracy . The framework also offers new metrics such as Execution Quality to generate new insights…
…Gianluca Barmina , , , Lukas Galke Poech , Abstract BrainSurgery is a tool for robust and reproducible tensor manipulation of neural network checkpoints through declarative YAML plans with built-in validation. Generated by Qwen/Qwen2…
…An Agentic System for Automated and Traceable LLM Evaluation (2026) GTA-2: Benchmarking General Tool Agents from Atomic Tool-Use to Open-Ended Workflows (2026) HWE-Bench: Benchmarking LLM Agents on Real…
Papers arxiv:2608.04436 ToolArtist: Tool-Using Unified Multimodal Models for Agentic Image Generation Published on Aug 5 Submitted by taesiri on Aug 6 #3 Paper of the day Authors: Jiahao Zhao…
…ToolCUA/ View arXiv page View PDF Project page GitHub 32 Add to collection Community We introduce ToolCUA, an end-to-end agent for optimal GUI-Tool path orchestration, by leveraging an automated…
…Through an automatically instrumented Monitor , it captures and generates standardized execution traces during experiments. In the Evaluation stage, A^2E systematically assesses harness capabilities using a suite of multidimensional metrics . Compared with…
…By comparing predicted judgments with ground-truth preferences and analyzing successes and failures in the reasoning process, the Orchestrator automatically refines its library of tools and skills without additional human annotation. Using…
…Harnessing Phone-Use Agents through Mixed GUI, CLI, and Tool Actions Published on Jun 12 Submitted by Chenxin Li on Jun 16 Authors: Chenxin Li , , Zhengyang Tang , , , , , , , , Junyi Li , , , , Sunqi Fan , , , , , , Abstract…