…framework that improves image edit evaluation by iteratively developing tools and skills from limited human demonstrations, achieving superior performance compared to existing models. AI-generated summary Evaluating instruction-guided image edits requires…
…This remains the most persistent weakness across all 17 evaluated models (including frontier models from Google, OpenAI, Anthropic, and the Qwen family). ⚖️ New Evaluation Paradigm: We decouple raw correctness from strict safety…
…Evaluating Multimodal Agent Memory Through Action-World Interaction Published on May 28 Submitted by taesiri on May 29 Authors: , , , , , , , , , , , , , , , , Abstract Multimodal large language models require sophisticated memory systems that can track evolving…
…Wei Pang , Xiangru Jian , , , , , Zhengyuan Dong , , , , , , Abstract TRL-Bench establishes a standardized benchmark for evaluating tabular representation learning models across multiple granularities, revealing that encoder performance varies by task type and requires…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Skills, i.e., structured workflow instructions distilled for large language models (LLMs), are becoming an increasingly important mechanism for improving agent performance on real…
…The following papers were recommended by the Semantic Scholar API MemLens: Benchmarking Multimodal Long-Term Memory in Large Vision-Language Models (2026) UniVLR: Unifying Text and Vision in Visual Latent Reasoning for…
…Training Robust Multilingual Code Reward Models for Flexible Multi-Criteria Scoring Published on May 1 Submitted by Indraneil Paul on May 4 Themis Authors: Indraneil Paul , , Abstract Researchers introduce Themis-RM, a…
…The following papers were recommended by the Semantic Scholar API Benchmarking Speech-to-Speech Translation Models (2026) SpeechEditBench: A Bilingual Multi-Attribute Benchmark for Instruction-Guided Speech Editing (2026) KVoiceBench, KOpenAudioBench, and…
Papers arxiv:2605.04045 Audio-Visual Intelligence in Large Foundation Models Published on May 5 Submitted by Hao Fei on May 8 National University of Singapore Authors: , , Shengqiong Wu , , , , , , , , , Lei Cui , , , Hao…
…The following papers were recommended by the Semantic Scholar API Adaptive Cost-Efficient Evaluation for Reliable Patent Claim Validation (2026) MetaGAI: A Large-Scale and High-Quality Benchmark for Generative AI Model…