…Although frontier models achieve relatively strong performance on direct expression evidence, performance drops substantially on functional, indirect, and weak-support evidence, with evidence-type confusion emerging as a dominant failure mode. Open…
…Yumin Choi , Sangwoo Park , , , Abstract Preping is a framework for pre-task memory construction that uses proposer-guided synthetic practice to improve agent performance in new environments with reduced deployment costs. AI…
…target success , preservation success , and joint success . Using this benchmark, we evaluate mainstream Speech LLMs and specialized speech editing systems. The results reveal three key findings: (1) no single model performs well…
…the trade-off between target-task adaptation and resistance to forgetting. We introduce PEFT-Arena , a benchmark that jointly measures downstream performance and general capability retention . Across methods, we find distinct stability…
…Bohan Lyu , , , Jiaru Zhang , Qixin Xu , , , , , , , , , Junlin Yang , , , , , , , , Abstract Current AI agents struggle to invent generalizable and scalable machine learning methods, relying more on engineering tuning than true method discovery, with performance…
…Shijue Huang , , , , , , , , , Abstract A visual-native agent harness with image bank reference protocol enables reusable intermediate visual evidence and closed-loop data generation that improves multimodal deep search performance across multiple benchmarks…
…By learning a performance-aware latent space over model--dataset--metric tuples , ModelLens ranks unseen models on unseen datasets without running candidates on the target dataset. On a new benchmark of 1…
…Jack Young Abstract WriteSAE enables sparse autoencoder decomposition and editing of matrix cache writes in state-space and hybrid recurrent language models, achieving superior performance in token-level interventions compared to existing…
…proposes tokens which the target model then verifies in a single forward pass. Although the drafter network is small in modern architectures, its LM-head still performs projection to a large vocabulary…
…markets in order to perform reliably. The paper reports concrete failure modes, fabricated rules, fee paralysis, numeric anchoring, cadence trading, and tokenomics misreads, and shows how targeted harness changes reduced them. It…