Paper page - WARP: Weight-Space Analysis for Recovering Training Data Portfolios
… Introducing WARP: a new strategy to estimate domain mixtures from model weights alone! …
Filtered by topic: In the Weights Clear ✕
Tracked topic
… Introducing WARP: a new strategy to estimate domain mixtures from model weights alone! …
Papers arxiv:2608.01851 Weights or Skills? …
… PAW enables: 🎮 Alien Taboo : give an alien free-form clues and see whether it can guess your secret word 🤖 Avatar Director : describe an action in natural language and watch a 3D character perform it 🌳 Website Helper : ask questions about a website and get grounded answers with relevant information… …
… Generated by thinkingmachines/Inkling-Small We identify a previously overlooked failure mode of ALiBi positional encoding : its linear bias scaling underflows floating-point precision, which zeroes out a large fraction of attention weights and renders the affected attention heads partially blind. …