Paper page - SPOT: Sparse Probing and Outcome Calibration for On-Policy Distillation
…We introduce Sparse Probing and Outcome-calibrated Targets OPD (SPOT), which addresses two coupled decisions, where to probe and what to distill, through an acquisition--exploration--exploitation procedure. During acquisition, a position…