… The method executes non-monotonically: a Chinese Restaurant Process CRP prior and context-aware Gibbs scheduling actively search for and anchor stable sequence segments first such as initial setups and final answer formats . …
… OmniOPD replaces deterministic logit matching with Monte Carlo rollouts that approximate the teacher's local preferences through a continuous semantic similarity metric over multi-token chunks, and concentrates this supervision via a peak-entropy scheduler that audits the student only at its high-u… …
… The following papers were recommended by the Semantic Scholar API Dual-Space Knowledge Distillation with Key-Query Matching for Large Language Models with Vocabulary Mismatch 2026 When Perplexity Lies: Generation-Focused Distillation of Hybrid Sequence Models 2026 OPSDL: On-Policy Self-Distillation… …