Paper page - BlockPilot: Instance-Adaptive Policy Learning for Diffusion-based Speculative Decoding
… In this paper, we show that this assumption is suboptimal, as the optimal block size varies across samples and plays a critical role in speculative decoding performance. …