Revisiting Lossy Verification in Speculative Decoding: Mechanisms, Trade-offs, and Failure Modes
This paper systematically analyzes lossy verification in speculative decoding, classifying into truncation and collaborative methods, revealing their mechanisms, pitfalls, and control principles.
Tianyu Wang, Yuxuan Zhou, Wenbin Wang et al.