cs.LG 2608.03447

Approximate Speculative Decoding

Proposes Approximate Speculative Decoding (ASD), a zero-training verifier that boosts throughput by up to 15.26% via budgeted longest-prefix selection.

Yuannuo Feng, Zegang Peng, Yuxin Xie et al.

2026-08-04 41