cs.CL 2605.31490

Are Full Rollouts Necessary for On-Policy Distillation?

Proposed horizon-control strategies—Progressive OPD and Truncated OPD—significantly improve long-horizon on-policy distillation efficiency, achieving 3× faster training and comparable performance with only 10% rollout length.

Yaocheng Zhang, Jiajun Chai, Yuqian Fu et al.

2026-05-30 47