Rec-Distill: An Industrial Distillation Pipeline for Large-Scale Recommendation Models
Rec-Distill employs decoupled training to distill 24B-parameter teacher models, achieving over 60% transferability in industrial recommendation tasks.
Haoran Ding, Wenlin Zhao, Yuchen Jiang et al.