Analyzing and Improving the Training Dynamics of Diffusion Models
This paper introduces layer magnitude preservation and post-hoc EMA tuning, reducing ImageNet-512 FID from 2.41 to 1.81, significantly improving diffusion model training stability and quality.
Tero Karras, Miika Aittala, Jaakko Lehtinen et al.