Bridging Model-Based Optimization and Generative Modeling via Conservative Fine-Tuning of Diffusion Models
BRAID leverages conservative reward modeling to fine-tune diffusion models, outperforming offline data with 15-20% reward gains while avoiding invalid designs.
Masatoshi Uehara, Yulai Zhao, Ehsan Hajiramezanali et al.