Using human feedback to align a diffusion model with DPO

This article is aimed at those who want to do post-training alignment of generative models, but aren&rsquo;t sure where to start. I give a end-to-end example of using human feedback data to align a generative model with direct preference optimization (DPO). I cover these steps: