A Variational Lens on RL in Diffusion Models.

DiPOD: Diffusion Policy Optimization without Drifting Apart Diffusion language models are an exciting alternative to autoregressive language models. Instead of generating a response strictly left-to-right, they can refine many tokens in parallel. This opens the door to faster sampling, flexible decoding orders, and possibly new ways of doing long-form reasoning. But there is a gap between this…