Diffusion is not necessarily Spectral Autoregression
Diffusion is not necessarily Spectral Autoregression tl;dr. DDPM diffusion models perform approximate autoregression in the Fourier domain, generating components from low to high frequency, but this inductive bias is not a necessity: diffusion models without any frequency hierarchy can perform equally well, and demonstrate improved high-frequency generation quality. In this blog post, we want to…