Flavors of attention in modern diffusion models

Attention is a crucial component in generative neural architectures for continuous modalities like images and videos from natural language. More specifically, cross-attention helps to contextualize the relationship between the natural language prompt inputs and the media, being generated. With modern diffusion models (or shall we say “flow”) for condition-guided image and video generation, we saw…