Flash Attention from Scratch Part 1: Intro

Intro In this 10-part series, we re going to implement Flash Attention 2 from scratch on Ampere GPUs.