Flash Attention from Scratch Part 5: Cutlass GEMM Optimizations

Intro In the previous part, we implemented swizzling and achieved a dramatic 2x performance improvement by eliminating bank conflicts.