FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness | Paper Notes

Paper notes for FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness.