Flash Attention Version 1
The first flash attention implementation in the cobraml repo
Low Level Machine Learning
Check out my latest articles!
Latest posts
Registers, Best Practices
How to avoid register spillage
ldmatrix Explained
How to utilize the ldmatrix ptx instruction