GPU MODE Lecture 11: Sparsity

Tip This post is part of the following series: GPU MODE Lecture Notes : My notes from the GPU MODE reading group lectures run by Andreas Kopf and Mark Saroufim . Introduction The Performance Challenge of Sparsity Unstructured Sparsity and Its Limitations on GPUs Semi-structured Sparsity (2:4 Sparsity) Block Sparsity Composing Sparsity with Quantization Sparse Training Future Directions and…