How to scale LLMs to 100 million tokens without blowing up memory costs

Memory Sparse Attention (MSA) scales LLM context windows to an unprecedented 100 million tokens while preserving accuracy.