Real-World Impact of Our Research

Academic research sometimes risks to be disconnected from real-world applications. Research from our group demonstrated significant real-world impact across multiple domains, from improving the efficiency of LLM inference and training to new state-of-the-art evaluation protocols, and contributing to several industry products. Industry Adoption KV Cache Compression Our work on KV cache compression…