In praise of smaller large language models

Part of my side-project s codebase uses Flan T5 XL for some generative tasks. Flan T5 is an LLM that was released in October 2022. The XL version that I use has 3 billion parameters. Might sound like a lot but it s small by modern standards. Kimi K3 has 2.8 trillion parameters. It has been hogging [ ]