Smarter Systems with Leaner Models

This post is a write-up of my talk at The Economist's Impact 2nd AI Compute Summit . You can find the slides here . LLMs keep getting smarter, month by month. But they also get bigger, more hardware- and resource-intensive, and more difficult to run efficiently, and even if token costs keep getting slashed, the AI bills of most companies just go up. Is it still possible to build state-of-the-art…