[8 September 2025] Interesting Things I Learnt This Week

1. Multi-Token Prediction Reshapes LLM Training Paradigms - This research proposes that training large language models to predict multiple future tokens simultaneously, rather than just the next one, improves sample efficiency. The approach involves the model predicting the next 'n' tokens at each position in the training data using separate output heads on a shared model base. When used as an…