LLM performance plateaus confirmed by David Silver and Richard Sutton

Top DeepMind veterans argue that LLM progress is stalling due to exhausted high-quality text data