Scaling the model isn’t enough: A lesson from chess engines

I’ve been learning about chess engines, and one of the things that surprised me most is the neural net at the heart of the strongest engine in the world. The rule I’d internalized about deep learning was that complex problems need deep networks.