Inventing Transformers

A branching tech tree of the Transformer: the path of innovations from 2012 to 2017 - AlexNet, Word2vec, Attention, ResNet and more - drawn as glowing nodes on a skill-tree diagram, each one unlocking the next on the way to the architecture behind modern AI.