How Subquadratic Won by Giving Up on Replacing Transformers

Subquadratic architectures won by surrendering. They stopped trying to be transformers and became the substrate transformers run on top of — in a 3:1 ratio that is starting to look uncannily empirical.