Non-Linear Attention and Test-Time-Training (Part 2)

From TTT and Titans to the four axes of MIRAS — reframing the hidden state as a tiny model trained online, and placing every modern sub-quadratic architecture (DeltaNet, Mamba2, Gated DeltaNet, TTT, Titans, KDA, ATLAS) on four design choices.