Chunkwise linear attention and DeltaNet (Part 3)

Why per-token recurrences are slow on GPUs, how chunkwise DeltaNet uses the WY representation, and how MQAR shows empirically the improvements of delta rule and gating in fixed-state recurrences.