Let’s Stop Calling Everything “Linear Attention”

Let s Stop Calling Everything “Linear Attention” If your “constant-time” attention still scans a million tokens, we need to talk. “Linear attention” is becoming the gluten-free of AI architecture terminology: everyone puts it on the label, nobody agrees what it means, read more