Attention – 3D Similarity Cube

Traditional machine learning models are built to generalize. And while that works well in many cases, it’s also their Achilles‘ heel, they often miss the sharp edges, the anomalies, the rare patterns that matter most. But transformers changed the game. In this post, I introduce a new mental model for understanding attention: the 3D similarity […]