Intuitions behind Attention in Neural Networks

If ReLU is a diode, attention is a transistor.