Similarity is (almost) all you need

From spectral clustering to Gaussian processes to transformer attention, the same primitive, a similarity matrix between points, keeps showing up as the load-bearing piece of very different models.