Touching the Elephant - TPUs

Something New There is mythological reverence for Google’s Tensor Processing Unit. While the world presently watches NVIDIA’s gravity drag more companies into its orbit, there sits Google, imperial and singular. Lots of companies participate in the “Cambrian-style explosion of new-interesting accelerators” [14] – Groq, Amazon, and Tenstorrent come to mind – but the TPU is the original existence…