Disclaimer: The views and opinions expressed in this post are my own and do not necessarily reflect the official policy or position of my employer.
As someone who’s worked with TPUs for a while, I’ve seen a common pattern in people coming from the GPU world: they’ll take a look at a TPU chip’s specs, then look at a comparable GPU, and see numbers for the GPU chip that are obviously higher and scratch their head. Let’s look at TPU v5p (the training-optimized chip released in 2023) compared to the Nvidia H200 (the flagship AI GPU also released in 2023):
Comments
Nothing yet. Say the first thing.
Sign in to join the conversation.