Writing your first Pallas kernel Express Yourself The Pallas API is relatively small. In exchange for that limited surface area, you the developer are responsible for keeping a lot in your head. Managing different memory spaces, data hazards, synchronization, etc. Intimacy with the execution model helps us to imagine what should happen, but coaxing the provided constructs into a nicely composed,…
Something New There is mythological reverence for Google’s Tensor Processing Unit. While the world presently watches NVIDIA’s gravity drag more companies into its orbit, there sits Google, imperial and singular. Lots of companies participate in the “Cambrian-style explosion of new-interesting accelerators” [14] – Groq, Amazon, and Tenstorrent come to mind – but the TPU is the original existence…
My dog and I walk three times a day. When she smells something interesting, everything else disappears. Seventy five pounds of maniacal focus circling and pawing and rolling. She drops her chest low to the ground expecting the tug of her leash. She knows this drives me crazy, but she knows that my will to keep walking is weaker than her will to keep smelling. As she circles and paws and rolls, I…