RSSAmplifier

Blog

Consider the Bulldog

A good site

considerthebulldog.comRSS feed ↗3 posts

Latest posts

Thinking in Pallas - Sharded MatMuls

Writing your first Pallas kernel Express Yourself The Pallas API is relatively small. In exchange for that limited surface area, you the developer are responsible for keeping a lot in your head. Managing different memory spaces, data hazards, synchronization, etc. Intimacy with the execution model helps us to imagine what should happen, but coaxing the provided constructs into a nicely composed,…

Touching the Elephant - TPUs

Something New There is mythological reverence for Google’s Tensor Processing Unit. While the world presently watches NVIDIA’s gravity drag more companies into its orbit, there sits Google, imperial and singular. Lots of companies participate in the “Cambrian-style explosion of new-interesting accelerators” [14] – Groq, Amazon, and Tenstorrent come to mind – but the TPU is the original existence…

Ununderstanding

My dog and I walk three times a day. When she smells something interesting, everything else disappears. Seventy five pounds of maniacal focus circling and pawing and rolling. She drops her chest low to the ground expecting the tug of her leash. She knows this drives me crazy, but she knows that my will to keep walking is weaker than her will to keep smelling. As she circles and paws and rolls, I…