Udit Saxena's blog Where I write mostly about engineering and technology, along with a healthy dose of creative outputs, and reflective and intrusive rumi...
In Cycles and Patterns I talk about how I think most systems - global or local - work. A quick reminder: Cycles : Cycles are instances of the same idea happening in the same domain after some unspecified amount of time. Patterns : Patterns are the occurrence of one idea across different domains. I'd like to embellish the idea with a few visualizations, some of which I hope are useful for me and…
An overview of major techniques I recently gave a talk on Speculative Decoding for the EleutherAI ML Performance Reading Group, focusing on how modern speculative sampling techniques improve LLM inference latency and throughput. The talk covers the evolution of speculative decoding from both a research and systems perspective, including: The original speculative decoding framework introduced…
(As Airflow Summit 2025 wraps up, this is a repost of my presentation at last year's Airflow Summit 2024 in San Francisco) Revolutionizing Contact Centers with Generative AI ASAPP is the definitive generative AI company for contact centers. Named not only a leader in The Forrester Wave™: Digital Customer Interaction Solutions, Q2 2024 report, but also “this market’s undisputed leader in AI-led…
(Steeped in AI, I'm fully aware that I'm writing this as the words "agent", "agentic", and "agency" are over-used in conversations - at least in what I believe my readers' circles are - but bear with me) As someone who enjoys exploring and walking around in cities and has also moved around a fair bit, I sometimes find myself having strong opinions about public transit. I don't have a car yet, and…
or “History doesn’t repeat, but it sure does rhyme” As the year comes to an end, and folks start to publish their end of the year reflections (here are some fantastic ones ), whether in writing, or on social media, I thought I would add my own flair to that trend and talk about something that’s been constantly on my mind over the last year (less concretely, over the last few years). It’s something…