Rohan Gupta's personal website
Claude 3+ doesn’t ship with an open tokenizer. If you’re building coding agents, that’s a practical problem. You either call Anthropic’s count_tokens for everything (slow, online, awkward) or use a proxy estimator ( tiktoken , wc -c // {3,4} ) and accept large systematic error - up to 20–50% for Claude models. As agents increasingly self-manage context, they need a fast,…
Every systems engineer at some point in their journey yearns to write a filesystem. This sounds daunting at first - and writing a battle-tested filesystem is hard - but the minimal surface area for a “working” FS is surprisingly small, simple, and in-distribution for coding agents. In fact, one of my smoke tests for new coding models is seeing how good of a filesystem they can…
Entropy # Entropy is the ultimate boss battle [1]. As the reason why ice melts, why tires burst, and why ink diffuses – thermodynamic entropy is a fact of the physical world, sharply following the arrow of time [2]. The Second Law of Thermodynamics states For an isolated system, entropy will either increase or remain the same over time; decreases require exporting entropy to the environment.…
I recently hit a somewhat important milestone in my life: one year as a Vim user. Despite its steep learning curve, I used to think that mastering Vim was mostly about habit formation. I swore by the cheatsheets and believed I would be golden. After all, a text editor couldn’t be too terribly complex, right? However, I soon realised how little I knew about Vim and how much there really was…
College. Times of fun, frolic, and of course, learning. For a couple days now, I’ve been thinking about the past 2 years of my life, focusing on the most meaningful aspects. I needed a place to write my reflections down, so I thought perhaps this would make for a fitting first blog post. So here’s a couple shoddily jotted down thoughts on what I think have been my most significant…