napkin llm router math
napkin math on whether llm routers are worth it.
Imprint
I'm an early-career engineer who writes to think. Expect {distributed, operating, database} systems, neuro, and whatever I'm currently building or breaking.
Latest posts
run multiple docker compose instances for your agents
Building Docktree, a drop-in isolated Docker Compose layer per git worktree, so parallel agents or PRs stop fighting over ports and container names.
On Customizable software
A hands-on write-up of using coding agents to trace and patch Codex ACP so ChatGPT login works in Zed remote projects, and what that experience felt like in practice.
dfs and bfs in the wild
Building a static analysis tool that detects concurrency bugs in Go
CFG, Data Flow Analysis and SSA
Compilers use static analysis to determine where transformations can be safely applied. Control flow and data flow analysis are two techniques often used in compiler optimization. Control-flow analysis seeks to understand the flow of control between operations, and data-flow analysis(DFA) analyses the flow of actual values through the code and operations. SSA is an intermediate representation that…
Relish being bored
A reflection on reclaiming the empty spaces in our day, resisting the urge to fill every second with stimulation, and why being bored is actually a superpower.
Connecting to multiple tailscale networks on a single host
Running two separate Tailscale tailnets on one Linux machine using network namespaces and a second tailscaled instance.
Infra and devtool themes I'm excited about in 2024
A survey of the infrastructure layer beneath foundation models — from compute and deployment to prompt tooling, vector databases, and AI-native dev tools.
AI-native software infrastructure: what I was excited about in 2023
A survey of the infrastructure layer beneath foundation models — from compute and deployment to prompt tooling, vector databases, and AI-native dev tools.
bitter amhdal and gustafon law lesson with agents.
# systems-pov of agentic code verification.
Python Attribute Lookup
Python Attribute Lookup In an effort to understand the very basics, I've been implementing classes in Python from scratch, starting with the functions and dictionaries. I was curious how to implement attribute lookup how python actually does it. So I went down a rabbit hole and came across this article that covers it exhaustively. Learned a great deal about how alot of the higher level ORMS,…
Binary Heaps in Python
Understanding binary heaps and their implementation in Python