This page cannot be shown here. You can still read it on the original site — the toolbar below keeps your place in the directory.

 Why
 # 
 
 I have been using sglang and vLLM as black boxes for a while. Paged KV
cache, continuous batching, prefill/decode split — I could repeat the
words but not actually draw the boxes. So I sat down with a coding
agent and rebuilt the smallest possible serving engine that still has
all of the real pieces, one lesson at a time. 
 The result is mini_sglang…
Comments
Nothing yet. Say the first thing.
Sign in to join the conversation.