Recent content on moomou

 Why
 # 
 
 I have been using sglang and vLLM as black boxes for a while. Paged KV
cache, continuous batching, prefill/decode split — I could repeat the
words but not actually draw the boxes. So I sat down with a coding
agent and rebuilt the smallest possible serving engine that still has
all of the real pieces, one lesson at a time. 
 The result is mini_sglang…

 Introduction
 # 
 
 In the age of coding agents, building software has never been cheaper
or easier. I can go from an idea to shipping working software in an
afternoon. I wanted to document a couple of these in this post and
argue that, in the era of AI coding, more software will be written and
increasingly cater to a smaller audience. 
 
 WinGroup
 #…

 Introduction
 # 
 
 I’ve been using Chef for server configuration for a while now. It works, but there’s always been friction. I don’t write Ruby anywhere else, so every time I need to update server configs, I’m context-switching into a language I’m barely literate in. Chef uses Ruby with its own DSL conventions, and while that’s arguably…

 Introduction
 # 
 
 Continuing the path of learning about deep learning, I have been working on building a diffusion/flow matching models from scratch on and off for a while. My initial goal was to build a flow-matching or diffusion model for audio with mel-spectrograms inputs. However, after struggling with eyeballing generated melspectrogram to determine if it’s good or…

 Overview
 # 
 
 Over the winter break, I was reviewing Fourier Transform and its various applications.
Fundamentally, Fourier Transform is about a shift in perspective - viewing the same data with a different lens makes some operations easier or faster. This piqued my curiosity about what other fundamental data transformations that I should be aware of. Like everyone in 2025,…

 Groot and Friends
 # 
 
 Navigating within a mono repo can be tedious. 
 I frequently find myself doing cd ../.. to navigate to sibling folders or jumping to the root of the git directory to navigate and inspect other part of the code base. 
 To navigate to the root of the Git repository, I use an alias groot defined as 
 alias groot='cd $(git rev-parse…

 Overview
 # 
 
 This is the first part of many posts I am writing to consolidate learnings on how to finetune Large Language Models (LLMs) to process audio, with the eventual goal of being able to build and host a LLM able to describe human voices. 
 I am motivated to gain hands-on experience tinkering LLMs so, as much as practical, I tried to recreate utilities and functions…

 Overview
 # 
 
 Recently, I went down a rabbit hole of debugging opensource LLM spewing gibberish on my PC.
The investigation was the one of the most difficult (but interesting) debugging experience I have encountered so far. 
 This blog will chronicle the problem I encountered, debugging steps I took, and finally, the resolution and workaround I adopted. 
 
…

 Introduction
 # 
 
 CORS stands for Cross-Origin-Resource-Sharing and is the HTTP mechanism to
allow servers to accept requests from other host locations other than its own. 
 Getting CORS up and running is not difficult. There are plenty of posts online that will
recommend a starting configuration that looks something like this, in pseudo code 
…
I have a PC with Ubuntu server installed and Nvidia GPUs attached. I have Googled on and off for a while trying to learn how to overclock the GPUs without success. 
 Finally, after gleaning bits and parts from different sources, I got power limit and overclocking working. 
 Here are the steps required 
 
 Virtual Monitor
 # 
 
 nvidia-settings need a monitor attached in…

 From m to m2
 # 
 
 Having used m for many years now, I encountered two primary problems. 
 The first is startup performance. Even with lazy module loading (see here ), calling m without any subcommands still took ~250ms on my laptop. 
 The second problem is code verbosity. To add a new command, one needs to create a new class in a separate file, import it in main, and…
Posted on go.mou.dev/triplet-embedding-learning

 2017-09
 # 
 
 
 LEARNING FINE-GRAINED IMAGE SIMILARITY WITH DEEP RANKING
 # 
 
 
 describes efficient sampling technique based on reservoir sampling for building triplets; requires an relevance function 
 multi scale CNN 
 
 
 
 DEEP METRIC LEARNING USING TRIPLET NETWORK
 # 
 
 
 learns a semantic embedding; results show…

 Fzf
 # 
 
 Amazing command line tool to fuzzy search for files. Cannot live without this. Also integrates with vim. 
 https://github.com/junegunn/fzf 
 
 Jq
 # 
 
 Swiss army knife for working with JSON on the command line 
 https://github.com/stedolan/jq 
 
 Pup
 # 
 
 Like Jq, but for HTML 
 https://github.com/ericchiang/pup…

 Commandline Productivity and Automation (aka make it easy to repeat)
 # 
 
 Developers tend to repeat themselves. A lot. This can be as innocuous as running a test manually after you update a test file or as insidious as deploying a newly built binary into production manually. Nobody likes to repeat themselves over and over again. And for good reasons. Not only does it take time…