jarkko's timeline · Aug 20, 2026
HotFlow - a probablistic CFG profiler that I've written to help optimizing CPU inference for ...
0Sign in to vote or save
HotFlow - a probablistic CFG profiler that I've written to help optimizing CPU inference for my tools Goosedump and ReadSeek. Inference is quite nasty and tricky to profile by measurement given maximization in scaling. E.g., when you optimize dedicated hardware for inference it's a minmax optimization to thenear proximity as possible of OOM as one can reach. Since I'm not really seasoned on doing…
Comments
Nothing yet. Say the first thing.
Sign in to join the conversation.