HotFlow - a probablistic CFG profiler that I've written to help optimizing CPU inference for ...

HotFlow - a probablistic CFG profiler that I've written to help optimizing CPU inference for my tools Goosedump and ReadSeek. Inference is quite nasty and tricky to profile by measurement given maximization in scaling. E.g., when you optimize dedicated hardware for inference it's a minmax optimization to thenear proximity as possible of OOM as one can reach. Since I'm not really seasoned on doing…