Qwen 3.5 397B on a MacBook @ 29 tokens / s

A year ago I would just read about 397B league of models. Today I can run it on my laptop. The combination of llama.cpp s importance matrix (imatrix) with Unsloth s per-model adaptive layer quantization is what makes it all possible Qwen3.5-397B-A17B is an 807GB beast that, even at Q4, would need more than 200GB of GPU [ ] The post Qwen 3.5 397B on a MacBook @ 29 tokens / s first appeared on . kam…