Why vllm.cpp exists

&#xA; I love vLLM, I really mean it. It made AI inferencing affordable and fast, but it has a cost.&#xA;A vLLM install here is also 9.1 GiB of virtualenv, a CUDA runtime, a&#xA;pinned torch, and a dependency tree somebody has to scan for CVEs every week, if you take care about security. I&#xA;did that for a while, but one of the things that broke me is trying to maintain vLLM in LocalAI. It is…