Llama.cpp with Vulkan

Running Llama.cpp with the Vulkan backends of my AMD and Intel graphic GPUs ends up being straightfoward and surprisingly fast. Build you container with: podman build -t llama-cpp-vulkan --target server -f .devops&#x2F;vulkan.Dockerfile . and run it with: podman run -it --rm --security-opt seccomp=unconfined --device &#x2F;dev&#x2F;dri:&#x2F;dev&#x2F;dri --volume…