Zero-Allocation LLM Inference on the Metal: The Transformers-Ultra Architecture

How we dropped token stepping latency to <5µs, built in-place Slotted Static KV caching, fused in-register sampling, and native Apple Silicon Metal MSL simdgroup GEMM kernels.