A KV cache calculator

I made a small KV cache calculator for some current open-weight models, based on Neil Movva&rsquo;s . KV Cache Calculator at 85% of GPU memory usable for weights + KV cache Memory: Average Sequence Length: Model Max Batch Size based on Neil Movva's KV cache calculator