KV Cache Quantization Is 4× Slower on My Mac and 28% Faster on a Rented L4

0Sign in to vote or save

Comments

Nothing yet. Say the first thing.