How fast does it serve? Throughput, latency, and picking the right GPU

Part 2 of 2 on inference engineering for AI engineers.