Making sense of latency numbers

Introduction While preparing for system design interviews a few months ago, I realized something that caught me off guard: even as an experienced software engineer, my intuition about performance wasn’t as strong as I thought. I know the usual rules of thumb - Cache is fast, Disk is slow, Network calls are expensive. I can recite the latency numbers every programmer is supposed to know, and I’...