http://blog.boyangyue.com/tags/system-design/Recent content in System Design on Boyang YueHugoen-usA Good Year AheadSun, 11 Sep 2022 11:00:00 +0900http://blog.boyangyue.com/2022/09/two-measures-of-fast-throughput-and-latency/Sun, 11 Sep 2022 11:00:00 +0900http://blog.boyangyue.com/2022/09/two-measures-of-fast-throughput-and-latency/<p>A service can double the requests it completes per second while every individual request gets slower. There is no contradiction, because the two numbers answer different questions: <strong>latency</strong> is the time one operation takes, from request to response, while <strong>throughput</strong> is the rate at which the system as a whole completes operations. Much of performance engineering consists of keeping the questions apart: knowing which number a change moves, and at what cost to the other.</p>