Decoding Average Response Time

Average (Mean) Response Time

Average response time, often referred to as mean response time, is a fundamental metric in performance testing and monitoring. It represents the average time taken for a system or application to respond to a request during a test or monitoring period.

Mathematically, the average response time is calculated by taking the sum of all individual response times and dividing it by the number of requests (samples) made.

For example, if you have the response times (10ms, 20ms, 30ms), the average response time would be: 20ms.

Why is Average Response Time Important?

1. Benchmarking: It provides a baseline metric to compare system performance against previous tests, different versions of an application, or even competitors.
2. General Understanding: While it may not capture all the nuances of user experience, the average response time gives an immediate sense of the system's general performance.
3. Trend Identification: Monitoring the average response time over prolonged periods can highlight patterns, indicating when a system is under strain or when optimization tweaks have improved performance.

Relationship with Percentiles

While the average response time provides a generalized view, it doesn't capture the extremes. A few very slow responses can significantly skew the average, which might not represent the experience of the majority of users. This is where percentiles come into play.

Percentiles, especially the 90th, 95th, and 99th, are frequently used in performance testing to provide a more detailed view of response times.

1. 90th Percentile (p90): 90% of the requests had a response time faster than this value, while 10% took longer. It's a good metric to understand the experience of the majority without the influence of extreme outliers.
2. 95th Percentile (p95): 95% of the requests were faster, and 5% were slower. It's closer to the worst-case scenarios but excludes the extreme outliers.
3. 99th Percentile (p99): Only 1% of the requests were slower than this. It gives an idea of the near worst-case scenario without considering the absolute worst outliers.

The average is not a percentile. The 50th percentile (p50, also called the median) is the value that half of the requests beat and half did not. When a few very slow responses pull the average up, the average ends up above the median, so comparing the two tells you how skewed your results are.

In Conclusion

Average (or mean) response time is a foundational metric in performance testing. While it provides a quick overview, it's essential to combine it with percentiles to get a comprehensive understanding of system performance. The average gives a general sense, while percentiles help pinpoint where improvements are needed and how the majority of users are experiencing the system. To see the spread of your own results, open Response Time Distribution.