Understanding Standard Deviation in Performance Testing

Load Testing Test Automation.

Understanding Standard Deviation in Performance Testing

2 minutes readKey takeaways A high standard deviation means inconsistent response times, which users notice more than a slow average. Two runs with the same mean can behave completely differently, and this is how you tell. Pair it with percentiles rather than reporting either alone. Standard Deviation is an important metric in performance testing analysis and informs… Read more »

Standard Deviation and Percentiles in Load Testing Metrics

Load Testing.

Standard Deviation and Percentiles in Load Testing Metrics

2 minutes readKey takeaways A mean with a large standard deviation describes almost none of your users. Percentiles show the tail, which is where the complaints come from. Report p95 or p99 alongside the median rather than the average alone. Standard deviation and percentiles are very helpful when comes to calculating the response times in a load… Read more »