{"id":2362,"date":"2022-01-18T08:45:57","date_gmt":"2022-01-18T08:45:57","guid":{"rendered":"https:\/\/loadfocus.com\/blog\/?p=2362"},"modified":"2023-09-03T14:09:47","modified_gmt":"2023-09-03T14:09:47","slug":"how-to-compare-two-load-tests-using-the-baseline-comparison-feature","status":"publish","type":"post","link":"https:\/\/loadfocus.com\/blog\/2022\/01\/how-to-compare-two-load-tests-using-the-baseline-comparison-feature","title":{"rendered":"How to Compare Two Load Tests using the Baseline Comparison Feature"},"content":{"rendered":"<\/span> 3<\/span> minutes read<\/span><\/span>\n

The load test comparison feature build-in to LoadFocus<\/a> Results allows you to compare the results of two different test runs of the same test for the cloud load testing service<\/a>.<\/p>\n\n\n\n

You can visually compare the results between the test run set as baseline and the current test run, just by setting a test run as a baseline, and loading the other load tests runs.<\/p>\n\n\n\n

Baseline comparison is important because it allows to easily find differences in performance for the test runs. <\/p>\n\n\n\n

Let’s have a look which are the steps to set a test as a baseline and compare with a different test run.<\/p>\n\n\n\n

Setting a baseline test run<\/h2>\n\n\n\n

First step is to set a test run as baseline. All other test runs of the same test will be compared with the chosen baseline test.<\/p>\n\n\n\n

When choosing a test as baseline, you should have in mind that you need to start small, with a small number of virtual users, so that in the following tests runs you can increase the load and discover potential issues and bottlenecks.<\/p>\n\n\n\n

In order to set a test run as a baseline, open the results of the test chosen as baseline, and click the Set Baseline<\/strong> button.<\/p>\n\n\n\n

\"\"
Setting test run as baseline<\/figcaption><\/figure>\n\n\n\n

After selecting a test run as baseline, you can check that the current test run is successfully set by checking the comparison percentages and the text under the test name.<\/p>\n\n\n\n

\"\"
Successfully setting a test run as baseline<\/figcaption><\/figure>\n\n\n\n
\"\"
Test run set as baseline is displayed under the test name<\/figcaption><\/figure>\n\n\n\n
\"\"
Percentages are all displayed as 0% for the test run set as baseline<\/figcaption><\/figure>\n\n\n\n

Comparing test runs<\/h2>\n\n\n\n

In order to compare a test run of the same test with the baseline, simply navigate to the test run id and the comparison will automatically get displayed.<\/p>\n\n\n\n

You can choose the test run by clicking on the id of the test from the dropdown next to the test name.<\/p>\n\n\n\n

\"\"
Response times and percentiles comparison with baseline<\/figcaption><\/figure>\n\n\n\n

Check why using percentiles in load testing are useful<\/a> in our previous blog post.<\/p>\n\n\n\n

Full results comparison <\/h2>\n\n\n\n
\"\"
Comparison between two different test results (baseline #1 and current test #2)<\/figcaption><\/figure>\n\n\n\n

Changing the baseline<\/h2>\n\n\n\n

Changing the baseline is done simply clicking the Set Baseline<\/strong> button on a test run that is not currently a baseline.<\/p>\n\n\n\n

\"\"
Changing the baseline<\/figcaption><\/figure>\n\n\n\n

When you change the baseline, the current visible test becomes the baseline.<\/p>\n\n\n\n

Removing the baseline<\/h2>\n\n\n\n

To remove the baseline, and the comparison for a test, you simply go to the test run which is set as baseline, and click on the green check indicating that the current test run is set as baseline.<\/p>\n\n\n\n

\"\"
Removing the baseline for a test<\/figcaption><\/figure>\n\n\n\n

After removing the baseline, the test has no baseline set, and the comparison will no longer be displayed for any of the test runs.<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n\n\n\n
\n\n\n\n

Written by Bogdan Vazzolla<\/a>.<\/em><\/p>\n\n\n\n

LoadFocus<\/a> is a cloud testing platform, a load and stress testing tool<\/a> which provides the infrastructure to run tests with thousands of concurrent users, from multiple cloud locations<\/a>, in less than a few minutes, keep history of the results, compare different runs to inspect performance improvements or performance degradation.<\/em> It also supports running JMeter load tests from the cloud<\/a><\/em> and monitoring and audit web and mobile performance<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

<\/span> 3<\/span> minutes read<\/span><\/span>The load test comparison feature build-in to LoadFocus Results allows you to compare the results of two different test runs of the same test for the cloud load testing service. You can visually compare the results between the test run set as baseline and the current test run, just by setting a test run as… Read more »<\/a><\/p>\n","protected":false},"author":1,"featured_media":2378,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8,337,9,48],"tags":[380,382,381],"class_list":["post-2362","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-apache-jmeter","category-api-load-testing","category-load-testing","category-test-automation","tag-baseline-comparison","tag-compare-test-results","tag-load-test-comparison"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/loadfocus.com\/blog\/wp-json\/wp\/v2\/posts\/2362","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/loadfocus.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/loadfocus.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/loadfocus.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/loadfocus.com\/blog\/wp-json\/wp\/v2\/comments?post=2362"}],"version-history":[{"count":1,"href":"https:\/\/loadfocus.com\/blog\/wp-json\/wp\/v2\/posts\/2362\/revisions"}],"predecessor-version":[{"id":2760,"href":"https:\/\/loadfocus.com\/blog\/wp-json\/wp\/v2\/posts\/2362\/revisions\/2760"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/loadfocus.com\/blog\/wp-json\/wp\/v2\/media\/2378"}],"wp:attachment":[{"href":"https:\/\/loadfocus.com\/blog\/wp-json\/wp\/v2\/media?parent=2362"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/loadfocus.com\/blog\/wp-json\/wp\/v2\/categories?post=2362"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/loadfocus.com\/blog\/wp-json\/wp\/v2\/tags?post=2362"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}