What is a Test Run Id?
Test Run ID Explained
A Test Run ID is the number of a run of a test. Every time you run a test, LoadFocus gives that run the next number for that test name, so you can track, reference, and compare results across the runs of the same test. You see it as Run on the Overview tab of a result. Together with the test name it identifies one run, which is how the API refers to a result (see Results Analysis API).
Purpose of a Test Run ID:
- Traceability: Easily trace back results and performance metrics to a specific test run.
- Comparison: Helps in comparing results between different test runs to identify patterns, anomalies, or improvements.
- Report Generation: Enables the generation of specific reports for individual test runs.
Incremental Nature:
- The first run of a test gets Test Run ID "1".
- Each later run of the same test, even if no parameters change, gets the previous number plus one: "2", "3", and so on.
- The counter belongs to the test name. A test with a different name starts again at "1".
Importance in Continuous Integration/Continuous Deployment (CI/CD):
- In CI/CD environments where tests might be triggered automatically upon code pushes or at regular intervals, having distinct Test Run IDs is crucial. It aids in identifying which particular execution may have introduced a bug or degraded performance.
Historical Data & Trend Analysis:
- By referencing Test Run IDs, teams can track performance or other metrics over time. This is particularly useful to assess the system's behavior across different versions or after specific updates.