The run results page

Search Knowledge Base by Keyword

< Back

You can review the results of automated test runs in the Run Results page.

The Run Results page allows you to view results graphically for every run and test case during a given time period. You can also review the results for individual test cases and test runs.

To open the Run Results page, select the “Results” option in the sidebar menu.

Filter results shown

The Run Results page displays results by context and date range. To filter by context, use the context drop-down menu. The Global context will display all tests executed across every project and release. Alternatively, filter run results by project or release.

To filter the results by date, click the Date Range box at the top of the page. Next, select either “Last 7 Days” or “Last 30 Days”. Alternatively, click “Custom range”, and specify a start and end date using the two calendars. Click “Apply” to display graphs for the custom date range.

Analysing Results_The Results Tab_4

Results graphs

The Run Results page provides two graphs for every test case executed within the specified context and time period.

The “Results Summary” graph provides a pie chart of the number of tests that have passed, and those that have failed.

Analysing Results_The Results Tab_1a

The “Execution Volume” graph displays the number of tests executed over time. Days with execution runs are represented by points plotted on the graph. Hover over a point to review the number of tests executed on that day:

Analysing Results_The Results Tab_2

Brows results by individual run or test case

The graphs reflect the results of every test run executed during the specified time period and context.

Scroll down to the “Results” table to instead browse run results by individual test runs or test cases.

Browse results by run

The “Home” tab displays every test run that has been executed within the specified time range and context. Runs are displayed row-by-row, and are ordered by the time of their “Last Execution”. The execution duration is also displayed:

Analysing Results_The Results Tab_3a

Clicking the Model name for an individual run will open the model from which the automated tests were generated. The “Profile” tells you the coverage profile that was used to generate the tests. Open the model and select the relevant coverage profile to review the run results at the model level.

The “Status” provides an overview of the number of tests that passed, and those that failed. The row will be labelled “Success” if every test passes; otherwise, the label will be red.

You can review the results of the individual test cases executed during an individual run by clicking the Run ID:

Analysing Results_The Results Tab_4b

Clicking the Test Name in this view displays the test steps and expected results, as well as any links:

Analysing Results_The Results Tab_5b

Browse results by test case

The “Runs” tab of the results table allows you to browse the results of every individual test case executed within the time period and context you have specified.

These are ordered chronologically, row-by-row, based on the time of execution:

Analysing Results_The Results Tab_6a

The duration is displayed, as is the pass/fail result of the test.

Clicking the reload symbol under “Model” loads the latest version of model from which the test case was generated. This might be different to the model from which the tests were created; clicking reload in the “Version” column instead loads the version of the model from which the test case was created.

Clicking the Test Name displays the test steps associated with that test case, along with any expected results and links:

Analysing Results_The Results Tab_5b

Clicking the Run Id displays the results for every test case executed during the same run:

Analysing Results_The Results Tab_7b