Manual test runs

A Test Run is a collection of instances of Test Cases with necessary information like who is handling the involved Test Cases at a particular time and the state they are in which can be untested, passed, failed, blocked, skipped or to be retested.

Create manual test runs

Follow these steps to create a Test Run manually:

1. Navigate to the project and click Test Runs on the left navigation panel.
2. Click Create Test Run. A Create New Test Run dialog box appears, and the current date appends to the Test Run Name field.
3. Click Update in the Test Cases field to select the Test Cases to add to the Test Run.
4. Click checkbox against the required Test Cases or click the Select All checkbox to add all the Test Cases to the Test Run.

5. Select the relevant test case folders under the Folder filter to narrow down test cases.

   

6. To refine test cases, configure the filter criteria based on your needs:
   • Choose the relevant criteria in the available filter panels (see annotation 1).
   • Select values in each filter panel to specify your filtering preferences (see annotation 2).
   • Use the Match filters option at the top of the filter panel to set how filter conditions should combine (see annotation 3). Learn more about matching filter criteria.
   • Enable Link Tests Dynamically for Dynamic Selection of test cases.
7. Click Select <number> Test Cases.

8. Enter Configurations, Description, Assign Rule, Tags, and State parameters as necessary.

9. Use the Requirements field to link Jira issue, and/or Azure work items and establish traceability for test case requirements.
10. Click Create.

The new Test Run appears in the test runs list view.

Add status

1. Click ID or TITLE of the Test Run to open the executed Test Run.
2. From the Status dropdown menu, select the Test Run status.
3. To add or modify a Test Case or to connect it to a JIRA issue, click the Test Case ID or TITLE. Then, you can perform the required action on the slide over menu.

Add a result for each step in a test case

If you use the steps template for a Test Case, you can add the result of each step. It allows you to track the exact step that caused the failure of the Test Case.

Follow these steps to add test results to a Test Case in a Test Run:

1. Navigate to the relevant Test Run.

2. Locate and click the Test Case with a steps template to which you wish to add step results.

   
   The Test Case details view appears.

3. Based on the result of a step, assign the appropriate status to it. The options are:

   • Pass: The step was executed successfully without issues.
     
   • Fail: The step encountered issues and did not execute as expected.
     
   • Skip: The step was intentionally not executed.
     
   • Blocked: The step could not be executed due to external factors or dependencies.
     
   • Retest: The step needs to be executed again, typically after a failure or other issue.
     

You can also assign Untested to a step and reset the step result.

Edit an existing test result

You can modify a manually added test result, its status, notes, and attachments, if you have originally added that result.

1. Select a test case in test runs or from the test case details view.
2. Locate the test result under the Results tab in the test case details slide-over.
3. Hover over the test result and click the overflow menu (three dots).
4. Select Edit Result to open the Edit Result form.
5. Update the Status, Notes, Attachments or custom result fields as needed.
6. Use the Defects field to add/remove any Jira, Azure or Asana items tracking related bugs.
7. Click Update Result to save your changes.

Automatic test case status assignment

The status of the Test Case is automatically determined based on the outcomes of the individual steps according to a predefined result mapping logic.

Add notes and attachments to Test Case result

You can add notes and attachments to the Test Case while adding the result.

1. Select a Test Case in Test Runs.
2. Click Add Result under Results tab in Test Case DETAILS slide over.
3. Enter Add Notes and upload a file in Attachments.
   
4. Use the Defects field to add Jira issue and/or Azure work items where the bugs are documented.
5. Click Add Result to add result to the Test Case.

Test run state

You can check the state New, In Progress, Under Review, Rejected, Done, or Closed of the selected Test Run, as shown in the following screenshot.

Dynamic selection

Dynamic Selection enhances the efficiency and comprehensiveness of creating test runs. When you enable Link Tests Dynamically in a Test Run, it automatically includes relevant Test Cases based on filter criteria. All future Test Cases that match the predefined filter criteria of a Test Run will be added automatically.

Dynamic Selection ensures that no relevant Test Case is skipped. This saves time and effort by eliminating the need to add each Test Case manually to a Test Run.

Create a test run with dynamic selection

1. Create a new Test Run or edit the existing Test Run.
2. Click Update in the Test Cases field.
3. Select the relevant test case folders under the Folder filter to narrow down test cases.
4. Specify the filter criteria for including Test Cases in the Test Run.
5. Click Apply Filters.
6. Enable Link Tests Dynamically.
7. Click Select Test Case.

This enables the automatic inclusion of Test Cases in a Test Run based on the applied filter criteria.

Clone test runs

To reuse the existing active or closed test runs, clone the test runs.

To clone a Test Run:

Search and filter test cases in test runs

You can query the list of test cases displayed on the dashboard using either the Test Cases ID or the Title as search parameters.

Filter test cases in test runs

Filtering for Test Cases in a Test Run allows you to narrow down Test Cases based on specific criteria. It helps you identify relevant Test Cases quickly.

Follow these steps to filter the Test Cases in a Test Run:

1. Select a Test Run.
2. Click Filter.

3. Select the relevant test case folders under the Folder filter to narrow down test cases.

   

4. Select the necessary filter criteria such as Status, Configurations, Priority, Assignee and Test Case Type.

5. Click Apply.

You can see the test cases in the test run that meet your filter criteria.

You can also perform bulk actions on seleted Test Cases:

• Add Result to add same result to the selected Test Cases.
• Assign to to assign the selected Test Cases to a different user.
• Remove from Run to remove the selected tests from the partcular Test Run.

Search and filter test runs

The Search functionality that allows you to look up test runs based on their Test Run ID or Title within your test runs list view. The search experience is designed to be intuitive, returning relevant results quickly so that users can locate the appropriate Test Run entry without having to scroll or filter through large amounts of test runs.

The search bar is visible above the list of active and closed test runs in the list view.

Filter test runs in the dashboard

Applying a filter to test runs allows you to narrow down test runs based on specific criteria. It helps you identify relevant test runs quickly.

Follow these steps to filter the test runs:

1. Select the Test Runs tab in the project dashboard.
2. Click Filter at the top right of the screen.

3. Select the relevant test case folders under the Folder filter to narrow down test cases.

   

4. In the Filter Active Test Runs view, select the filter criteria such as Created, Status of Test Case, Assigned To and Type of Run to narrow your search.
5. Click Apply.

You can see the test runs that meet your filter criteria.

View test cases in a test run detail page

You can view test cases in a test run in two formats:

• Folder view
• Consolidated view

Folder view

The folder view is the default view and has a nested hierarchy of the main folder and sub-folders. To view the test cases linked to the test run, navigate to the individual parent folder and sub-folders. If you apply the filter, the display is refined to show only those folders containing test cases that meet the specified filter criteria.

Consolidated view

The consolidated view offers a comprehensive list of all test cases from across all the folders linked to the test run.

Share your test run publicly

You can share your test run with anyone on the internet using a public link. This allows external stakeholders who may not have access to view your test run stay informed about your testing progress.

To share your test run publicly:

1. On your test run, click Share (see annotation 1).

   

2. Click Share via public link tab (see annotation 2).
3. Enable the Enable public link toggle (see annotation 3).

4. Click Copy link to copy the generated URL and share it with anyone you want to grant access to.