Create and Execute Test Sets

Once you have defined enough test cases to meet your requirements, you can start by combining the test cases into test sets (test units). A test set contains several test cases that are configured to be perfomed for a specific topic and point in time.

You create test sets using test set executions. However, when you create a test set execution, you do not specify test cases. Instead, you define which requirements are to be tested. The tool then automatically collects all test cases assigned to the selected requirement, as well as versions refined from that requirement and its derivatives. Of course, you can also assign test cases manually.
A test is created for each test case found. These tests form the test set execution.

Define test set executions

1. Select a package and choose Create / Test set execution from its context menu.
2. Name the test set execution and enter a date and a description if necessary.
3. Click Continue.

4. Click the Plus button and select a package, activity, or existing test set execution.

5. Click OK to create the test set execution.

A test is created for each test case found. The test includes the name, description and test steps of the test case.

Execute test sets

Double-click on a test set execution to open it; all derived tests are displayed in the Tests tab. Each individual test is in the initial state planned. Please note, at this point that test sets have their own state machine and that the state of the test case is not displayed here.

The actual testing takes place in the following queries:

• Tests with test set executions
• Test set executions with tests

In these two queries you can see the states of the tests as well as the test set execution.

1. When you start testing, you set the test set execution state to ready; this will set all tests that belong to the test set execution state also to ready.
2. Run the test. If you want to see the individual steps, double-click on the test; you will be able to see each step in the Test steps section.
3. Record the test result in the Test result tab. Here you can describe in detail what you noticed during the test

4. Set the test to either passed or failed.
   When all tests have been performed, the test set execution state automatically changes to failed or passed.

Derive bugs

If any error occurs during the test run, you can derive a bug directly from the test. Select the test and choose Derive Bug from the context menu.

When a bug is created, a reference to the test it was derived from is automatically created in the Tests tab.

The following queries are available for this purpose:

• Tests with bugs This query lists tests with the corresponding bugs, depending on the package specified.
• Open bugs Depending on the package specified, this query lists all bugs that are in the state from in definition to realization. If the state changes to realized, the bug disappears from the list.
• My reported bugs This query lists all bugs created by the current user, depending on which package was specified.

If a bug has been derived from a failed test and fixed, the developer sets the bug to the state passed. When this happens, the state of the test changes to ready to re-test. This is the signal for the tester to repeat the test.

Assign testers

The individual tests are carried out by assigned testers. If you already know who the testers will be when you define the test cases, you can directly assign them to the test case. If you then create a test set execution, the testers are automatically included in the tests. If no testers have been assigned to the test cases, assign them to the tests. The procedure is the same for test cases and tests.

1. Double-click on a test case or test to open its editing dialog.
2. Switch to the Staff tab.
3. Use the green Plus button to select the testers in the subsequent dialog and confirm with OK.

Retrospectively assign test cases

Test cases can also be retrospectively assigned to a test set execution. You can do this in a query using Drag & Drop or a command.

Assign test cases via Drag & Drop

• Open a query that displays test set executions, e.g. Test set executions with tests.
• Drag and drop one or more test cases into a test set execution.

Assign test cases via command

• In the context menu of a test set execution select the command Add test sources.
• In the following dialog, use the Plus button to specify where further test cases should be searched for. Confirm your choices with OK.