Tool Mentor: Evaluating the Results of Executing a Suite of Test Scripts Using Rational TestFactory

Tool Mentors > Rational TestFactory Tool Mentors > Evaluating the Results of Executing a Suite of Test Scripts Using Rational TestFactory

Purpose

This tool mentor describes how to use Rational TestFactory to measure and evaluate the results of executing a suite of test scripts.

Related Rational Unified Process™ information:

Activity: Execute Test, refer to the section titled "Evaluate Execution of Test".
Activity: Evaluate Test, refer to the section titled "Evaluate Code-based Test Coverage".

Overview

After you have executed a suite of test scripts in Rational TestFactory, you can evaluate the results. For information about using a Test Suite to run a suite of test scripts in TestFactory, see Tool Mentor: Executing a Suite of Test Scripts.

This tool mentor is applicable when running Windows 95/98/2000/NT 4.0.

To use Rational TestFactory to evaluate the results of executing a suite of test scripts:

Review the run status of the test scripts in a suite
Analyze code-based test coverage

1. Review the run status of the test scripts in the suite

When a Test Suite is the selected object in the left pane of the Rational TestFactory main window, the Status tab in the right pane displays the results of the run. For each test script listed in the Test Suite, a status value indicates whether TestFactory executed the test script successfully.

If a test script failed to run successfully, you can analyze its run log in Rational TestManager.

Refer to the following topics in Rational TestFactory online Help:

Test Suite— tab
Review the run status of a Test Suite
View the log for a script run

2. Analyze code-based test coverage

If you instrumented the application-under-test (AUT) before you ran the Test Suite, you can view code-based test coverage data for the Test Suite. When the Test Suite is the selected object in the left pane of the Rational TestFactory main window, the Coverage tab in the right pane displays combined code-based coverage values for all the test scripts that ran in the Test Suite.

Rational TestFactory calculates the code-based test coverage values as the percent of the source code that the test scripts touch, relative to all the source code in the AUT. If you have access to the source files of the AUT, you can use the Coverage Browser in TestFactory to review the code in a source file and examine which lines of code the test scripts touch.

You can also view the code-based coverage values for individual test scripts included in the Test Suite. Double-clicking a test script on the Status tab of the Test Suite selects that test script in the left pane. For details, see Tool Mentor: Evaluating Test Coverage.

Refer to the following topics in Rational TestFactory online Help:

Instrumenting the application-under-test
Test Suite— tab
Review code coverage results for a Test Suite

Rational Unified Process