2.3. Running Tests

To run all the tests, choose All Tests from the Run menu. QMTest will display the test results page. As the tests run, this page will be automatically updated. (If you do not want to wait for QMTest to update the page, you can manually reload the page in your browser.) After a few moments, QMTest will display the test results for the three tests in the database. The upper part of the screen gives a statistical overview of the test results. Of the three tests, two passed. However, one test failed. You can use this statistical information to get a quick overview of your application's correctness.

In addition to showing you how many tests passed and how many failed, QMTest shows you whether how many tests had unexpected pass or fail outcomes. If you know that certain tests will fail, you can tell QMTest that they are expected to fail. Then, if you are testing a change to your application, you can easily see whether your change made things better or worse. As long as there are no unexpected failures, your change did not cause any problems.

If you have not explicitly set up an expectation for a test, QMTest assumes that the test is expected to pass. That is why QMTest indicated that there was one unexpected failure when you ran the tests.

Below the statistics section, QMTest displays detailed information about each test. In this case, you can see that the exec1 test is the one that is failing. You can click on the Details link to get additional information about why a particular test is failing.