2.9. Reviewing Results

You can use the results file generated by QMTest to get additional information about the tests that failed. The default results file name is results.qmr and is placed in the directory where you ran QMTest.

To examine the results file, use the summarize command, like this:


> qmtest summarize -f full
   
The -f full option indicates that the output should be displayed in more detail. The output will look like:

--- TEST RESULTS -------------------------------------------------------------

  exec0                                         : PASS    

    qmtest.target:
      local

  exec1                                         : FAIL    
    Expression evaluates to false.

    ExecTest.expr:
      x + x == 5

    ExecTest.value:
      0

    qmtest.target:
      local

  exec2                                         : PASS    

    qmtest.target:
      local

--- TESTS THAT DID NOT PASS --------------------------------------------------

  exec1                                         : FAIL    
    Expression evaluates to false.


--- STATISTICS ---------------------------------------------------------------

       3        tests total
       1 ( 33%) tests FAIL
       2 ( 67%) tests PASS

The detailed information indicates what went wrong. The test value was 0 which is considered false by Python. The information displayed by the "full" format is domain-dependent; it depends on the kind of application you are testing. The tests in the sample database test basic functionality of the Python interpreter, so the full report contains information about Python concepts called exceptions and tracebacks. If you were testing a different application, the full report would contain different information. For example, if you were testing a database, the detailed results might refer to queries and records.