When you run QMTest on the command line, it automatically creates a results file called results.qmr. You can specify a different filename with the -o option. Run this command:
> qmtest run -o expected.qmrto save the results to a file named expected.qmr instead of the default results.qmr.
Now, when you rerun the tests you can tell QMTest to use expected.qmr as the expected results file, like this:
> qmtest run -O expected.qmrQMTest will rerun the tests, but this time it will not mention the failure of exec1. The output will look like:
--- TEST RESULTS ------------------------------------------------------------- exec0 : PASS exec1 : XFAIL Expression evaluates to false. ExecTest.expr: x + x == 5 ExecTest.value: 0 qmtest.target: local exec2 : PASS --- TESTS WITH UNEXPECTED OUTCOMES ------------------------------------------- None. --- STATISTICS --------------------------------------------------------------- 3 tests total 3 (100%) tests as expectedNote that QMTest indicates that there were no tests with unexpected outcomes, even though exec1 still fails. The XFAIL notation indicates that the test failed, but that failure was expected. In contrast, XPASS means that a test passed unexpectedly.