Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. test run status - the status of the entire test run regardless of how many tests are in it

  2. test status - the status of a single test within a test run

Test Run Statuses

Status

Description

SUBMITTED

Test run has been submitted to the queue to be run

QUEUED

Waiting for another test run in the same environment to finish. We do not run 2 test runs in the same environment at once.

RUNNING

Test run is currently running

PASS

All tests that are not ignored passed.

FAIL

There was at least 1 test in the test run that failed OR an error happened and test run can’t finish. If the latter happens a failure reason should display.

CANCELED

  1. Test run was manually canceled by someone.

The
  1. (user’s username will display to show who canceled the test run) OR

  2. Test run will be automatically canceled if it runs for more than 3 hours (message will be Canceled - Due to running too long) OR

  3. Test run is in queued status and a newer test run comes in, the current queued test run

.
  1. will be canceled (message will be Canceled - Due to newer test run)

Test Statuses

Status

Description

The test passed.

The test failed.

Test was flagged as ignored and this test did NOT run.

Test is waiting to run.

Test is running.

...