Closed Bug 1390889 Opened 2 years ago Closed 2 years ago

Add a test verification mode to the reftest test harness

Categories

(Testing :: General, enhancement)

enhancement
Not set

Tracking

(firefox57 fixed)

RESOLVED FIXED
mozilla57
Tracking Status
firefox57 --- fixed

People

(Reporter: gbrown, Assigned: gbrown)

References

(Blocks 1 open bug)

Details

Attachments

(1 file)

...as in bug 1357520, but for reftest instead of mochitest.

This bug aims to add a --verify option for the reftest test harness, supporting test verification. Test verification involves running a test, or small group of tests, repeatedly and possibly in different environments, with the intent of finding intermittent test failures quickly and efficiently.
This is very similar to the changes made for mochitests (and xpcshell tests).
Attachment #8903866 - Flags: review?(jmaher)
Comment on attachment 8903866 [details] [diff] [review]
support --verify in reftest harness

Review of attachment 8903866 [details] [diff] [review]:
-----------------------------------------------------------------

I know :ahal is doing some selftests for reftest harness, please ensure he is aware of your changes.
Attachment #8903866 - Flags: review?(jmaher) → review+
Thanks, good point. I filed bug 1396901 and will follow-up once the first reftest selftests land.
Blocks: 1396905
Pushed by gbrown@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/34deee927067
Support --verify option in reftest harness; r=jmaher
https://hg.mozilla.org/mozilla-central/rev/34deee927067
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla57
You need to log in before you can comment on or make changes to this bug.