Closed Bug 1561306 Opened 4 months ago Closed 4 months ago

[test isolation] Use repeat id tests 5 times and it tests 20 times

Categories

(Testing :: General, enhancement, P3)

enhancement

Tracking

(firefox69 fixed)

RESOLVED FIXED
mozilla69
Tracking Status
firefox69 --- fixed

People

(Reporter: bc, Assigned: bc)

References

Details

Attachments

(1 file)

To get more test runs of each failing directory and test during test isolation without increasing the number of distinct tasks, we want to try using --repeat when invoking test harnesses to execute each test in the failing directory 5 times and each individual failing test 20 times.

--repeat is only supported on reftest and mochitest at the moment and is not currently supported in mozharness.

Depends on: 1561309
Depends on: 1561571
Pushed by bclary@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/0ec05244de2d
[test isolation] repeat directory tests 5 times, individual tests 20 times, r=jmaher,tomprince
Priority: -- → P3
Status: ASSIGNED → RESOLVED
Closed: 4 months ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla69
You need to log in before you can comment on or make changes to this bug.