Open Bug 995639 Opened 6 years ago Updated 6 years ago

[meta] Fix tests that don't pass when test execution order is shuffled

Categories

(Testing :: General, defect)

defect
Not set
normal

Tracking

(Not tracked)

People

(Reporter: gps, Unassigned)

References

(Depends on 2 open bugs, Blocks 1 open bug)

Details

(Keywords: meta)

When you randomize the execution order of tests, new failures occur:

https://tbpl.mozilla.org/?tree=Try&rev=a57e1e07befa

Each one of these failures is a potential orange in waiting, if not an existing orange. If a test gets moved to another job, it could suddenly fail. We've seen a lot of this lately with bc tests.

I'm opening this meta bug to track new failures only seen during shuffled execution.
Depends on: 995640
Depends on: 995642
Depends on: 995645
Thank you for filing these! :-)
Blocks: 996504
You need to log in before you can comment on or make changes to this bug.