Open Bug 995639 Opened 10 years ago Updated 2 years ago

[meta] Fix tests that don't pass when test execution order is shuffled

Categories

(Testing :: General, defect)

Product:
Testing
Component:
General
Type:
defect

Tracking

(Not tracked)

People

(Reporter: gps, Unassigned)

References

(Depends on 2 open bugs, Blocks 1 open bug)

Details

(Keywords: meta) 

When you randomize the execution order of tests, new failures occur:

https://tbpl.mozilla.org/?tree=Try&rev=a57e1e07befa

Each one of these failures is a potential orange in waiting, if not an existing orange. If a test gets moved to another job, it could suddenly fail. We've seen a lot of this lately with bc tests.

I'm opening this meta bug to track new failures only seen during shuffled execution.
Depends on: 995640
Depends on: 995642
Depends on: 995645
Thank you for filing these! :-)
Blocks: 996504
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.