Open Bug 995639 Opened 11 years ago Updated 2 years ago

[meta] Fix tests that don't pass when test execution order is shuffled

Categories

(Testing :: General, defect)

Product:
Testing
Component:
General
Type:
defect

Tracking

(Not tracked)

People

(Reporter: gps, Unassigned)

References

(Depends on 2 open bugs, Blocks 1 open bug)

Details

(Keywords: meta)

When you randomize the execution order of tests, new failures occur: https://tbpl.mozilla.org/?tree=Try&rev=a57e1e07befa Each one of these failures is a potential orange in waiting, if not an existing orange. If a test gets moved to another job, it could suddenly fail. We've seen a lot of this lately with bc tests. I'm opening this meta bug to track new failures only seen during shuffled execution.
Depends on: 995640
Depends on: 995642
Depends on: 995645
Thank you for filing these! :-)
Blocks: 996504
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.