Open Bug 967696 Opened 9 years ago Updated 2 months ago

mach does not stop early when python unit tests fail

Categories

(Firefox Build System :: Mach Core, enhancement)

enhancement

Tracking

(Not tracked)

People

(Reporter: froydnj, Unassigned)

References

(Depends on 1 open bug)

Details

Running:

mach build check

cheerily runs all the python unit tests, even if a test somewhere in the middle fails.  In contrast,

blah/blah/pymake.py -f Makefile check; or
make check

stops after the first failed unit test.  This behavior can make it difficult to determine what test has failed due to limited terminal scrollback.
make check's early termination behavior is what we want to avoid because it masks multiple failures and can result in multiple try pushes since you have to play whack-a-mole. What you really want is a summary of failures. Bug 917363 should hopefully facilitate that.
Depends on: 917363
Product: Core → Firefox Build System
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.