Open Bug 906623 Opened 11 years ago Updated 2 years ago

When run individually a test should be marked as fail when there is an assert

Categories

(Testing :: Mochitest, defect)

Product:
Testing
Component:
Mochitest
Type:
defect

Tracking

(Not tracked)

People

(Reporter: mounir, Unassigned)

References

Details

I encountered a case (bug 884332) where there was an assert in one test and running that one test locally seemed enough for the developer to be confident to push his patch. Unfortunately, the test was asserting but in the thousands of output lines that was not obvious and the test was not marked as fail. It seems that to get the test to be marked as failed when asserting, it has to be run as part of a group (ie. directory), not individually. We should consider marking individually ran test as failing when asserting.
Blocks: 404077
This is probably just another symptom of bug 508664.
Yeah, this is really hard to do without bug 508664, since we want to catch even asserts that happen when loading or unloading a page.
Marked as depending on bug 508664 so we still keep track of that problem.
Depends on: 508664
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.