Open Bug 906623 Opened 6 years ago Updated 6 years ago
When run individually a test should be marked as fail when there is an assert
I encountered a case (bug 884332) where there was an assert in one test and running that one test locally seemed enough for the developer to be confident to push his patch. Unfortunately, the test was asserting but in the thousands of output lines that was not obvious and the test was not marked as fail. It seems that to get the test to be marked as failed when asserting, it has to be run as part of a group (ie. directory), not individually. We should consider marking individually ran test as failing when asserting.
This is probably just another symptom of bug 508664.
Yeah, this is really hard to do without bug 508664, since we want to catch even asserts that happen when loading or unloading a page.
You need to log in before you can comment on or make changes to this bug.