Open Bug 1444360 Opened 6 years ago Updated 2 years ago

"ShutdownLeaks | process() called before end of test suite" should be shown after real test failures or not at all

Categories

(Testing :: Mochitest, defect)

Product:
Testing
Component:
Mochitest
Version:
Version 3
Type:
defect

Tracking

(Not tracked)

People

(Reporter: aryx, Unassigned)

Details

https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&revision=1f522b139917c38f2b4eb88c8ea00247219579d4&filter-resultStatus=testfailed&filter-resultStatus=busted&filter-resultStatus=exception&filter-resultStatus=retry&filter-resultStatus=usercancel&filter-resultStatus=runnable&selectedJob=166954112

has the test failures in this order:

TEST-UNEXPECTED-FAIL | ShutdownLeaks | process() called before end of test suite
TEST-UNEXPECTED-FAIL | browser/base/content/test/forms/browser_selectpopup_searchfocus.js | application terminated with exit code 11
PROCESS-CRASH | browser/base/content/test/forms/browser_selectpopup_searchfocus.js | application crashed [@ MOZ_CrashOOL]
TEST-UNEXPECTED-FAIL | leakcheck | tab process: missing output line for total leaks!

This has changed (today?). Earlier the ShutdownLeaks message was after the test failures. In it's current state, it's confusing for the sheriffs because they have to ignore the first failure. In the previous result flow, it was easier to ignore because the output after the test failure was recognizable as fallout from that test failure.
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.