523394 - debug builds spit out lots of output, confuse tinderbox error parser

Status: RESOLVED FIXED

(Webtools Graveyard :: Tinderbox, defect)

Description

[(not currently active) Ted Mielczarek]

You can look at any Tinderbox log of a debug unittest run to see this, but the "error summary" section is just absolutely full of junk. There are probably a few root causes here:
1) Error console output goes to stdout
2) strict JavaScript mode is on
3) Random debug printfs that have "Error: " in them somewhere

We need to fix this in some way, or nobody will ever be able to look at a Tinderbox log usefully.

Comment 1

[David Baron :dbaron: (⌚️UTC-5, no longer working on Mozilla)]

I'd say the tinderbox error parser should probably be a little stricter.

Comment 2

[(not currently active) Ted Mielczarek]

Attachment: ignore \WError: in ep_unittest

Indeed, this simple patch takes this log:
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox-Unittest/1256182254.1256186574.13089.gz#err48
down to just 4 lines of detected errors, the TEST-UNEXPECTED-FAIL lines.

Only the one removal is strictly necessary, but we're not actually using those old mochitest/reftest/xpcshell test failure lines anymore anyway.

Comment 3

[(not currently active) Ted Mielczarek]

Checking in ep_unittest.pl;
/cvsroot/mozilla/webtools/tinderbox/ep_unittest.pl,v  <--  ep_unittest.pl
new revision: 1.5; previous revision: 1.4
done

Comment 4

[(not currently active) Ted Mielczarek]

Filed bug 523974 on getting tinderbox.mozilla.org updated.