1066302 - Test jobs can log a little less

Status: RESOLVED WONTFIX

(Testing :: Mozbase, defect)

Description

[Chris Manchester (limited bugmail, email directly)]

Now that we have structured logging for a many of our test jobs, maybe we can implement a minimalist variant of the tbpl formatter and put a little less in the actual log. It seems like most of our test logs are full of passing tests nobody looks at. Form mochitests instead of:

121 INFO TEST-START | /tests/content/base/test/test_XHRSendData.html
122 INFO TEST-OK | /tests/content/base/test/test_XHRSendData.html | took 338ms
123 INFO TEST-START | /tests/content/base/test/test_XHR_anon.html
124 INFO TEST-OK | /tests/content/base/test/test_XHR_anon.html | took 186ms


We can just log:

/tests/content/base/test/test_XHRSendData.html
/tests/content/base/test/test_XHR_anon.html

Where the emission of the path name would correspond to the test start, so in case the test times out and there isn't anything to go on, we can figure out which test was running from looking at the log. Anything that should look like a failure would be logged exactly as before, and we still get the sanity check of looking at the log and seeing that the tests we expected to run actually ran. This might not be acceptable, but with structured logging we can experiment with this pretty easily.

Comment 1

[James Graham [:jgraham]]

I don't think there are any plans to do this; please reopen if this is still something we should work on.