Closed Bug 1048559 Opened 7 years ago Closed 7 years ago

Always dump log messages with an ERROR or CRITICAL level

Categories

(Testing :: Mochitest, defect)

x86
macOS
defect
Not set
normal

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: akachkach, Assigned: akachkach)

References

(Blocks 1 open bug)

Details

Attachments

(1 file)

The log buffering in mochitest hides all log message unless there's a failure (a test failing, or an unstructured log starting with TEST-UNEXPECTED since we still have some of those in a couple tests).

We should also consider log messages with an ERROR or CRITICAL log level.
Blocks: 778688
Comment on attachment 8467354 [details] [diff] [review]
0001-Bug-1048559-Consider-ERROR-and-CRITICAL-mochitest-lo.patch

Review of attachment 8467354 [details] [diff] [review]:
-----------------------------------------------------------------

It looks like this isn't in the old log buffering logic, so I'm not sure why this is necessary now. It will give some context whenever these levels are logged, but wont change the job status. Can you give some context for the issue this is trying to solve?
We were trying to solve bug 1032878, and mwargers created a patch that logged an error in case a test_status is sent after a test_end, but with the current buffering logic we're missing those errors.

But maybe we should try using ok(false, some_message) in that case instead?
The ok function doesn't exist in the TestRunner.js window, which is the parent window of the test iframe (where SimpleTest.ok exists).
SimpleTest.ok is essentially doing this logging: http://mxr.mozilla.org/mozilla-central/source/testing/mochitest/tests/SimpleTest/SimpleTest.js#339
Should I be using something similar for bug 1032878?
Comment on attachment 8467354 [details] [diff] [review]
0001-Bug-1048559-Consider-ERROR-and-CRITICAL-mochitest-lo.patch

Review of attachment 8467354 [details] [diff] [review]:
-----------------------------------------------------------------

After chatting with akachkach, it sounds like there are other ways to get the information we need from the runner.
Attachment #8467354 - Flags: review?(cmanchester)
Changing this to WONTFIX for now as we're not planning to go this way.
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.