Closed Bug 1048423 Opened 5 years ago Closed 5 years ago
Mochitest is incorrectly interpreting a todo
_is as an unexpected failure
Looks like this failure started on jgraham's push for bug 1042921. However, it seems highly unlikely that his patch actually caused this failure vs. causing a previously-hidden failure to appear. So there are two issues here: 1.) The test is perma-failing 2.) The harness isn't failing the run because of it This bug is on file for fixing the harness side of this issue. Bug 1048422 was filed for fixing the test issue specifically.
WIP patch to calculate the summary on the Python side (to take into account all failures).
Attachment #8467446 - Flags: review?(james)
Assignee: nobody → cmanchester
Status: NEW → ASSIGNED
Summary: Mochitest-3 is green even though dom/inputmethod/mochitest/test_basic.html is perma-failing → The log for mochitest-3 shows a todo_is as an unexpected failure
Summary: The log for mochitest-3 shows a todo_is as an unexpected failure → Mochitest is incorrectly interpreting a todo_is as an unexpected failure
Status: ASSIGNED → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla34
(In reply to Chris Manchester [:chmanchester] from comment #2) > and the formatter formats as > 'TEST-UNEXPECTED-', triggering tbpl's regex (but not mozharness', because it > isn't at the beginning of a line). Filed bug 1048985 for making this match even if not at start of line.
You need to log in before you can comment on or make changes to this bug.