769017 - Log parser doesn't catch this mochitest failure - treats it as 'success': ERROR TEST-UNEXPECTED-FAIL | /tests/dom/indexedDB/test/test_traffic_jam.html | expect it to be fired at the transaction

Status: RESOLVED DUPLICATE of bug 770046

(Core :: Storage: IndexedDB, defect)

Description

[Daniel Holbert [:dholbert]]

See this mochitest log:

https://tbpl.mozilla.org/php/getParsedLog.php?id=13045396&full=1&branch=try
Rev3 Fedora 12x64 try debug test mochitests-2/5 on 2012-06-27 11:35:05 PDT for push 8ca66050cc01

It helpfully highlights this mochitest failure:
{
2 ERROR TEST-UNEXPECTED-FAIL | /tests/dom/indexedDB/test/test_traffic_jam.html | expect it to be fired at the transaction - got [object IDBTransaction @ 0x1ac3280 (native @ 0x14999c0)], expected null
}

...but then it says:

{
builder: try_fedora64-debug_test-mochitests-2
slave: talos-r3-fed64-005
starttime: 1340822105.55
results: success (0)
buildid: 20120627105315
builduid: 021aedc2057c4fa399b69eb5e36f6558
revision: 8ca66050cc01
}

ACTUAL RESULTS:   "results: success" in the block above
EXPECTED RESULTS: "results: warnings (1)"

IIRC, that "results" line is what makes the log colored green vs. orange.

Comment 1

[Daniel Holbert [:dholbert]]

(CC'ing armenzg_buildduty for triage / investigation.)

Comment 2

[Daniel Holbert [:dholbert]]

Attachment: raw log (gzipped)

For reference, here's a copy of the (gzipped) full raw log.

Comment 3

[(not currently active) Ted Mielczarek]

So, this test is broken. The log parser determines the pass/fail status from the summary at the end:
23417 INFO Passed: 211977
23418 INFO Failed: 0
23419 INFO Todo:   21394

It's not showing up as an actual failure.

Comment 4

[Kyle Huey (Exited; not receiving bugmail, old account, do not use)]

This is bent's crazy test_ipc setup.

Comment 6

[:Ms2ger (he/him; ⌚ UTC+1/+2)]

Duping forward to the bug that explains how to fix it.

Comment 7

[Ben Turner (not reading bugmail, use the needinfo flag!)]

(In reply to Kyle Huey [:khuey] ([e-mail]) from comment #4)
> This is bent's crazy test_ipc setup.

s/crazy/awesome/ ;)

Comment 8

[Justin Wood (:Callek)]

(In reply to ben turner [:bent] from comment #7)
> (In reply to Kyle Huey [:khuey] ([e-mail]) from comment #4)
> > This is bent's crazy test_ipc setup.
> 
> s/crazy/awesome/ ;)

true, IFF we want to ignore any and all failures.

I can concede it can be true, in the future, IFF we don't ignore failures.