505755 - exceptions are double-counted in the failures count

Status: RESOLVED WONTFIX

(Testing :: Mochitest, defect)

Description

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

Tinderbox logs that show exceptions during mochitest have double the number of failures expected.  For example:

http://tinderbox.mozilla.org/showlog.cgi?log=Firefox-Unittest/1248269038.1248271997.14905.gz
WINNT 5.2 mozilla-central test mochitests on 2009/07/22 06:23:58  

had three exceptions (bug 505217), but the summary shows:

92835 INFO Failed: 6

Comment 1

[(not currently active) Ted Mielczarek]

Serge, any idea?

Comment 2

[Serge Gautherie (:sgautherie)]

No idea, as I can't reproduce (with my local build):
{
[Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.9.2a1pre) Gecko/20090715 SeaMonkey/2.1a1pre] (home, optim default) (W2Ksp4)
(http://hg.mozilla.org/mozilla-central/rev/d190d9b6ccd1
 +http://hg.mozilla.org/comm-central/rev/773809454cf2 + bug 503724 patch)

6804 ERROR TEST-UNEXPECTED-FAIL | /tests/toolkit/content/tests/widgets/test_vide
ocontrols.html | [SimpleTest/SimpleTest.js, window.onerror] An error occurred: [
 uncaught exception: test string throw ]

6821 INFO Failed: 1
}

Is it reproducible by downloading that packaged test build?
Or in any other way? (Or any other examples?)

Do we know what caused the failures in the first place?

Comment 3

[Serge Gautherie (:sgautherie)]

Ah, I saw the same kind of log in another case, but I missed to report it here :-/

Comment 4

[Serge Gautherie (:sgautherie)]

http://tinderbox.mozilla.org/showlog.cgi?log=Firefox-Unittest/1249603816.1249606640.20711.gz
WINNT 5.2 mozilla-central test mochitests

Bug 505217 - test_videocontrols.html, test_videocontrols_audio_direction.html, test_videocontrols_video_direction.html, test_handlerApps.xhtml failures with NS_ERROR_XPC_BAD_OP_ON_WN_PROTO exception

Comment 5

[Andrew Halberstadt [:ahal]]

Mass closing mochitest bugs that haven't had activity in the past 5 years. Please re-open or file a new bug with modern context if this is still relevant.