554111 - Intermittent failure in reftest suite: no output in 330 seconds during shutdown

Status: RESOLVED WORKSFORME

(Testing :: Reftest, defect)

Description

[(no longer active)]

http://tinderbox.mozilla.org/showlog.cgi?tree=Firefox&errorparser=unittest&logfile=1269251710.1269255098.18990.gz&buildtime=1269251710&buildname=WINNT%205.2%20mozilla-central%20debug%20test%20reftest&fulltext=1#err0
WINNT 5.2 mozilla-central debug test reftest on 2010/03/22 02:55:10

TEST-UNEXPECTED-FAIL | automation.py | application timed out after 330 seconds
with no output

command timed out: 1200 seconds without output
program finished with exit code 1
elapsedTime=2933.906000
TinderboxPrint: reftest<br/>4267/0/277
buildbot.slave.commands.TimeoutError: command timed out: 1200 seconds without
output
TinderboxPrint: reftest<br/><em class="testfail">timeout</em>

It seems that for some reason, nothing was written on stdout for 330 seconds.  This seems to has happened during shutdown.

Comment 1

[Jesse Ruderman]

Attachment: relevant part of the log

Comment 2

[Jesse Ruderman]

It looks like crashinject failed, too, so we don't have stacks for the hang :(

Comment 3

[Joe Drew (not getting mail)]

Is it possible that http://tinderbox.mozilla.org/showlog.cgi?tree=Firefox&errorparser=unittest&logfile=1270007306.1270009110.2283.gz&buildtime=1270007306&buildname=WINNT%205.2%20mozilla-central%20debug%20test%20mochitests-3%2f5&fulltext=1 is another example of this bug? That one crashed for realsies, but it crashed in lock code, which makes me think that it could potentially be a deadlock situation that sometimes crashes?

Comment 4

[Phil Ringnalda (:philor)]

http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1275761778.1275765046.7409.gz
WINNT 5.2 mozilla-central debug test reftest on 2010/06/05 11:16:18
s: mw32-ix-slave12

Comment 5

[Phil Ringnalda (:philor)]

http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1276142467.1276143860.9591.gz
WINNT 5.2 mozilla-central debug test reftest on 2010/06/09 21:01:07
s: mw32-ix-slave07

Comment 6

[Phil Ringnalda (:philor)]

Comment 5 isn't actually this.

Comment 7

[Legacy TBPL/Treeherder Robot]

philringnalda%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1277473633.1277476648.14355.gz
Rev3 WINNT 6.1 mozilla-central opt test reftest-d2d on 2010/06/25 06:47:13

s: talos-r3-w7-048
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
buildbot.slave.commands.TimeoutError: command timed out: 1200 seconds without output

Comment 9

[Phil Ringnalda (:philor)]

http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1278022134.1278025919.4957.gz
Rev3 WINNT 6.1 mozilla-central opt test reftest-d2d on 2010/07/01 15:08:54
s: talos-r3-w7-023

http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1278022141.1278025494.2952.gz
Rev3 WINNT 6.1 mozilla-central opt test reftest on 2010/07/01 15:09:01
s: talos-r3-w7-033

Comment 10

[Legacy TBPL/Treeherder Robot]

philringnalda%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1278059723.1278062570.29777.gz
Rev3 WINNT 6.1 mozilla-central opt test reftest on 2010/07/02 01:35:23

s: talos-r3-w7-044
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
buildbot.slave.commands.TimeoutError: command timed out: 1200 seconds without output

Comment 11

[Legacy TBPL/Treeherder Robot]

philringnalda%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1278085738.1278089296.3667.gz
Rev3 WINNT 6.1 mozilla-central opt test reftest on 2010/07/02 08:48:58

s: talos-r3-w7-043
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
buildbot.slave.commands.TimeoutError: command timed out: 1200 seconds without output

Comment 12

[Legacy TBPL/Treeherder Robot]

philringnalda%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1278102981.1278106683.18138.gz
Rev3 WINNT 6.1 mozilla-central opt test reftest on 2010/07/02 13:36:21

s: talos-r3-w7-021
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
buildbot.slave.commands.TimeoutError: command timed out: 1200 seconds without output

Comment 13

[Legacy TBPL/Treeherder Robot]

philringnalda%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1278115068.1278118577.5709.gz
Rev3 WINNT 6.1 mozilla-central opt test reftest on 2010/07/02 16:57:48

s: talos-r3-w7-032
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
buildbot.slave.commands.TimeoutError: command timed out: 1200 seconds without output

Comment 14

[Legacy TBPL/Treeherder Robot]

philringnalda%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1278122738.1278126191.3653.gz
Rev3 WINNT 6.1 mozilla-central opt test reftest on 2010/07/02 19:05:38

s: talos-r3-w7-024
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
buildbot.slave.commands.TimeoutError: command timed out: 1200 seconds without output

Comment 15

[Legacy TBPL/Treeherder Robot]

philringnalda%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1278280789.1278283663.16078.gz
Rev3 WINNT 6.1 mozilla-central opt test reftest on 2010/07/04 14:59:49

s: talos-r3-w7-011
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
buildbot.slave.commands.TimeoutError: command timed out: 1200 seconds without output

Comment 16

[Phil Ringnalda (:philor)]

philringnalda%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1278398477.1278401414.21488.gz
Rev3 WINNT 6.1 mozilla-central opt test reftest on 2010/07/05 23:41:17

s: talos-r3-w7-024
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
buildbot.slave.commands.TimeoutError: command timed out: 1200 seconds without output

Comment 17

[Legacy TBPL/Treeherder Robot]

philringnalda%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1278542036.1278545316.19572.gz
Rev3 WINNT 6.1 mozilla-central opt test reftest on 2010/07/07 15:33:56

s: talos-r3-w7-033
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
buildbot.slave.commands.TimeoutError: command timed out: 1200 seconds without output

Comment 18

[Legacy TBPL/Treeherder Robot]

philringnalda%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1278548109.1278551100.9736.gz
Rev3 WINNT 6.1 mozilla-central opt test reftest on 2010/07/07 17:15:09

s: talos-r3-w7-023
REFTEST TEST-UNEXPECTED-FAIL | file:///c:/talos-slave/mozilla-central-win7-opt-u-reftest/build/reftest/tests/layout/reftests/bugs/424236-2.html |
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
buildbot.slave.commands.TimeoutError: command timed out: 1200 seconds without output

Comment 19

[Legacy TBPL/Treeherder Robot]

philringnalda%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1278554914.1278558101.32678.gz
Rev3 WINNT 6.1 mozilla-central opt test reftest on 2010/07/07 19:08:34

s: talos-r3-w7-005
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
buildbot.slave.commands.TimeoutError: command timed out: 1200 seconds without output

Comment 20

[Legacy TBPL/Treeherder Robot]

ehsan%mozilla.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1279065138.1279068772.28773.gz
WINNT 5.2 mozilla-central debug test mochitests-1/5 on 2010/07/13 16:52:18

s: win32-slave43
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
PROCESS-CRASH | Shutdown | application crashed (minidump found)
Thread 31 (crashed)
TEST-UNEXPECTED-FAIL | automationutils.processLeakLog() | missing output line for total leaks!

Comment 21

[Legacy TBPL/Treeherder Robot]

timeless%mozdev
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1279114042.1279117522.10460.gz
WINNT 5.2 mozilla-central debug test mochitests-1/5 on 2010/07/14 06:27:22

s: win32-slave49
47011 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/document/test/test_bug404320.html | tag was changed - "P" should equal "DL"
47012 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/document/test/test_bug404320.html | tag was changed - undefined should equal "DD"
47013 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/document/test/test_bug404320.html | tag was changed - "P" should equal "DL"
47014 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/document/test/test_bug404320.html | tag was changed - undefined should equal "DD"
47019 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/document/test/test_bug404320.html | tag was changed - "P" should equal "DL"
47020 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/document/test/test_bug404320.html | tag was changed - undefined should equal "DT"
47021 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/document/test/test_bug404320.html | tag was changed - "P" should equal "DL"
47022 ERROR TEST-UNEXPECTED-FAIL | /tests/content/html/document/test/test_bug404320.html | tag was changed - undefined should equal "DT"
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
PROCESS-CRASH | Shutdown | application crashed (minidump found)
Thread 29 (crashed)
TEST-UNEXPECTED-FAIL | automationutils.processLeakLog() | missing output line for total leaks!

Comment 22

[Legacy TBPL/Treeherder Robot]

timeless%mozdev
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1279241101.1279243349.22324.gz
Rev3 Fedora 12x64 mozilla-central debug test mochitests-1/5 on 2010/07/15 17:45:01

s: talos-r3-fed64-035
51031 ERROR TEST-UNEXPECTED-FAIL | /tests/content/media/test/test_timeupdate_small_files.html | Test timed out.
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
PROCESS-CRASH | Shutdown | application crashed (minidump found)
TEST-UNEXPECTED-FAIL | automationutils.processLeakLog() | missing output line for total leaks!

Comment 23

[Legacy TBPL/Treeherder Robot]

timeless%mozdev
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1279264426.1279267082.14247.gz
Rev3 Fedora 12x64 mozilla-central debug test mochitests-1/5 on 2010/07/16 00:13:46

s: talos-r3-fed64-016
51009 ERROR TEST-UNEXPECTED-FAIL | /tests/content/media/test/test_timeupdate_small_files.html | Test timed out.
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
PROCESS-CRASH | Shutdown | application crashed (minidump found)
TEST-UNEXPECTED-FAIL | automationutils.processLeakLog() | missing output line for total leaks!

Comment 24

[Legacy TBPL/Treeherder Robot]

http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1282277421.1282279744.22051.gz
Rev3 Fedora 12 tryserver debug test mochitests-1/5 on 2010/08/19 21:10:21

s: talos-r3-fed-004
53076 ERROR TEST-UNEXPECTED-FAIL | /tests/content/media/test/test_seek.html | Test timed out.
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
PROCESS-CRASH | Shutdown | application crashed (minidump found)
Thread 0 (crashed)
TEST-UNEXPECTED-FAIL | automationutils.processLeakLog() | missing output line for total leaks!

Comment 25

[Legacy TBPL/Treeherder Robot]

dmandelin%mozilla.com
http://tinderbox.mozilla.org/showlog.cgi?log=Jaegermonkey/1282349827.1282353030.6047.gz
Rev3 Fedora 12 jaegermonkey debug test mochitests-1/5 on 2010/08/20 17:17:07

s: talos-r3-fed-004
55522 ERROR TEST-UNEXPECTED-FAIL | /tests/content/media/test/test_seek.html | Test timed out.
55549 ERROR TEST-UNEXPECTED-FAIL | /tests/content/media/test/test_seek_out_of_range.html | Test timed out.
55584 ERROR TEST-UNEXPECTED-FAIL | /tests/content/media/test/test_timeupdate_small_files.html | Test timed out.
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
PROCESS-CRASH | Shutdown | application crashed (minidump found)
Thread 0 (crashed)
TEST-UNEXPECTED-FAIL | automationutils.processLeakLog() | missing output line for total leaks!

Comment 26

[Chris Jones [:cjones] inactive; ni?/f?/r? if you need me]

http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1282634671.1282638336.22571.gz

Comment 27

[Legacy TBPL/Treeherder Robot]

bjarne%runitsoft.com
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1282646334.1282648611.14711.gz
Rev3 Fedora 12x64 tryserver debug test mochitests-1/5 on 2010/08/24 03:38:54

s: talos-r3-fed64-015
55793 ERROR TEST-UNEXPECTED-FAIL | /tests/content/media/test/test_timeupdate_small_files.html | Test timed out.
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
PROCESS-CRASH | Shutdown | application crashed (minidump found)
Thread 0 (crashed)
TEST-UNEXPECTED-FAIL | automationutils.processLeakLog() | missing output line for total leaks!

Comment 28

[Legacy TBPL/Treeherder Robot]

rstrong%mozilla.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1282862064.1282865739.3707.gz
WINNT 5.2 mozilla-central debug test mochitests-1/5 on 2010/08/26 15:34:24

s: win32-slave28
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
buildbot.slave.commands.TimeoutError: command timed out: 1200 seconds without output

Comment 29

[Legacy TBPL/Treeherder Robot]

iann_bugzilla%blueyonder.co.uk
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1284817141.1284819716.7424.gz
WINNT 5.2 mozilla-central debug test crashtest on 2010/09/18 06:39:01

s: win32-slave35
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
buildbot.slave.commands.TimeoutError: command timed out: 1200 seconds without output

Comment 30

[Legacy TBPL/Treeherder Robot]

mounir.lamouri%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1287566742.1287569531.10631.gz
Rev3 Fedora 12 tryserver debug test mochitests-1/5 on 2010/10/20 02:25:42

s: talos-r3-fed-043
55804 ERROR TEST-UNEXPECTED-FAIL | /tests/content/media/test/test_play_twice.html | Test timed out.
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
PROCESS-CRASH | Shutdown | application crashed (minidump found)
Thread 0 (crashed)
TEST-UNEXPECTED-FAIL | automationutils.processLeakLog() | missing output line for total leaks!

Comment 31

[Legacy TBPL/Treeherder Robot]

fyan%mozilla.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1290459962.1290461646.4464.gz
Rev3 MacOSX Snow Leopard 10.6.2 mozilla-central opt test mochitest-other on 2010/11/22 13:06:02

s: talos-r3-snow-004
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output
PROCESS-CRASH | Main app process exited normally | application crashed (minidump found)
Thread 0 (crashed)
PROCESS-CRASH | Main app process exited normally | application crashed (minidump found)
Thread 0 (crashed)
PROCESS-CRASH | Main app process exited normally | application crashed (minidump found)
Thread 0 (crashed)

Comment 32

[Legacy TBPL/Treeherder Robot]

jfkthame%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1291208491.1291209127.27943.gz
Rev3 MacOSX Leopard 10.5.8 mozilla-central opt test crashtest on 2010/12/01 05:01:31

s: talos-r3-leopard-021
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output

Comment 33

[Legacy TBPL/Treeherder Robot]

mstange%themasta.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1291210469.1291211036.6022.gz
Rev3 MacOSX Leopard 10.5.8 mozilla-central opt test crashtest on 2010/12/01 05:34:29

s: talos-r3-leopard-050
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output

Comment 34

[Legacy TBPL/Treeherder Robot]

mstange%themasta.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1291212595.1291213392.17360.gz
Rev3 MacOSX Leopard 10.5.8 mozilla-central opt test crashtest on 2010/12/01 06:09:55

s: talos-r3-leopard-051
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output

Comment 35

[Legacy TBPL/Treeherder Robot]

mounir.lamouri%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1291215279.1291215961.30638.gz
Rev3 MacOSX Leopard 10.5.8 tryserver opt test crashtest on 2010/12/01 06:54:39

s: talos-r3-leopard-014
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output

Comment 36

[Legacy TBPL/Treeherder Robot]

ehsan%mozilla.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1291220164.1291220929.18685.gz
Rev3 MacOSX Leopard 10.5.8 mozilla-central opt test crashtest on 2010/12/01 08:16:04

s: talos-r3-leopard-004
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output

Comment 37

[Legacy TBPL/Treeherder Robot]

ehsan%mozilla.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1291225055.1291225786.5766.gz
Rev3 MacOSX Leopard 10.5.8 mozilla-central opt test crashtest on 2010/12/01 09:37:35

s: talos-r3-leopard-036
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output

Comment 38

[Legacy TBPL/Treeherder Robot]

josh%joshmatthews.net
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1291226872.1291227586.13558.gz
Rev3 MacOSX Leopard 10.5.8 mozilla-central opt test crashtest on 2010/12/01 10:07:52

s: talos-r3-leopard-050
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output

Comment 39

[Legacy TBPL/Treeherder Robot]

ehsan%mozilla.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1291228529.1291229281.20965.gz
Rev3 MacOSX Leopard 10.5.8 mozilla-central opt test crashtest on 2010/12/01 10:35:29

s: talos-r3-leopard-019
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output

Comment 40

[Legacy TBPL/Treeherder Robot]

philringnalda%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1291230612.1291231389.29779.gz
Rev3 MacOSX Leopard 10.5.8 mozilla-central opt test crashtest on 2010/12/01 11:10:12

s: talos-r3-leopard-049
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output

Comment 41

[Legacy TBPL/Treeherder Robot]

mounir.lamouri%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1291227647.1291228488.17353.gz
Rev3 MacOSX Leopard 10.5.8 tryserver opt test crashtest on 2010/12/01 10:20:47

s: talos-r3-leopard-043
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output

Comment 42

[Legacy TBPL/Treeherder Robot]

mounir.lamouri%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1291253046.1291253885.27972.gz
Rev3 MacOSX Leopard 10.5.8 tryserver opt test crashtest on 2010/12/01 17:24:06

s: talos-r3-leopard-031
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output

Comment 43

[Legacy TBPL/Treeherder Robot]

surkov.alexander%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1291258171.1291258948.17781.gz
Rev3 MacOSX Leopard 10.5.8 mozilla-central opt test crashtest on 2010/12/01 18:49:31

s: talos-r3-leopard-018
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output

Comment 44

[(no longer active)]

Bug 616085 could have been one of the reasons that this has happened to our crashtests.

Comment 45

[Legacy TBPL/Treeherder Robot]

mounir.lamouri%gmail.com
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1291265535.1291266315.12252.gz
Rev3 MacOSX Leopard 10.5.8 tryserver opt test crashtest on 2010/12/01 20:52:15

s: talos-r3-leopard-044
TEST-UNEXPECTED-FAIL | Shutdown | application timed out after 330 seconds with no output

Comment 46

[Phil Ringnalda (:philor)]

And since this was about reftest, not any of the other stuff that has piled on since, nothing after comment 19 was actually this, and this hasn't happened since last July.