Talos & build redness due to Mpt connectivity issues

RESOLVED FIXED

Status

--
blocker
RESOLVED FIXED
9 years ago
5 years ago

People

(Reporter: dholbert, Unassigned)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(URL)

(Reporter)

Description

9 years ago
The last few cycles for almost all Talos columns on mozilla-central have been red, with errors like this:
{
C:\WINDOWS\system32\cmd.exe /c wget --progress=dot:mega -N http://stage.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-central-win32/1268669724/firefox-3.7a3.en-US.win32.crashreporter-symbols.zip
 in dir C:\talos-slave\mozilla-central-xp-nochrome\../talos-data (timeout 1200 secs)
 watching logfiles {}
 argv: ['C:\\WINDOWS\\system32\\cmd.exe', '/c', 'wget', '--progress=dot:mega', '-N', 'http://stage.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-central-win32/1268669724/firefox-3.7a3.en-US.win32.crashreporter-symbols.zip']
 environment:
[-----SNIP-----]
--11:48:24--  http://stage.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-central-win32/1268669724/firefox-3.7a3.en-US.win32.crashreporter-symbols.zip
           => `firefox-3.7a3.en-US.win32.crashreporter-symbols.zip'
Resolving stage.mozilla.org... 10.2.74.116
Connecting to stage.mozilla.org|10.2.74.116|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 52,350,963 (50M) [application/zip]

    0K ........ ........ ........ ........ ........ ........  6%    6.11 KB/s
 3072K ........ ........ ........ ........ ........ ........ 12%    7.62 KB/s
 6144K ........ ........ ........ ........ ........ ........ 18%    4.64 KB/s
 9216K ........ ........ ..
remoteFailed: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion.
]
[Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion.
]
}
e.g.
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1268678782.1268685669.21644.gz
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1268678790.1268685799.21982.gz
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1268682568.1268686342.23939.gz

I think this is due to the connectivity issues we're experiencing with Mpt right now, Bug 552481.  (I'm filing this bug separately to track the talos redness and state-o'-the-tree, though.)

I've closed the tree for now, and intend to reopen when talos is healthy again.
(Reporter)

Comment 1

9 years ago
Some build boxes are having redness due to the connectivity problems, too. e.g.
http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1268678032.1268684664.18996.gz
WINNT 5.2 mozilla-central build on 2010/03/15 11:33:52
mw32-ix-slave10
{
make[1]: Entering directory `/e/builds/moz2_slave/mozilla-central-win32/build/obj-firefox/browser/installer'
d:/mozilla-build/python25/python2.5.exe /e/builds/moz2_slave/mozilla-central-win32/build/build/upload.py --base-path ../../dist \
		"../../dist/firefox-3.7a4pre.en-US.win32.zip" \
		"../../dist/install/sea/firefox-3.7a4pre.en-US.win32.installer.exe" \
		 \
		 \
		"../../dist/firefox-3.7a4pre.en-US.win32.tests.tar.bz2" \
		"../../dist/firefox-3.7a4pre.en-US.win32.crashreporter-symbols.zip" \
		 \
		"../../dist//firefox-3.7a4pre.en-US.win32.txt" \
		  ../../dist/firefox-3.7a4pre.en-US.langpack.xpi

command timed out: 1200 seconds without output
program finished with exit code 1
}

http://tinderbox.mozilla.org/showlog.cgi?log=Firefox/1268672405.1268678283.3006.gz
WINNT 5.2 mozilla-central build on 2010/03/15 10:00:05
mw32-ix-slave04
{
e:/builds/moz2_slave/mozilla-central-win32/build/obj-firefox/config/nsinstall.exe -D ./dist/crashreporter-symbols
d:/mozilla-build/python25/python2.5.exe /e/builds/moz2_slave/mozilla-central-win32/build/toolkit/crashreporter/tools/symbolstore.py \
	  -c -i --vcs-info                                          \
	  -s /e/builds/moz2_slave/mozilla-central-win32/build               \
	  /e/builds/moz2_slave/mozilla-central-win32/build/toolkit/crashreporter/tools/win32/dump_syms.exe                                                \
	  ./dist/crashreporter-symbols                                   \
	  . >                                        \
	  ./dist/crashreporter-symbols/firefox-3.7a4pre-WINNT-20100315104909-symbols.txt

remoteFailed: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion.
]
[Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion.
]
}
Summary: Talos redness due to Mpt connectivity issues → Talos & build redness due to Mpt connectivity issues
(Reporter)

Updated

9 years ago
Depends on: 551187
Severity: normal → blocker
(Reporter)

Comment 3

9 years ago
(mrz suggests that bug 551187 will fix this)
(Reporter)

Comment 4

9 years ago
Resolving as FIXED, since I believe bug 551187's proxy is now active, and tinderbox is green and happy again. Yay!
Status: NEW → RESOLVED
Last Resolved: 9 years ago
Resolution: --- → FIXED
(Assignee)

Updated

5 years ago
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.