1005426 - (b-2008-sm-0001) b-2008-sm-0001 problem tracking

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task, P3)

Description

[Phil Ringnalda (:philor)]

Took one job, https://tbpl.mozilla.org/php/getParsedLog.php?id=38976281&tree=Mozilla-Inbound, burned it.

Disabled in slavealloc.

Comment 1

[Chris Cooper [:coop] (he/him)]

Looks like |make upload| timed out running signtool.py:

python c:/builds/moz2_slave/m-in-w32-d-0000000000000000000/tools/release/signing/signtool.py --cachedir c:/builds/moz2_slave/m-in-w32-d-0000000000000000000/signing_cache -t c:/builds/moz2_slave/m-in-w32-d-0000000000000000000/token -n c:/builds/moz2_slave/m-in-w32-d-0000000000000000000/nonce -c c:/builds/moz2_slave/m-in-w32-d-0000000000000000000/tools/release/signing/host.cert -H signing4.srv.releng.scl3.mozilla.com:9110 -H signing5.srv.releng.scl3.mozilla.com:9110 -H signing6.srv.releng.scl3.mozilla.com:9110 -f gpg '../../dist//firefox-32.0a1.en-US.win32.checksums'
c:/builds/moz2_slave/m-in-w32-d-0000000000000000000/build/obj-firefox/_virtualenv/Scripts/python.exe c:/builds/moz2_slave/m-in-w32-d-0000000000000000000/build/build/upload.py --base-path ../../dist \
	'../../dist/firefox-32.0a1.en-US.win32.zip' '../../dist/install/sea/firefox-32.0a1.en-US.win32.installer.exe'  '../../dist/win32/xpi/firefox-32.0a1.en-US.langpack.xpi'  '../../dist/firefox-32.0a1.en-US.win32.tests.zip' '../../dist/firefox-32.0a1.en-US.win32.crashreporter-symbols.zip'  '../../dist//firefox-32.0a1.en-US.win32.txt' '../../dist//firefox-32.0a1.en-US.win32.json' '../../dist/jsshell-win32.zip'     ../../dist/host/bin/mar.exe  ../../dist/host/bin/mbsdiff.exe     \
	'../../dist//firefox-32.0a1.en-US.win32.checksums' '../../dist//firefox-32.0a1.en-US.win32.checksums'.asc
2014-05-02 19:50:56,627 - e7d04f0fddae8b36bf0db7def724f5c5774ef78d: exists in the cache; copying to ../../dist//firefox-32.0a1.en-US.win32.checksums.asc
2014-05-02 19:50:56,628 - e7d04f0fddae8b36bf0db7def724f5c5774ef78d: OK
WARNING: Timeout (2460) exceeded, killing process 4484

(From http://buildbot-master84.srv.releng.scl3.mozilla.com:8001/builders/WINNT%205.2%20mozilla-inbound%20leak%20test%20build/builds/1871/steps/make_upload/logs/stdio)

If I had to guess, I'd say the seamicros are in a new ip range that needs to be added to puppet for the signing servers: http://hg.mozilla.org/build/puppet/file/143e86d64c2b/manifests/moco-config.pp

Comment 2

[Massimo Gervasini [:massimo]]

Hi coop,

that was my guess too, but their IP range is already in $signing_allowed_ips (10.26.36.0/22), as catlee found out, the root cause is probably because "stage.mozilla.org" was missing from ~/.ssh/known_hosts.

I have copied the known_hosts file from bld-centos6-hp-006.build.mozilla.org on sm-000{1..3} and I am enabling them again in production in few minutes.

Comment 3

[Jordan Lund (:jlund)]

loaning to jlund for vs2013 work (bug 1019165)

Comment 4

[Jordan Lund (:jlund)]

I'm done with this machine. I only ran a build on it cleanly so it shouldn't need a re-image.

note: arr ran a gpo on this that installed vs2013 like we have done for our win ix machines: https://bugzilla.mozilla.org/show_bug.cgi?id=1019165#c74

She will be doing the remaining seamicros tomorrow but I am enabling this one now.