793576 - XULRunner nightly builds failing in uploadsymbols with "xrbld_dsa not accessible: No such file or directory"

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P2)

Description

[Phil Ringnalda (:philor)]

Yeah, "wait, we still build XULRunner?" but that's already been done.

Rather reminiscent of bug 793217, except I think this is "the key doesn't exist" rather than "the right key doesn't exist, and it has been told to use the wrong key which won't work."

https://tbpl.mozilla.org/php/getParsedLog.php?id=15454358&tree=Firefox&full=1
Linux mozilla-central xulrunner on 2012-09-23 03:21:01 PDT for push 9d285bedbc1f

Transferring symbols... ./dist/xulrunner-18.0a1.en-US.linux-i686.crashreporter-symbols-full.zip
Warning: Identity file /home/mock_mozilla/.ssh/xrbld_dsa not accessible: No such file or directory.
debug1: Reading configuration data /home/mock_mozilla/.ssh/config
debug1: Applying options for *mozilla.com
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: Applying options for *
debug1: Connecting to symbols1.dmz.phx1.mozilla.com [10.8.74.48] port 22.
debug1: Connection established.
debug1: identity file /home/mock_mozilla/.ssh/identity type -1
debug1: identity file /home/mock_mozilla/.ssh/id_rsa type -1
debug1: identity file /home/mock_mozilla/.ssh/id_dsa type -1
debug1: Remote protocol version 2.0, remote software version OpenSSH_5.3
debug1: match: OpenSSH_5.3 pat OpenSSH*
debug1: Enabling compatibility mode for protocol 2.0
debug1: Local version string SSH-2.0-OpenSSH_5.3
debug1: SSH2_MSG_KEXINIT sent
debug1: SSH2_MSG_KEXINIT received
debug1: kex: server->client aes128-ctr hmac-md5 none
debug1: kex: client->server aes128-ctr hmac-md5 none
debug1: SSH2_MSG_KEX_DH_GEX_REQUEST(1024<1024<8192) sent
debug1: expecting SSH2_MSG_KEX_DH_GEX_GROUP
debug1: SSH2_MSG_KEX_DH_GEX_INIT sent
debug1: expecting SSH2_MSG_KEX_DH_GEX_REPLY
debug1: Host 'symbols1.dmz.phx1.mozilla.com' is known and matches the RSA host key.
debug1: Found key in /home/mock_mozilla/.ssh/known_hosts:7
debug1: ssh_rsa_verify: signature correct
debug1: SSH2_MSG_NEWKEYS sent
debug1: expecting SSH2_MSG_NEWKEYS
debug1: SSH2_MSG_NEWKEYS received
debug1: SSH2_MSG_SERVICE_REQUEST sent
debug1: SSH2_MSG_SERVICE_ACCEPT received
debug1: Authentications that can continue: publickey,gssapi-keyex,gssapi-with-mic
debug1: Next authentication method: gssapi-keyex
debug1: No valid Key exchange context
debug1: Next authentication method: gssapi-with-mic
debug1: Unspecified GSS failure.  Minor code may provide more information
Credentials cache file '/tmp/krb5cc_500' not found

debug1: Unspecified GSS failure.  Minor code may provide more information
Credentials cache file '/tmp/krb5cc_500' not found

debug1: Unspecified GSS failure.  Minor code may provide more information


debug1: Unspecified GSS failure.  Minor code may provide more information


debug1: Next authentication method: publickey
debug1: Trying private key: /home/mock_mozilla/.ssh/identity
debug1: Trying private key: /home/mock_mozilla/.ssh/id_rsa
debug1: Trying private key: /home/mock_mozilla/.ssh/id_dsa
debug1: No more authentication methods to try.
Permission denied (publickey,gssapi-keyex,gssapi-with-mic).
lost connection
make: *** [uploadsymbols] Error 1

Comment 1

[[e-mail] (:bhearsum)]

Probably need the xrbld keys on the mock slaves.

Comment 2

[Rail Aliiev [:rail]]

I updated all AWS machines and the following HP machines:

bld-centos6-hp-006
bld-centos6-hp-008
bld-centos6-hp-012
bld-centos6-hp-015
bld-centos6-hp-016
bld-centos6-hp-019

Still need to check the following ones:
bld-centos6-hp-007

bld-centos6-hp-009
bld-centos6-hp-013
bld-centos6-hp-017
bld-centos6-hp-018

Comment 3

[Rail Aliiev [:rail]]

Done:
bld-centos6-hp-007
bld-centos6-hp-017
bld-centos6-hp-018

TODO: (bug 779487)
bld-centos6-hp-009
bld-centos6-hp-013

BTW, what's the ref machine for these? Couldn't find any entry about this platform in https://wiki.mozilla.org/ReferencePlatforms#Reference_Platforms :/

Comment 4

[Rail Aliiev [:rail]]

Only need to deploy the key to bld-centos6-hp-009, which is dead right now. Filed bug bld-centos6-hp-009 to track it.

Comment 5

[Nick Thomas [:nthomas] (UTC+12)]

Deployed xrbld key to bld-centos6-hp-009.