"Host key verification failed." for Android builds on multiple build slaves

RESOLVED FIXED

Status

Release Engineering
General
P1
blocker
RESOLVED FIXED
6 years ago
5 years ago

People

(Reporter: dholbert, Assigned: nthomas)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(URL)

(Reporter)

Description

6 years ago
https://tbpl.mozilla.org/php/getParsedLog.php?id=14537838&full=1&branch=mozilla-inbound
Android Armv6 mozilla-inbound build on 2012-08-20 14:26:08 PDT for push 559c5895bad6
builder: mozilla-inbound-android-armv6
slave: bld-centos6-hp-013

{
Executing: ['make', 'upload']
make[1]: Entering directory `/builds/slave/m-in-andrd-armv6/build/obj-firefox/mobile/android/installer'
mkdir -p `dirname "../../../dist//fennec-17.0a1.en-US.android-arm-armv6.checksums"`
CHECKSUM FILE START
[...SNIP...]
CHECKSUM FILE END
/builds/slave/m-in-andrd-armv6/build/obj-firefox/_virtualenv/bin/python /builds/slave/m-in-andrd-armv6/build/build/upload.py --base-path ../../../dist \
		"../../../dist/fennec-17.0a1.en-US.android-arm-armv6.apk"     "../../../dist/fennec-17.0a1.en-US.android-arm-armv6.tests.zip" "../../../dist/fennec-17.0a1.en-US.android-arm-armv6.crashreporter-symbols.zip"  "../../../dist//fennec-17.0a1.en-US.android-arm-armv6.txt"    ../../../dist/gecko-unsigned-unaligned.apk  ../../../dist/robocop.apk  ../../../dist/fennec_ids.txt \
		"../../../dist//fennec-17.0a1.en-US.android-arm-armv6.checksums"
Host key verification failed.
Command ['ssh', '-o', 'IdentityFile=~/.ssh/ffxbld_dsa', 'ffxbld@stage.mozilla.org', 'mktemp -d'] returned non-zero exit code: 255
}
Severity: normal → blocker
OS: Linux → Android
Hardware: x86_64 → ARM
Summary: "Host key verification failed." for Android Armv6 mozilla-inbound build on bld-centos6-hp-013 → "Host key verification failed." for Android builds on multiple tegras
(Assignee)

Updated

6 years ago
Assignee: nobody → nrthomas
Priority: -- → P1
Summary: "Host key verification failed." for Android builds on multiple tegras → "Host key verification failed." for Android builds on multiple build slaves
(Assignee)

Comment 3

6 years ago
This is fallout from bug 778303, which removed ~cltbld/.ssh/known_hosts and added /etc/ssh/ssh_known_hosts. The latter is not made available to the mock environment where make upload is called from.
Depends on: 778303
Closed m-c for this around 15:10, m-i was already closed but this overlaps on owning that closure too.

Comment 5

6 years ago
Backed out bug 778303.
Puppet should be auto-updated shortly; slaves that reboot after that point will pick up the latest changes and should have the correct ssh settings.

Looking into ways to speed that process up.
(Assignee)

Comment 6

6 years ago
Confirmed that fixes up bld-centos6-hp-013, provided you redo the copyin steps and chown steps in a clean mock environment.
(Assignee)

Comment 7

6 years ago
We've rebooted all the idle slaves, as of about 4:20 Pacific, so jobs starting after then are good. Very likely there will be continuing failures from jobs that started prior to that.

We have a green build for 'Android mozilla-inbound build' at 
https://tbpl.mozilla.org/php/getParsedLog.php?id=14540981&tree=Mozilla-Inbound
Status: NEW → RESOLVED
Last Resolved: 6 years ago
Resolution: --- → FIXED
Trees reopened at 16:53
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.