If you think a bug might affect users in the 57 release, please set the correct tracking and status flags for Release Management.

errors in Chief update_celery script on mozillians.prod

RESOLVED FIXED

Status

Infrastructure & Operations
WebOps: Other
P3
normal
RESOLVED FIXED
5 years ago
4 years ago

People

(Reporter: sancus, Assigned: solarce)

Tracking

Details

(Reporter)

Description

5 years ago
[2013-02-13 14:33:09] Running update_celery
[2013-02-13 14:33:09] [generic-celery2.seamicro.phx1.mozilla.com] running: /data/bin/update-www.sh mozillians.org
[2013-02-13 14:33:09] [generic-celery1.webapp.phx1.mozilla.com] running: /data/bin/update-www.sh mozillians.org
[2013-02-13 14:33:09] [generic-celery3.webapp.phx1.mozilla.com] running: /data/bin/update-www.sh mozillians.org
[2013-02-13 14:33:09] [generic-celery3.webapp.phx1.mozilla.com] failed: /data/bin/update-www.sh mozillians.org (0.027s)
[generic-celery3.webapp.phx1.mozilla.com] err: Host key verification failed.
[2013-02-13 14:33:09] [generic-celery1.webapp.phx1.mozilla.com] failed: /data/bin/update-www.sh mozillians.org (0.034s)
[generic-celery1.webapp.phx1.mozilla.com] err: Host key verification failed.

We're getting the above errors in the update_celery portion of the mozillians.prod Chief script when we run it.
(Assignee)

Comment 1

5 years ago
Yes, we're in the process of replacing these nodes and some SSH host keys, this has been cleared out

[root@genericadm.private.phx1 ~]# issue-multi-command genericrhel6-celery ls
[2013-02-13 16:27:57] [generic-celery2.seamicro.phx1.mozilla.com] running: ls
[2013-02-13 16:27:57] [generic-celery1.webapp.phx1.mozilla.com] running: ls
[2013-02-13 16:27:57] [generic-celery3.webapp.phx1.mozilla.com] running: ls
[2013-02-13 16:27:57] [generic-celery1.webapp.phx1.mozilla.com] finished: ls (0.241s)
[generic-celery1.webapp.phx1.mozilla.com] out: anaconda-ks.cfg
[generic-celery1.webapp.phx1.mozilla.com] out: install.log
[generic-celery1.webapp.phx1.mozilla.com] out: install.log.syslog
[generic-celery1.webapp.phx1.mozilla.com] out: post_install.log
[2013-02-13 16:27:57] [generic-celery3.webapp.phx1.mozilla.com] finished: ls (0.284s)
[generic-celery3.webapp.phx1.mozilla.com] out: anaconda-ks.cfg
[generic-celery3.webapp.phx1.mozilla.com] out: install.log
[generic-celery3.webapp.phx1.mozilla.com] out: install.log.syslog
[generic-celery3.webapp.phx1.mozilla.com] out: post_install.log
[2013-02-13 16:27:58] [generic-celery2.seamicro.phx1.mozilla.com] finished: ls (0.517s)
[generic-celery2.seamicro.phx1.mozilla.com] out: anaconda-ks.cfg
[generic-celery2.seamicro.phx1.mozilla.com] out: install.log
[generic-celery2.seamicro.phx1.mozilla.com] out: install.log.syslog
[generic-celery2.seamicro.phx1.mozilla.com] out: post_install.log
Assignee: server-ops-webops → bburton
Status: NEW → RESOLVED
Last Resolved: 5 years ago
Priority: -- → P3
Resolution: --- → FIXED
(Reporter)

Comment 2

5 years ago
Thanks!
Component: Server Operations: Web Operations → WebOps: Other
Product: mozilla.org → Infrastructure & Operations
You need to log in before you can comment on or make changes to this bug.