Closed Bug 841183 Opened 11 years ago Closed 11 years ago

errors in Chief update_celery script on mozillians.prod

Categories

(Infrastructure & Operations Graveyard :: WebOps: Other, task, P3)

Product:
Infrastructure & Operations Graveyard
Component:
WebOps: Other
Type:
task

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: sancus, Assigned: bburton)

Details

[2013-02-13 14:33:09] Running update_celery
[2013-02-13 14:33:09] [generic-celery2.seamicro.phx1.mozilla.com] running: /data/bin/update-www.sh mozillians.org
[2013-02-13 14:33:09] [generic-celery1.webapp.phx1.mozilla.com] running: /data/bin/update-www.sh mozillians.org
[2013-02-13 14:33:09] [generic-celery3.webapp.phx1.mozilla.com] running: /data/bin/update-www.sh mozillians.org
[2013-02-13 14:33:09] [generic-celery3.webapp.phx1.mozilla.com] failed: /data/bin/update-www.sh mozillians.org (0.027s)
[generic-celery3.webapp.phx1.mozilla.com] err: Host key verification failed.
[2013-02-13 14:33:09] [generic-celery1.webapp.phx1.mozilla.com] failed: /data/bin/update-www.sh mozillians.org (0.034s)
[generic-celery1.webapp.phx1.mozilla.com] err: Host key verification failed.

We're getting the above errors in the update_celery portion of the mozillians.prod Chief script when we run it.
Yes, we're in the process of replacing these nodes and some SSH host keys, this has been cleared out

[root@genericadm.private.phx1 ~]# issue-multi-command genericrhel6-celery ls
[2013-02-13 16:27:57] [generic-celery2.seamicro.phx1.mozilla.com] running: ls
[2013-02-13 16:27:57] [generic-celery1.webapp.phx1.mozilla.com] running: ls
[2013-02-13 16:27:57] [generic-celery3.webapp.phx1.mozilla.com] running: ls
[2013-02-13 16:27:57] [generic-celery1.webapp.phx1.mozilla.com] finished: ls (0.241s)
[generic-celery1.webapp.phx1.mozilla.com] out: anaconda-ks.cfg
[generic-celery1.webapp.phx1.mozilla.com] out: install.log
[generic-celery1.webapp.phx1.mozilla.com] out: install.log.syslog
[generic-celery1.webapp.phx1.mozilla.com] out: post_install.log
[2013-02-13 16:27:57] [generic-celery3.webapp.phx1.mozilla.com] finished: ls (0.284s)
[generic-celery3.webapp.phx1.mozilla.com] out: anaconda-ks.cfg
[generic-celery3.webapp.phx1.mozilla.com] out: install.log
[generic-celery3.webapp.phx1.mozilla.com] out: install.log.syslog
[generic-celery3.webapp.phx1.mozilla.com] out: post_install.log
[2013-02-13 16:27:58] [generic-celery2.seamicro.phx1.mozilla.com] finished: ls (0.517s)
[generic-celery2.seamicro.phx1.mozilla.com] out: anaconda-ks.cfg
[generic-celery2.seamicro.phx1.mozilla.com] out: install.log
[generic-celery2.seamicro.phx1.mozilla.com] out: install.log.syslog
[generic-celery2.seamicro.phx1.mozilla.com] out: post_install.log
Assignee: server-ops-webops → bburton
Status: NEW → RESOLVED
Closed: 11 years ago
Priority: -- → P3
Resolution: --- → FIXED
Thanks!
Component: Server Operations: Web Operations → WebOps: Other
Product: mozilla.org → Infrastructure & Operations
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.