1261046 - [Reps] Chief not updating dev instance

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Engagement, task)

Description

[Tasos Katsoulas [:tasos]]

Chief is not updating the dev server (reps-dev.allizom.org) with new code from master. 

Please also see history and traceback here:
http://genericadm.private.phx1.mozilla.com/chief/reps.dev/history

Comment 1

[John Giannelos [:nemo-yiannis]]

Here is the traceback that we are getting from the chief logs:


I am trying to load /data/python-dev/src/reps-dev.allizom.org/remo/bin/update/update.py

Traceback (most recent call last):
  File "/usr/bin/commander", line 4, in <module>
    main()
  File "/usr/lib/python2.6/site-packages/commander/main.py", line 102, in main
    cmd_mod = import_cmdfile(cmdfile)
  File "/usr/lib/python2.6/site-packages/commander/main.py", line 83, in import_cmdfile
    return imp.load_source('cmdfile', cmdfile)
  File "/data/python-dev/src/reps-dev.allizom.org/remo/bin/update/update.py", line 76, in <module>
    @hostgroups(settings.CELERY_HOSTGROUP, remote_kwargs={'ssh_key': settings.SSH_KEY})
  File "/usr/lib/python2.6/site-packages/commander/deploy.py", line 121, in hostgroups
    hs = reduce(lambda x, y: x + y, [get_systems(group) for group in groups])
  File "/usr/lib/python2.6/site-packages/commander/hosts.py", line 23, in get_systems
    return commanderconfig.hostgroups[host_group]
KeyError: 'genericrhel6-celery-dev'

Comment 2

[John Giannelos [:nemo-yiannis]]

The last successful chief push was on 15-Mar-2016. It looks like some configuration change must have occurred since then.

Comment 3

[Eric Ziegenhorn :ericz]

The celery hostgroup was misconfigured in commander_settings.py -- not sure how that happened or how it ever worked, but I fixed it and it's working now.