804167 - Restart celery after pushing to mozillians

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task, P4)

Description

[Giorgos Logiotatidis [:giorgos]]

Please add 'celery restart' to deployment scripts of mozillians(-dev, -stage) to register new tasks on every push.

Thnx!

Comment 1

[Daniel Maher [:phrawzty]]

I added a restart of the mozillians celery process to the -dev deployment script.  It was already present in the -stage deployment script, so I made no modifications to -stage.

Comment 2

[Giorgos Logiotatidis [:giorgos]]

Thanks phrawzty! Is it present on prod also? (I guess I failed to make this clear, sorry! :)

Comment 3

[Daniel Maher [:phrawzty]]

Yes, it is present in prod already also; oddly, only -dev didn't have the celery restart.

Comment 4

[Giorgos Logiotatidis [:giorgos]]

After adding this we get an email every 15' with the following content:

"""
[2012-10-23 01:03:23] [generic-celery1.dev.seamicro.phx1.mozilla.com] running: /data/bin/update-www.sh; service celeryd-mozillians-dev restart
[2012-10-23 01:05:38] [generic-celery1.dev.seamicro.phx1.mozilla.com] finished: /data/bin/update-www.sh; service celeryd-mozillians-dev restart (134.611s)
[generic-celery1.dev.seamicro.phx1.mozilla.com] out: Restarting celery-mozillians-dev: celery-mozillians-dev: stopped
[generic-celery1.dev.seamicro.phx1.mozilla.com] out: celery-mozillians-dev: started
[generic-celery1.dev.seamicro.phx1.mozilla.com] out: [  OK  ]
[2012-10-23 01:05:38] [generic1.dev.webapp.phx1.mozilla.com] running: touch /data/www/mozillians-dev.allizom.org/mozillians/wsgi/playdoh.wsgi
[2012-10-23 01:05:38] [generic1.dev.webapp.phx1.mozilla.com] finished: touch /data/www/mozillians-dev.allizom.org/mozillians/wsgi/playdoh.wsgi (0.147s)
"""

Can we suspend this please?

Thanks!

Comment 5

[Daniel Maher [:phrawzty]]

01:54:13 < phrawzty> giorgos: just so that i'm clear and what exactly you're requesting
01:54:46 < phrawzty> giorgos: did you want me to disable the cron job, or did you want me to hide that particular output block ?
01:55:08 < giorgos> hide the output please, so we don't get the email if everything is OK

02:09:59 < phrawzty> giorgos: ok, so good news and bad news.
02:10:11 < giorgos> ok bad news first
02:10:27 < phrawzty> giorgos: bad news is that you'll never know if those processes failed.
02:10:34 < phrawzty> giorgos: good news is that you won't get that email every 15 minutes :)
02:10:58 < giorgos> phrawzty, well i'll take it !