1167217 - Disable/set expiry for celery event queues

Status: RESOLVED DUPLICATE of bug 1215102

(Tree Management :: Treeherder: Data Ingestion, defect, P2)

Description

[Ed Morley [:emorley]]

We're apparently not using the event queues, so we should switch them off to reduce the noise due to bug .

I think we'll want to use some combination of:
CELERY_SEND_EVENTS
CELERY_EVENT_QUEUE_TTL
CELERY_EVENT_QUEUE_EXPIRES

...as well as stopping using the "-E" parameter on the command line (which strangely we only use for some of the workers):

https://github.com/mozilla/treeherder/blob/9da6ddbf4151436f20a763d9543b86409214d8c3/bin/run_celery_worker#L27
https://github.com/mozilla/treeherder/blob/9da6ddbf4151436f20a763d9543b86409214d8c3/bin/run_celery_worker_hp#L26

Comment 1

[Ed Morley [:emorley]]

http://celery.readthedocs.org/en/latest/configuration.html#events

Also https://github.com/celery/celery/issues/2005 mentions something about heartbeats using those queues too, which we would have to disable using:
http://docs.celeryproject.org/en/latest/reference/celery.bin.worker.html?highlight=heartbeat#cmdoption-celery-worker--without-heartbeat