1518780 - Move the seta-analyze-failures celery beat task to Heroku scheduler

Status: RESOLVED INVALID

(Tree Management Graveyard :: Treeherder: SETA, enhancement, P3)

Description

[Ed Morley [:emorley]]

(Split out of bug 1176492)

Currently the seta-analyze-failures task is run every 1 day using a celery beat task. However for the reasons in bug 1176492 comment 0 we're trying to move away from these.

To achieve this we'll have to:

• add a Django management command for running the task (if it doesn't already exist), making sure to add it to the annotation list in newrelic.ini too
• remove the task from CELERYBEAT_SCHEDULE in treeherder/config/settings.py (along with its queues under CELERY_QUEUES), and from Procfile + the scripts under bin/
• add a new scheduler addon entry using Heroku's web UI to each of prototype/stage/prod, making sure to prefix the command run with the new relic admin wrapper (see other such scheduler commands for examples), and pick an appropriate dyno size
• check the papertrail logs to ensure the command runs successfully (eg doesn't run out of memory on the chosen dyno size), using eg:
  • https://papertrailapp.com/systems/treeherder-prototype/events?q=program%3Ascheduler
  • https://papertrailapp.com/systems/treeherder-stage/events?q=program%3Ascheduler
  • https://papertrailapp.com/systems/treeherder-prod/events?q=program%3Ascheduler

For an example of the in-repo changes required, see:
https://github.com/mozilla/treeherder/pull/4300

Comment 1

[Armen [:armenzg]]

We don't have CELERYBEAT_SCHEDULE