Ensure only one of each periodic celery task is run at a time

RESOLVED INCOMPLETE

Status

Tree Management
Treeherder: Data Ingestion
P2
normal
RESOLVED INCOMPLETE
3 years ago
6 months ago

People

(Reporter: emorley, Unassigned)

Tracking

Details

(Reporter)

Description

3 years ago
It doesn't make sense to have say two overlapping builds-4hr tasks, or two fetch-bugs tasks. (the pushlog ingestion might be the exception here, since there are so many repos).

This will avoid us stomping on ourselves in bug 1178240, and avoid thundering herd style performance issues if ingestion gets backlogged.

http://celery.readthedocs.org/en/latest/tutorials/task-cookbook.html#ensuring-a-task-is-only-executed-one-at-a-time
(Reporter)

Updated

3 years ago
Assignee: emorley → nobody
Blocks: 1096919
(Reporter)

Comment 1

6 months ago
Let's not worry about this for now, I doubt we hit it often.
Status: NEW → RESOLVED
Last Resolved: 6 months ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.