Coalescer needs a threshold setting

RESOLVED FIXED

Status

RESOLVED FIXED
3 years ago
a year ago

People

(Reporter: dividehex, Assigned: dividehex)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Assignee)

Description

3 years ago
The coalescer app needs a threshold setting so we don't coalesce on all task queues greater than one.  This should be probably be dynamically set via the api as opposed to a ENV setting.  All logic should be contained to the coalescer service and not within the worker.  One idea is to return an list with only the calling taskid if queue size is below current threshold and return the entire actual taskid list if equal to or above the threshold
I tend to think that the threshold should be a combination: queue length > N && oldest task age > M.  Then even if we dump 100 tasks in with the same key within a short time, if we have the capacity to start them all immediately, we can avoid coalescing.
(Assignee)

Updated

3 years ago
Depends on: 1213039
(Assignee)

Updated

3 years ago
Blocks: 1213039
No longer depends on: 1213039
(Assignee)

Comment 2

2 years ago
Pending the review and merge of https://github.com/mozilla/tc-coalesce/pull/12, this will be complete.
(Assignee)

Updated

2 years ago
Status: NEW → RESOLVED
Last Resolved: 2 years ago
Resolution: --- → FIXED
Component: Tools → General
Product: Release Engineering → Release Engineering
You need to log in before you can comment on or make changes to this bug.