Closed Bug 1196380 Opened 9 years ago Closed 7 years ago

[ETL] Some batches take forever

Categories

(Testing Graveyard :: ActiveData, defect)

Product:
Testing Graveyard
Component:
ActiveData
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED WONTFIX

People

(Reporter: ekyle, Unassigned)

Details

Some ETL jobs take too long (over 12 hours).  This means another machine may work on it in the meantime; each overwriting the results of the other, and both complaining about the resulting inconsistency.

These big results eventually error out, and left on the queue for another to work on.  Overtime, the queue is saturated with these long-running jobs consuming the resources of all machines, and preventing further ETL.

Find one of these jobs (they are still on the queue) and fix the problem.
Assignee: klahnakoski → nobody
If this is still a problem, I have not noticed for a while.
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → WONTFIX
Product: Testing → Testing Graveyard
You need to log in before you can comment on or make changes to this bug.