Closed Bug 444152 Opened 17 years ago Closed 17 years ago

Processors stall indefinitely when main monitor thread crashes

Categories

(Socorro :: General, task)

Product:
Socorro
Component:
General
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: morgamic, Assigned: lars)

References

Details

Processor 77 in production crashed with 195 pending jobs, leaving things queued for an indefinite amount of time as it "hung". This may be a result of bug 444150 but the cause is still unknown since a main monitor thread crash should die gracefully and not cause an unrecoverable state in any known processors. Adding bug 444150 as a dep, since it is related.
For the short-term we are reassigning all defunct jobs to another processor.
it appears that this is resolved - for some reason sometimes the Postgresql connection fails. The processors now detect a bad connection, and try to reconnect. If they cannot reconnect, the processor will die gracefully logging the CRITICAL error.
Status: NEW → RESOLVED
Closed: 17 years ago
Resolution: --- → FIXED
Component: Socorro → General
Product: Webtools → Socorro
You need to log in before you can comment on or make changes to this bug.