Bug 1441181 (bmo-cloud-jobqueue)

Implement new process model for running multiple email jobqueue daemons

RESOLVED FIXED

Status

()

enhancement
RESOLVED FIXED
a year ago
a year ago

People

(Reporter: glob, Assigned: dylan)

Tracking

Production

Firefox Tracking Flags

(Not tracked)

Details

(URL)

Attachments

(9 attachments, 2 obsolete attachments)

45 bytes, text/x-github-pull-request
dylan
: review+
Details | Review
45 bytes, text/x-github-pull-request
dylan
: review+
Details | Review
45 bytes, text/x-github-pull-request
dylan
: review+
Details | Review
45 bytes, text/x-github-pull-request
dylan
: review+
Details | Review
45 bytes, text/x-github-pull-request
dylan
: review+
Details | Review
45 bytes, text/x-github-pull-request
dylan
: review+
Details | Review
45 bytes, text/x-github-pull-request
dylan
: review+
Details | Review
45 bytes, text/x-github-pull-request
dylan
: review+
Details | Review
45 bytes, text/x-github-pull-request
dylan
: review+
Details | Review
(Reporter)

Description

a year ago
Implement new process model for running multiple email jobqueue daemons, as per ckolos's recommendations.
(Assignee)

Comment 1

a year ago
This PR removes the subprocess code that was added because of memory leaks.
It's intended to be replaced at the end of the patch series with Process::SizeLimit::Core.
(Assignee)

Comment 2

a year ago
The header in the jobqueue code is weird; this patch makes it more like more recent changes.
(Assignee)

Comment 3

a year ago
While working on this I noticed memory wasn't being freed in a predictable way. This is because the memory is cleared before each job, instead of after.
(Assignee)

Comment 4

a year ago
This re-implements the sub process code in terms of IO::Async. It doesn't yet handle memory problems but I'm going to add that in my next period of coding.
(Assignee)

Comment 5

a year ago
Posted file Step 5 - Add logging (obsolete) —
This is not strictly needed, but it wires up the TheSchwartz logging code into our logging framework.
(Assignee)

Comment 6

a year ago
Posted file Step 6 - Add concurrency (obsolete) —
(Assignee)

Updated

a year ago
Attachment #8955706 - Attachment description: Bug 1441181 - Step 6 - Add concurrency → Step 6 - Add concurrency
(Assignee)

Comment 8

a year ago
Attachment #8955706 - Attachment is obsolete: true
(Assignee)

Updated

a year ago
Attachment #8958290 - Attachment description: PR → Step 8 - Add jobqueue command to entrypoint
(Assignee)

Updated

a year ago
Attachment #8955591 - Flags: review+
(Assignee)

Updated

a year ago
Attachment #8955593 - Flags: review+
(Assignee)

Updated

a year ago
Attachment #8955594 - Flags: review+
(Assignee)

Updated

a year ago
Attachment #8955707 - Flags: review+
(Assignee)

Updated

a year ago
Attachment #8955602 - Attachment is obsolete: true
(Assignee)

Updated

a year ago
Attachment #8955706 - Attachment is obsolete: false
(Assignee)

Updated

a year ago
Attachment #8957333 - Flags: review+
(Assignee)

Updated

a year ago
Attachment #8955601 - Flags: review+
(Assignee)

Updated

a year ago
Attachment #8955706 - Attachment is obsolete: true
(Assignee)

Updated

a year ago
Attachment #8958290 - Flags: review+
(Assignee)

Updated

a year ago
Attachment #8958513 - Flags: review+
(Assignee)

Updated

a year ago
Status: NEW → RESOLVED
Last Resolved: a year ago
Resolution: --- → FIXED
(Assignee)

Updated

a year ago
Attachment #8958514 - Attachment description: Bug 1441181 - Step 6 - Add concurrency → Step 6 - Add concurrency
You need to log in before you can comment on or make changes to this bug.