Closed Bug 1076778 Opened 10 years ago Closed 10 years ago

Use a gevent worker for pushlog ingestion

Categories

(Tree Management :: Treeherder, defect, P1)

Product:
Tree Management
Component:
Treeherder
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: mdoglio, Assigned: mdoglio)

References

Details

Attachments

(2 files)

New relic stats for fetch_hg_pushlog
127 bytes, text/plain
Details
Github PR #236 on treeherder-service
54 bytes, text/x-github-pull-request
Details | Review
A celery worker can use a prefork model or an async model . the first one is usually better for cpu bound tasks while the second one is usually better for i/o bound tasks. We are currently using the first model for everything other than the log parser. According to new relic the fetch hg pushlog task is spending 95% of the time on the request to hg.m.o on average, so it would be a good idea to test in on dev and see how it performs.
Blocks: 1076750
Priority: -- → P1
Assignee: nobody → mdoglio
Status: NEW → ASSIGNED
Attachment #8498891 - Flags: review?(jeads)
Blocks: 1076774
Commits pushed to master at https://github.com/mozilla/treeherder-service https://github.com/mozilla/treeherder-service/commit/cfa29aaa656cdeed4602170ca1a1527a713c8ed4 Bug 1076778 - Use a gevent worker for pushlog ingestion https://github.com/mozilla/treeherder-service/commit/893d89ce845ea5fecdd52d39ba6c885ed31142de Merge pull request #236 from mozilla/bug-1076778-use-gevent-for-pushlog Bug 1076778 - Use a gevent worker for pushlog ingestion
Status: ASSIGNED → RESOLVED
Closed: 10 years ago
Resolution: --- → FIXED
Attachment #8498891 - Flags: review?(jeads)
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: