Closed Bug 1076778 Opened 5 years ago Closed 5 years ago

Use a gevent worker for pushlog ingestion

Categories

(Tree Management :: Treeherder, defect, P1)

defect

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: mdoglio, Assigned: mdoglio)

References

Details

Attachments

(2 files)

A celery worker can use a prefork model or an async model . the first one is usually better for cpu bound tasks while the second one is usually better for i/o bound tasks. We are currently using the first model for everything other than the log parser.
According to new relic the fetch hg pushlog task is spending 95% of the time on the request to hg.m.o on average, so it would be a good idea to test in on dev and see how it performs.
Blocks: 1076750
Priority: -- → P1
Assignee: nobody → mdoglio
Status: NEW → ASSIGNED
Attachment #8498891 - Flags: review?(jeads)
Blocks: 1076774
Commits pushed to master at https://github.com/mozilla/treeherder-service

https://github.com/mozilla/treeherder-service/commit/cfa29aaa656cdeed4602170ca1a1527a713c8ed4
Bug 1076778 - Use a gevent worker for pushlog ingestion

https://github.com/mozilla/treeherder-service/commit/893d89ce845ea5fecdd52d39ba6c885ed31142de
Merge pull request #236 from mozilla/bug-1076778-use-gevent-for-pushlog

Bug 1076778 - Use a gevent worker for pushlog ingestion
Status: ASSIGNED → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
Attachment #8498891 - Flags: review?(jeads)
You need to log in before you can comment on or make changes to this bug.