Closed Bug 1287489 Opened 8 years ago Closed 8 years ago

Reduce memory consumption of buildapi and pushlog tasks

Categories

(Tree Management :: Treeherder: Data Ingestion, defect, P3)

Product:
Tree Management
Component:
Treeherder: Data Ingestion
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 1312007

People

(Reporter: emorley, Unassigned)

References

Details

The memory consumption of the pughlog and buildapi ingestion tasks seems to have increased after bug 1280913 / bug 1281056 - to the point where on Heroku I had to switch from a P1 to a P2 dyno type (bug 1277304 comment 12). There's probably some simple tweaks we can make to reduce this (and also perform some further cleanup from now not needing to use the TreeherderClient). (A P1 dyno has 512MB RAM and costs $25/month, a P2 1024MB RAM $50/month, so not worth spending too long fwiw.)
Ah so when we were still submitting resultsets/jobs using the API, the datasource connections (and this the leaks) were happening on the webheads, whereas after they were on the workers. -> this is the datasource leak.
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → DUPLICATE
You need to log in before you can comment on or make changes to this bug.