Open Bug 1330783 Opened 7 years ago Updated 5 years ago

The fetch-bugs task takes 9 mins and makes 57,000 MySQL requests

Categories

(Tree Management :: Treeherder: Data Ingestion, defect, P3)

Product:
Tree Management
Component:
Treeherder: Data Ingestion
Type:
defect

Tracking

(Not tracked)

People

(Reporter: emorley, Unassigned)

References

Details

Task takes 440 seconds on average, and makes:

23 requests to the Bugzilla API, which take 45% of the profile.

Plus the following MySQL requests (which take ~43% of the profile):

MySQL commit: 11500
MySQL bugscache select: 11500
MySQL bugscache update: 11400

Example:
https://rpm.newrelic.com/accounts/677903/applications/14179733/transactions#id=5b224f746865725472616e73616374696f6e2f43656c6572792f66657463682d62756773222c22225d&sort_by=slowest
The fetch-bugs task is now regularly timing out completely, and so hitting bug 1308549:
https://papertrailapp.com/systems/treeherder-prod/events?q=program%3Aapp%2Fworker_default.1&focus=766441015329591373
Priority: P2 → P1
Assignee: nobody → emorley
Assignee: emorley → nobody
Priority: P1 → P2
Summary: The fetch-bugs task takes 7 mins and makes 34,000 MySQL requests → The fetch-bugs task takes 9 mins and makes 57,000 MySQL requests
Priority: P2 → P3
You need to log in before you can comment on or make changes to this bug.