Closed Bug 1592921 Opened 1 year ago Closed 1 year ago

3.73 - 5.4% raptor-tp6-imgur-firefox / raptor-tp6-imgur-firefox fcp / raptor-tp6-imgur-firefox loadtime (linux64-shippable-qr) regression on push 1bbcb17120eb305e78bd3be7807440b8f436ee6c (Sat October 26 2019)

Categories

(Toolkit :: Video/Audio Controls, defect, P2)

defect

Tracking

()

RESOLVED WORKSFORME

People

(Reporter: Bebe, Unassigned)

References

(Blocks 1 open bug, Regression)

Details

(Keywords: perf, perf-alert, regression)

Raptor has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=1bbcb17120eb305e78bd3be7807440b8f436ee6c

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

5% raptor-tp6-imgur-firefox linux64-shippable-qr opt 291.86 -> 307.62
5% raptor-tp6-imgur-firefox fcp linux64-shippable-qr opt 281.75 -> 296.83
5% raptor-tp6-imgur-firefox linux64-shippable-qr opt 291.80 -> 306.61
4% raptor-tp6-imgur-firefox loadtime linux64-shippable-qr opt 408.56 -> 423.79

Improvements:

38% raptor-tp6m-cnn-geckoview-cold loadtime android-hw-g5-7-0-arm7-api-16 pgo 14,550.25 -> 8,994.58
10% raptor-tp6m-cnn-geckoview-cold android-hw-g5-7-0-arm7-api-16 pgo 4,624.51 -> 4,148.08

You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=23637

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a Treeherder page showing the Raptor jobs in a pushlog format.

To learn more about the regressing test(s) or reproducing them, please see: https://wiki.mozilla.org/TestEngineering/Performance/Raptor

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/TestEngineering/Performance/Talos/RegressionBugsHandling

Blocks: 1592626
Flags: needinfo?(mconley)
Regressed by: 1591227
Component: Performance → Video/Audio Controls
Product: Testing → Toolkit
Version: Version 3 → unspecified

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

The feature that was enabled is Nightly-only for now. Please do not back me out.

Blocks: 1532675
Flags: needinfo?(mconley)
Priority: -- → P2
You need to log in before you can comment on or make changes to this bug.