1611893 - 4.63 - 9.6% raptor-tp6-pinterest-firefox-cold loadtime / raptor-tp6-tumblr-firefox-cold loadtime (windows10-64-shippable, windows10-64-shippable-qr, windows7-32-shippable) regression on push 2b4b92c1f316b05824106e91f9ddccf21d3bf28d (Tue January 21 2020)

Status: RESOLVED WORKSFORME

(Firefox Build System :: Task Configuration, defect)

Description

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Raptor has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=2b4b92c1f316b05824106e91f9ddccf21d3bf28d

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

10% raptor-tp6-tumblr-firefox-cold loadtime windows10-64-shippable opt 1,641.58 -> 1,799.25
8% raptor-tp6-tumblr-firefox-cold loadtime windows7-32-shippable opt 1,794.96 -> 1,946.25
7% raptor-tp6-tumblr-firefox-cold loadtime windows10-64-shippable-qr opt 1,636.88 -> 1,744.08
5% raptor-tp6-pinterest-firefox-cold loadtime windows10-64-shippable-qr opt 1,817.42 -> 1,914.67
5% raptor-tp6-tumblr-firefox-cold loadtime windows7-32-shippable opt 1,860.42 -> 1,955.67
5% raptor-tp6-pinterest-firefox-cold loadtime windows10-64-shippable opt 1,828.58 -> 1,913.25

You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=24810

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a Treeherder page showing the Raptor jobs in a pushlog format.

To learn more about the regressing test(s) or reproducing them, please see: https://wiki.mozilla.org/TestEngineering/Performance/Raptor

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/TestEngineering/Performance/Talos/RegressionBugsHandling

Comment 1

[Andrew Halberstadt [:ahal]]

This is almost certainly not related to that change. That push shouldn't have any impact on either Firefox or raptor.