1562137 - 12.39 - 50.54% raptor-tp6-yandex-firefox / raptor-tp6-yandex-firefox fcp (linux64-shippable, macosx1014-64-shippable, windows10-64-shippable-qr) regression on push 0b8f1947271e2efed2ed9e84e0ff20cac3606977 (Wed June 26 2019)

Status: RESOLVED WONTFIX

(Testing :: Raptor, defect, P1)

Description

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Raptor has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=0b8f1947271e2efed2ed9e84e0ff20cac3606977

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

51% raptor-tp6-yandex-firefox windows10-64-shippable-qr opt 90.91 -> 136.85
25% raptor-tp6-yandex-firefox macosx1014-64-shippable opt 152.48 -> 191.00
18% raptor-tp6-yandex-firefox fcp macosx1014-64-shippable opt 114.58 -> 135.58
12% raptor-tp6-yandex-firefox linux64-shippable opt 115.30 -> 129.58

Improvements:

9% raptor-tp6-yandex-firefox loadtime linux64-shippable opt 227.69 -> 207.17

You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=21606

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a Treeherder page showing the Raptor jobs in a pushlog format.

To learn more about the regressing test(s) or reproducing them, please see: https://wiki.mozilla.org/Performance_sheriffing/Raptor

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/Performance_sheriffing/Talos/RegressionBugsHandling

Comment 1

[Alexandru Irimovici]

I believe we should close this as WONTFIX as this is just a test/harness update as we only did a re-recording