1515885 - 5.02 - 154.43% raptor-tp6-imgur-firefox / raptor-tp6-microsoft-firefox (linux64, linux64-qr, windows10-64, windows10-64-qr, windows7-32) regression on push d73d20bd962a12781eaf90c42837cd9ff7c66f90 (Thu Dec 20 2018)

Status: VERIFIED WONTFIX

(Testing :: Raptor, defect)

Description

[Florin Strugariu [:Bebe]]

Raptor has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=d73d20bd962a12781eaf90c42837cd9ff7c66f90

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

154%  raptor-tp6-microsoft-firefox linux64 pgo              531.67 -> 1,352.72
151%  raptor-tp6-microsoft-firefox windows10-64-qr opt      586.44 -> 1,471.62
137%  raptor-tp6-microsoft-firefox windows7-32 pgo          615.61 -> 1,460.58
132%  raptor-tp6-microsoft-firefox windows7-32 opt          605.63 -> 1,405.52
129%  raptor-tp6-microsoft-firefox linux64 opt              594.41 -> 1,358.94
127%  raptor-tp6-microsoft-firefox linux64-qr opt           627.65 -> 1,426.31
126%  raptor-tp6-microsoft-firefox windows10-64 pgo         543.68 -> 1,227.66
100%  raptor-tp6-microsoft-firefox windows10-64 opt         683.56 -> 1,369.68
  5%  raptor-tp6-imgur-firefox linux64 opt                  309.19 -> 325.57
  5%  raptor-tp6-imgur-firefox linux64 pgo                  287.01 -> 301.42


You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=18368

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a Treeherder page showing the Raptor jobs in a pushlog format.

To learn more about the regressing test(s) or reproducing them, please see: https://wiki.mozilla.org/Performance_sheriffing/Raptor

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/Performance_sheriffing/Talos/RegressionBugsHandling

Comment 1

[Florin Strugariu [:Bebe]]

Attachment: microsoft no patch.png

Comment 2

[Florin Strugariu [:Bebe]]

Attachment: microsoft-patch.png

Comment 3

[Florin Strugariu [:Bebe]]

The Microsoft change is caused by the new mitmproxy patch
Please observe the Microsoft attachments.

I consider this a improvement.

:rwood please confirm

Comment 4

[Florin Strugariu [:Bebe]]

Attachment: imgur no patch.png

Comment 5

[Florin Strugariu [:Bebe]]

Attachment: imgur patch.png

Comment 6

[Florin Strugariu [:Bebe]]

The same for imgur

Please observe the screenshots

Comment 7

[Robert Wood [:rwood]]

Yes I agree! LGTM to accept this.