1568164 - 48.37 - 53.16% raptor-tp6-wikipedia-firefox /fcp/ loadtime (windows10-64-shippable, windows10-64-shippable-qr, windows7-32-shippable) regression on push ad5e0980c2731978f159e17622d6ba0aa1c05ea5 (Sun July 21 2019)

Status: RESOLVED INVALID

(Infrastructure & Operations :: RelOps: Posix OS, defect)

Description

[Florin Strugariu [:Bebe]]

Raptor has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/autoland/pushloghtml?fromchange=5b21e285d546b38bbdae18c075c079f4b56350a7&tochange=ad5e0980c2731978f159e17622d6ba0aa1c05ea5

== Change summary for alert #22039 (as of Mon, 22 Jul 2019 06:55:59 GMT) ==

Regressions:

53% raptor-tp6-wikipedia-firefox windows7-32-shippable opt 540.49 -> 827.83
52% raptor-tp6-wikipedia-firefox loadtime windows7-32-shippable opt 548.12 -> 834.75
52% raptor-tp6-wikipedia-firefox fcp windows7-32-shippable opt 548.50 -> 833.88
51% raptor-tp6-wikipedia-firefox windows10-64-shippable opt 528.76 -> 795.97
50% raptor-tp6-wikipedia-firefox loadtime windows10-64-shippable opt 532.50 -> 799.33
50% raptor-tp6-wikipedia-firefox loadtime windows10-64-shippable-qr opt 539.67 -> 808.33
50% raptor-tp6-wikipedia-firefox fcp windows10-64-shippable opt 536.00 -> 801.79
50% raptor-tp6-wikipedia-firefox windows10-64-shippable-qr opt 538.22 -> 805.13
48% raptor-tp6-wikipedia-firefox fcp windows10-64-shippable-qr opt 547.17 -> 811.83

Improvements:

35% raptor-tp6-wikipedia-firefox loadtime linux64-shippable opt 631.42 -> 407.62
35% raptor-tp6-wikipedia-firefox linux64-shippable opt 620.77 -> 403.27
34% raptor-tp6-wikipedia-firefox fcp linux64-shippable opt 626.46 -> 410.88
34% raptor-tp6-wikipedia-firefox fcp linux64-shippable-qr opt 665.75 -> 438.04
34% raptor-tp6-wikipedia-firefox linux64-shippable-qr opt 657.35 -> 432.67
33% raptor-tp6-wikipedia-firefox loadtime linux64-shippable-qr opt 665.75 -> 446.21

For up to date results, see: https://treeherder.mozilla.org/perf.html#/alerts?id=22039

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a Treeherder page showing the Raptor jobs in a pushlog format.

To learn more about the regressing test(s) or reproducing them, please see: https://wiki.mozilla.org/Performance_sheriffing/Raptor

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/Performance_sheriffing/Talos/RegressionBugsHandling

Comment 1

[Florin Strugariu [:Bebe]]

Bug not related with this commit