1572716 - Re record outlook and wikipedia destop tests

Status: RESOLVED FIXED

(Testing :: Raptor, defect, P1)

Description

[Florin Strugariu [:Bebe]]

These tests do not respect the pattern we use to generate zip files.

Comment 1

[Florin Strugariu [:Bebe]]

Attachment: Bug 1572716 Re record outlook and wikipedia destop tests

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/4c86b78c1ce2
Re record outlook and wikipedia destop tests r=perftest-reviewers,sparky

Comment 3

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/4c86b78c1ce2

Comment 4

[Florin Strugariu [:Bebe]]

== Change summary for alert #22410 (as of Mon, 12 Aug 2019 05:29:46 GMT) ==

Regressions:

82% raptor-tp6-outlook-firefox windows10-64-shippable-qr opt 209.78 -> 381.95
81% raptor-tp6-outlook-firefox windows10-64-shippable opt 251.09 -> 454.97
76% raptor-tp6-outlook-firefox macosx1014-64-shippable opt 496.66 -> 872.07
59% raptor-tp6-outlook-firefox linux64-shippable opt 179.63 -> 286.03
58% raptor-tp6-outlook-firefox windows7-32-shippable opt 193.07 -> 305.55
29% raptor-tp6-wikipedia-firefox fcp macosx1014-64-shippable opt 695.50 -> 898.58
27% raptor-tp6-wikipedia-firefox macosx1014-64-shippable opt 693.34 -> 881.90
27% raptor-tp6-wikipedia-firefox loadtime macosx1014-64-shippable opt 697.29 -> 886.67
26% raptor-tp6-wikipedia-firefox macosx1014-64-shippable opt 697.57 -> 880.06
18% raptor-tp6-wikipedia-firefox linux64-shippable opt 459.06 -> 543.03
17% raptor-tp6-wikipedia-firefox fcp linux64-shippable opt 467.29 -> 548.08
17% raptor-tp6-wikipedia-firefox loadtime linux64-shippable opt 462.73 -> 540.08
16% raptor-tp6-wikipedia-firefox linux64-shippable-qr opt 482.43 -> 561.56
16% raptor-tp6-wikipedia-firefox fcp linux64-shippable-qr opt 488.60 -> 567.00
15% raptor-tp6-wikipedia-firefox windows7-32-shippable opt 802.38 -> 920.68
14% raptor-tp6-wikipedia-firefox loadtime linux64-shippable-qr opt 490.38 -> 561.00
14% raptor-tp6-wikipedia-firefox fcp windows7-32-shippable opt 806.58 -> 917.79
13% raptor-tp6-wikipedia-firefox loadtime windows7-32-shippable opt 805.98 -> 911.12
9% raptor-tp6-wikipedia-firefox fcp windows10-64-shippable opt 815.42 -> 889.46
9% raptor-tp6-wikipedia-firefox windows10-64-shippable opt 812.52 -> 884.46
8% raptor-tp6-wikipedia-firefox loadtime windows10-64-shippable opt 809.52 -> 876.17

For up to date results, see: https://treeherder.mozilla.org/perf.html#/alerts?id=22410

Comment 5

[Florin Strugariu [:Bebe]]

Alerts that where caused by this bug:

== Change summary for alert #22303 (as of Tue, 06 Aug 2019 15:16:02 GMT) ==

Improvements:

31% raptor-tp6-wikipedia-firefox fcp macosx1014-64-shippable opt 1,025.46 -> 705.83
31% raptor-tp6-wikipedia-firefox loadtime macosx1014-64-shippable opt 1,027.54 -> 708.12
31% raptor-tp6-wikipedia-firefox macosx1014-64-shippable opt 1,025.31 -> 709.59
26% raptor-tp6-wikipedia-firefox loadtime linux64-shippable opt 594.83 -> 441.54
26% raptor-tp6-wikipedia-firefox linux64-shippable opt 585.10 -> 434.76
25% raptor-tp6-wikipedia-firefox fcp linux64-shippable opt 590.50 -> 440.00
25% raptor-tp6-wikipedia-firefox linux64-shippable-qr opt 622.56 -> 464.54
25% raptor-tp6-wikipedia-firefox fcp linux64-shippable-qr opt 629.42 -> 470.33
25% raptor-tp6-wikipedia-firefox loadtime linux64-shippable-qr opt 632.96 -> 474.54

For up to date results, see: https://treeherder.mozilla.org/perf.html#/alerts?id=22303