1562872 - Disable raptor tp6 upstream certs

Status: RESOLVED FIXED

(Testing :: Raptor, task, P1)

Description

[Florin Strugariu [:Bebe]]

Disable upstream certs when running raptor tests.
Add playback_upstream_cert = false

Comment 1

[Robert Wood [:rwood]]

Can you please add a bug description for this? Thanks :bebe!

Comment 2

[Florin Strugariu [:Bebe]]

Attachment: Bug 1562872 Disable raptor tp6 upstream certs

Depends on D36594

Comment 3

[Florin Strugariu [:Bebe]]

Done

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/6bcdd2b94604
Disable raptor tp6 upstream certs r=perftest-reviewers,sparky

Comment 5

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/6bcdd2b94604

Comment 6

[Florin Strugariu [:Bebe]]

== Change summary for alert #21735 (as of Thu, 04 Jul 2019 10:20:39 GMT) ==

Improvements:

71% raptor-tp6-microsoft-firefox loadtime macosx1014-64-shippable opt 4,960.29 -> 1,456.42
66% raptor-tp6-microsoft-firefox loadtime linux64-shippable opt 2,899.29 -> 982.17
61% raptor-tp6-microsoft-firefox loadtime linux64-shippable-qr opt 3,023.50 -> 1,177.92
61% raptor-tp6-microsoft-firefox loadtime windows7-32-shippable opt 2,795.69 -> 1,090.25
58% raptor-tp6-microsoft-firefox loadtime windows10-64-shippable opt 3,046.96 -> 1,292.96
53% raptor-tp6-apple-firefox loadtime windows10-64-shippable-qr opt 485.96 -> 227.00
52% raptor-tp6-apple-firefox loadtime windows10-64-shippable opt 494.17 -> 234.79
51% raptor-tp6-apple-firefox loadtime windows7-32-shippable opt 494.12 -> 244.58
44% raptor-tp6-apple-firefox loadtime macosx1014-64-shippable opt 606.17 -> 338.79
44% raptor-tp6-google-firefox-cold loadtime windows10-64-shippable-qr opt 848.29 -> 478.25
42% raptor-tp6-apple-firefox loadtime linux64-shippable opt 382.92 -> 223.88
40% raptor-tp6-google-firefox-cold windows10-64-shippable-qr opt 528.65 -> 316.61
40% raptor-tp6-apple-firefox loadtime linux64-shippable-qr opt 394.00 -> 236.21
39% raptor-tp6-apple-firefox macosx1014-64-shippable opt 526.74 -> 319.15
38% raptor-tp6-apple-firefox windows10-64-shippable opt 342.16 -> 211.57
38% raptor-tp6-google-firefox-cold fcp windows10-64-shippable-qr opt 472.00 -> 294.92
35% raptor-tp6-apple-firefox fcp macosx1014-64-shippable opt 501.56 -> 325.50
34% raptor-tp6-apple-firefox windows10-64-shippable-qr opt 313.77 -> 206.66
32% raptor-tp6-apple-firefox linux64-shippable opt 307.49 -> 209.14
32% raptor-tp6-facebook-firefox-cold fcp linux64-shippable opt 512.50 -> 349.50
32% raptor-tp6-apple-firefox windows7-32-shippable opt 338.75 -> 231.29
31% raptor-tp6-google-firefox-cold linux64-shippable opt 502.22 -> 344.53
31% raptor-tp6-google-firefox-cold fcp windows10-64-shippable opt 460.08 -> 318.42
29% raptor-tp6-facebook-firefox-cold fcp windows10-64-shippable-qr opt 484.79 -> 344.00
29% raptor-tp6-facebook-firefox-cold fcp linux64-shippable-qr opt 510.33 -> 363.50
27% raptor-tp6-youtube-firefox-cold linux64-shippable opt 879.69 -> 641.27
27% raptor-tp6-facebook-firefox-cold linux64-shippable-qr opt 584.22 -> 429.04
26% raptor-tp6-facebook-firefox-cold windows10-64-shippable-qr opt 563.59 -> 414.31
26% raptor-tp6-apple-firefox linux64-shippable-qr opt 306.94 -> 225.77
26% raptor-tp6-youtube-firefox-cold windows10-64-shippable opt 845.72 -> 625.16
25% raptor-tp6-youtube-firefox-cold loadtime linux64-shippable opt 1,367.08 -> 1,023.00
20% raptor-tp6-amazon-firefox-cold windows10-64-shippable opt 625.09 -> 498.70
20% raptor-tp6-youtube-firefox-cold fcp windows10-64-shippable opt 875.92 -> 700.42
19% raptor-tp6-youtube-firefox-cold fcp linux64-shippable opt 988.42 -> 801.75
18% raptor-tp6-facebook-firefox-cold fcp macosx1014-64-shippable opt 731.17 -> 598.25
18% raptor-tp6-youtube-firefox-cold macosx1014-64-shippable opt 1,237.07 -> 1,012.96
18% raptor-tp6-amazon-firefox-cold windows7-32-shippable opt 621.37 -> 509.73
16% raptor-tp6-facebook-firefox-cold macosx1014-64-shippable opt 861.48 -> 719.56
16% raptor-tp6-facebook-firefox-cold loadtime linux64-shippable-qr opt 996.33 -> 839.00
16% raptor-tp6-youtube-firefox-cold fcp macosx1014-64-shippable opt 1,265.88 -> 1,069.25
15% raptor-tp6-amazon-firefox-cold linux64-shippable opt 604.74 -> 511.19
15% raptor-tp6-facebook-firefox-cold loadtime windows10-64-shippable-qr opt 970.17 -> 824.33
15% raptor-tp6-youtube-firefox-cold loadtime macosx1014-64-shippable opt 1,982.75 -> 1,691.58
12% raptor-tp6-amazon-firefox-cold fcp windows7-32-shippable opt 484.17 -> 423.75
12% raptor-tp6-amazon-firefox-cold linux64-shippable-qr opt 672.46 -> 588.61
12% raptor-tp6-amazon-firefox-cold fcp linux64-shippable opt 465.50 -> 408.08
12% raptor-tp6-amazon-firefox-cold fcp windows10-64-shippable-qr opt 484.29 -> 426.58
11% raptor-tp6-amazon-firefox-cold fcp windows10-64-shippable opt 474.88 -> 421.75
11% raptor-tp6-amazon-firefox-cold fcp linux64-shippable-qr opt 556.92 -> 495.75
11% raptor-tp6-amazon-firefox-cold loadtime macosx1014-64-shippable opt 1,597.33 -> 1,423.00
11% raptor-tp6-amazon-firefox-cold linux64-shippable-qr opt 668.37 -> 596.41
9% raptor-tp6-amazon-firefox-cold macosx1014-64-shippable opt 1,112.88 -> 1,007.99
9% raptor-tp6-facebook-firefox-cold loadtime macosx1014-64-shippable opt 1,568.75 -> 1,422.50

For up to date results, see: https://treeherder.mozilla.org/perf.html#/alerts?id=21735