1738360 - Upgrade imgur page load test to mitm7

Status: RESOLVED FIXED

(Testing :: Raptor, task, P1)

Description

[Andrej (:aglavic)]

Kimberly told me that there were a few non-login page loads that are using mitm5 that should be upgraded to mitm6, this is one such test.
https://mozilla-hub.atlassian.net/browse/FXP-1841

Comment 1

[Andrej (:aglavic)]

Attachment: Bug 1738360 Upgrade imgur page load test to mitm7 r?#perftest

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/9424ba1be92c
Upgrade imgur page load test to mitm7 r=perftest-reviewers,AlexandruIonescu,kimberlythegeek

Comment 4

[Cristian Tuns]

https://hg.mozilla.org/mozilla-central/rev/9424ba1be92c

Comment 5

[Alex Finder|PTO, back on Nov 25th]

== Change summary for alert #32985 (as of Wed, 19 Jan 2022 09:15:12 GMT) ==

Regressions:

Ratio	Test	Platform	Options	Absolute values (old vs new)
434%	imgur fcp	macosx1015-64-shippable-qr	fission warm webrender	75.04 -> 400.83
381%	imgur fcp	windows10-64-shippable-qr	fission warm webrender	95.71 -> 460.71
181%	imgur LastVisualChange	windows10-64-shippable-qr	fission warm webrender	1,092.08 -> 3,064.00
149%	imgur LastVisualChange	windows10-64-shippable-qr	cold fission webrender	2,852.75 -> 7,091.67
128%	imgur LastVisualChange	macosx1015-64-shippable-qr	fission warm webrender	1,336.67 -> 3,053.33
101%	imgur LastVisualChange	macosx1015-64-shippable-qr	cold fission webrender	3,400.00 -> 6,843.33
33%	imgur dcf	macosx1015-64-shippable-qr	fission warm webrender	196.50 -> 260.58
27%	imgur ContentfulSpeedIndex	windows10-64-shippable-qr	fission warm webrender	396.62 -> 504.75
25%	imgur fcp	windows10-64-shippable-qr	cold fission webrender	581.46 -> 724.50
19%	imgur dcf	windows10-64-shippable-qr	fission warm webrender	256.71 -> 305.46
18%	imgur ContentfulSpeedIndex	linux1804-64-shippable-qr	fission warm webrender	381.89 -> 452.38

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)
73%	imgur fnbpaint	macosx1015-64-shippable-qr	cold fission webrender	706.12 -> 189.71
70%	imgur SpeedIndex	macosx1015-64-shippable-qr	cold fission webrender	2,611.42 -> 786.08
66%	imgur PerceptualSpeedIndex	macosx1015-64-shippable-qr	cold fission webrender	2,424.17 -> 833.42
65%	imgur PerceptualSpeedIndex	macosx1015-64-shippable-qr	fission warm webrender	866.50 -> 301.58
62%	imgur SpeedIndex	macosx1015-64-shippable-qr	fission warm webrender	930.50 -> 350.42
...	...	...	...	...
17%	imgur ContentfulSpeedIndex	macosx1015-64-shippable-qr	fission warm webrender	437.17 -> 361.50

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=32985