1756956 - Beta 98 Performance changes when we unset EARLY_BETA_OR_EARLIER

Status: RESOLVED FIXED

(Testing :: Performance, defect, P2)

Description

[Acasandrei Beatrice (needinfo me)]

== Change summary for alert #33355 (as of Tue, 22 Feb 2022 18:54:37 GMT) ==

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)
7%	Base Content Explicit	linux1804-64-shippable-qr		7,479,792.00 -> 6,928,538.67
7%	Base Content Explicit	windows10-64-2004-shippable-qr		8,328,754.78 -> 7,722,138.67

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=33355

Comment 1

[Alex Finder|PTO, returning Feb 17th]

== Change summary for alert #33356 (as of Tue, 22 Feb 2022 19:01:20 GMT) ==

Regressions:

Ratio	Test	Platform	Options	Absolute values (old vs new)
22%	espn fcp	android-hw-g5-7-0-arm7-shippable-qr	warm webrender	1,160.54 -> 1,415.83
22%	espn fnbpaint	android-hw-g5-7-0-arm7-shippable-qr	warm webrender	1,179.63 -> 1,438.46
20%	espn FirstVisualChange	android-hw-g5-7-0-arm7-shippable-qr	warm webrender	1,241.39 -> 1,488.42

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)
10%	wikipedia fcp	linux1804-64-shippable-qr	fission warm webrender	124.72 -> 111.67
8%	wikipedia fcp	macosx1015-64-shippable-qr	fission warm webrender	89.67 -> 82.29
7%	amazon fcp	linux1804-64-shippable-qr	fission warm webrender	234.52 -> 217.58
7%	amazon fnbpaint	linux1804-64-shippable-qr	fission warm webrender	285.22 -> 266.38
6%	amazon dcf	linux1804-64-shippable-qr	fission warm webrender	292.85 -> 273.88
...	...	...	...	...
2%	twitch dcf	macosx1015-64-shippable-qr	cold fission webrender	531.90 -> 521.25

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=33356

Comment 2

[Alexandru Ionescu (needinfo me) [:alexandrui]]

== Change summary for alert #33371 (as of Wed, 23 Feb 2022 07:19:43 GMT) ==

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)
11%	amazon PerceptualSpeedIndex	linux1804-64-shippable-qr	fission warm webrender	335.58 -> 298.33
11%	amazon FirstVisualChange	linux1804-64-shippable-qr	fission warm webrender	318.26 -> 283.33
11%	amazon ContentfulSpeedIndex	linux1804-64-shippable-qr	fission warm webrender	339.25 -> 302.25
10%	amazon SpeedIndex	linux1804-64-shippable-qr	fission warm webrender	330.65 -> 298.50
6%	reddit fcp	windows10-64-shippable-qr	fission warm webrender	243.80 -> 228.33
...	...	...	...	...
2%	espn fcp	android-hw-p2-8-0-android-aarch64-shippable-qr	warm webrender	479.65 -> 469.96

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=33371

Comment 3

[Alex Finder|PTO, returning Feb 17th]

== Change summary for alert #33357 (as of Tue, 22 Feb 2022 19:01:41 GMT) ==

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)
18%	perf_reftest_singletons style-sharing.html	macosx1015-64-shippable-qr	e10s fission stylo webrender	3.91 -> 3.20
17%	perf_reftest_singletons style-sharing.html	windows10-64-shippable-qr	e10s fission stylo webrender	4.55 -> 3.76
16%	perf_reftest_singletons style-sharing-style-attr.html	windows10-64-shippable-qr	e10s fission stylo webrender	4.61 -> 3.89
15%	perf_reftest_singletons style-sharing-style-attr.html	linux1804-64-shippable-qr	e10s fission stylo webrender	5.19 -> 4.43
13%	perf_reftest_singletons style-sharing.html	linux1804-64-shippable-qr	e10s fission stylo webrender	5.22 -> 4.52
...	...	...	...	...
3%	tart	macosx1015-64-shippable-qr	e10s fission stylo webrender-sw	1.97 -> 1.91

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=33357

Comment 4

[Alexandru Ionescu (needinfo me) [:alexandrui]]

== Change summary for alert #33647 (as of Fri, 25 Mar 2022 20:58:13 GMT) ==

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)
3%	espn LastVisualChange	android-hw-g5-7-0-arm7-shippable-qr	warm webrender	6,116.46 -> 5,948.17

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=33647