1751696 - Beta 97 Performance changes when we unset EARLY_BETA_OR_EARLIER

Status: RESOLVED FIXED

(Testing :: Performance, defect, P2)

Description

[Andrej (:aglavic)]

== Change summary for alert #33040 (as of Mon, 24 Jan 2022 01:45:11 GMT) ==

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)
9%	Base Content Explicit	macosx1015-64-shippable-qr		8,196,762.67 -> 7,470,234.67
8%	Base Content Explicit	linux1804-64-shippable-qr		7,486,277.33 -> 6,888,773.33
7%	Base Content Explicit	windows10-64-2004-shippable-qr		8,315,888.00 -> 7,767,024.00

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=33040

Comment 1

[Alex Finder]

== Change summary for alert #33096 (as of Wed, 26 Jan 2022 14:51:08 GMT) ==

Regressions:

Ratio	Test	Platform	Options	Absolute values (old vs new)
30%	espn fcp	android-hw-g5-7-0-arm7-shippable-qr	warm webrender	1,095.12 -> 1,419.04
29%	espn fnbpaint	android-hw-g5-7-0-arm7-shippable-qr	warm webrender	1,115.67 -> 1,440.12

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)
6%	amazon fnbpaint	linux1804-64-shippable-qr	warm webrender	278.75 -> 261.17
6%	amazon dcf	linux1804-64-shippable-qr	warm webrender	286.48 -> 268.67
6%	amazon fnbpaint	macosx1015-64-shippable-qr	fission warm webrender	211.96 -> 199.33
6%	amazon dcf	macosx1015-64-shippable-qr	fission warm webrender	217.88 -> 205.04
6%	buzzfeed fcp	macosx1015-64-shippable-qr	warm webrender	340.96 -> 321.62
...	...	...	...	...
2%	youtube-watch PerceptualSpeedIndex	android-hw-g5-7-0-arm7-shippable-qr	warm webrender	644.27 -> 631.33

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=33096

Comment 2

[Alex Finder]

== Change summary for alert #33097 (as of Wed, 26 Jan 2022 14:53:40 GMT) ==

Improvements:

Ratio	Test	Platform	Options	Absolute values (old vs new)
19%	perf_reftest_singletons style-sharing.html	macosx1015-64-shippable-qr	e10s fission stylo webrender	3.98 -> 3.22
19%	perf_reftest_singletons style-sharing.html	macosx1015-64-shippable-qr	e10s stylo webrender	3.99 -> 3.24
19%	perf_reftest_singletons style-sharing-style-attr.html	macosx1015-64-shippable-qr	e10s fission stylo webrender	4.01 -> 3.26
19%	perf_reftest_singletons style-sharing-style-attr.html	macosx1015-64-shippable-qr	e10s stylo webrender	4.06 -> 3.31
18%	perf_reftest_singletons style-sharing.html	windows10-64-2004-shippable-qr	e10s fission stylo webrender	4.63 -> 3.78
...	...	...	...	...
2%	startup_about_home_paint	windows10-64-shippable-qr	e10s stylo webrender-sw	566.83 -> 554.67

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=33097