1674963 - 5.48 - 28.14% perf_reftest_singletons (linux64-shippable-qr, macosx1014-64-shippable, windows10-64-shippable, windows10-64-shippable-qr, windows7-32-shippable) regression on push c061dfcf1598aece0fe343783b351d0a280bf67d (Wed October 21 2020)

Status: RESOLVED DUPLICATE of bug 1672610

(Firefox Build System :: Toolchains, defect)

Description

[Alexandru Ionescu (needinfo me) [:alexandrui]]

Perfherder has detected a talos performance regression from push c061dfcf1598aece0fe343783b351d0a280bf67d. As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

Ratio	Suite	Test	Platform	Options	Absolute values (old vs new)
28%	perf_reftest_singletons	bloom-basic-2.html	windows7-32-shippable	e10s stylo	53.13 -> 68.08
28%	perf_reftest_singletons	bloom-basic-2.html	windows10-64-shippable	e10s stylo	40.04 -> 51.20
27%	perf_reftest_singletons	bloom-basic.html	windows10-64-shippable	e10s stylo	39.85 -> 50.79
27%	perf_reftest_singletons	bloom-basic-2.html	windows10-64-shippable-qr	e10s stylo	39.68 -> 50.54
27%	perf_reftest_singletons	bloom-basic.html	windows7-32-shippable	e10s stylo	53.30 -> 67.61
26%	perf_reftest_singletons	bloom-basic-2.html	macosx1014-64-shippable	e10s stylo	75.44 -> 94.76
26%	perf_reftest_singletons	bloom-basic.html	windows10-64-shippable-qr	e10s stylo	40.01 -> 50.26
26%	perf_reftest_singletons	bloom-basic.html	macosx1014-64-shippable	e10s stylo	75.14 -> 94.34
22%	perf_reftest_singletons	bloom-basic.html	linux64-shippable-qr	e10s stylo	40.67 -> 49.82
20%	perf_reftest_singletons	bloom-basic-2.html	linux64-shippable-qr	e10s stylo	40.84 -> 49.19
18%	perf_reftest_singletons	bloom-basic.html	windows10-64-shippable-qr	e10s stylo	42.86 -> 50.45
5%	perf_reftest_singletons	attr-selector-1.html	windows10-64-shippable-qr	e10s stylo	228.92 -> 241.46

Improvements:

Ratio	Suite	Test	Platform	Options	Absolute values (old vs new)
15%	perf_reftest	some-descendants-1.html	windows7-32-shippable	e10s stylo	4.07 -> 3.47
13%	perf_reftest	some-descendants-1.html	windows10-64-shippable	e10s stylo	6.38 -> 5.57
12%	perf_reftest_singletons	nth-index-2.html	windows7-32-shippable	e10s stylo	2.58 -> 2.27
12%	perf_reftest_singletons	parent-basic-singleton.html	macosx1014-64-shippable	e10s stylo	188.90 -> 167.08
10%	perf_reftest_singletons	tiny-traversal-singleton.html	macosx1014-64-shippable	e10s stylo	828.85 -> 744.10
10%	perf_reftest_singletons	tiny-traversal-singleton.html	windows7-32-shippable	e10s stylo	797.57 -> 717.42
9%	perf_reftest_singletons	tiny-traversal-singleton.html	windows10-64-shippable-qr	e10s stylo	847.61 -> 767.36
9%	perf_reftest	some-descendants-1.html	linux64-shippable	e10s stylo	6.33 -> 5.74
9%	perf_reftest	some-descendants-1.html	windows10-64-shippable-qr	e10s stylo	6.47 -> 5.89
9%	perf_reftest_singletons	tiny-traversal-singleton.html	windows10-64-shippable	e10s stylo	818.14 -> 747.89
7%	perf_reftest_singletons	parent-basic-singleton.html	linux64-shippable-qr	e10s stylo	87.77 -> 81.68
7%	perf_reftest_singletons	parent-basic-singleton.html	windows10-64-shippable	e10s stylo	90.93 -> 84.75
7%	perf_reftest_singletons	parent-basic-singleton.html	windows10-64-shippable-qr	e10s stylo	90.04 -> 84.03
7%	perf_reftest_singletons	tiny-traversal-singleton.html	windows10-64-shippable-qr	e10s stylo	825.88 -> 771.53
7%	perf_reftest_singletons	coalesce-2.html	linux64-shippable-qr	e10s stylo	141.26 -> 132.08
6%	perf_reftest_singletons	coalesce-2.html	windows7-32-shippable	e10s stylo	137.07 -> 128.32
6%	perf_reftest_singletons	coalesce-2.html	macosx1014-64-shippable	e10s stylo	221.24 -> 207.37
6%	perf_reftest	some-descendants-1.html	macosx1014-64-shippable	e10s stylo	8.11 -> 7.60
6%	perf_reftest_singletons	coalesce-2.html	windows10-64-shippable	e10s stylo	149.83 -> 140.56
6%	perf_reftest_singletons	id-getter-2.html	windows10-64-shippable-qr	e10s stylo	790.56 -> 745.93
5%	perf_reftest_singletons	coalesce-2.html	windows10-64-shippable-qr	e10s stylo	153.38 -> 145.03
5%	perf_reftest_singletons	id-getter-2.html	linux64-shippable-qr	e10s stylo	712.94 -> 675.79
5%	perf_reftest_singletons	coalesce-1.html	windows10-64-shippable	e10s stylo	189.15 -> 179.42
5%	perf_reftest_singletons	coalesce-1.html	windows7-32-shippable	e10s stylo	173.87 -> 165.09
5%	perf_reftest_singletons	coalesce-1.html	linux64-shippable-qr	e10s stylo	174.33 -> 165.55
5%	perf_reftest_singletons	coalesce-1.html	windows10-64-shippable-qr	e10s stylo	194.49 -> 184.74

Details of the alert can be found in the alert summary, including links to graphs and comparisons for each of the affected tests. Please follow our guide to handling regression bugs and let us know your plans within 3 business days, or the offending patch(es) will be backed out in accordance with our regression policy.

For more information on performance sheriffing please see our FAQ.

Comment 1

[Mike Hommey [:glandium]]

Same as bug 1672610 comment 2