1899324 - 6.65 - 5.71% perf_reftest style-attr-1.html / perf_reftest style-attr-1.html + 1 more (OSX) regression on Wed May 15 2024

Status: RESOLVED WONTFIX

(Firefox Build System :: Toolchains, defect)

Description

[Andrej (:aglavic)]

Perfherder has detected a talos performance baseline adjustment from push updating infrastructure c6dd0210975b42f6a4d9e08b8047cf1e4f13ffe5. As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

Ratio	Test	Platform	Options	Absolute values (old vs new)
7%	perf_reftest style-attr-1.html	macosx1015-64-shippable-qr	e10s fission stylo webrender-sw	3.41 -> 3.64
6%	perf_reftest style-attr-1.html	macosx1015-64-shippable-qr	e10s fission stylo webrender-sw	3.43 -> 3.64
6%	perf_reftest style-attr-1.html	macosx1015-64-shippable-qr	e10s fission stylo webrender	3.43 -> 3.63

Details of the alert can be found in the alert summary, including links to graphs and comparisons for each of the affected tests. Please follow our guide to handling regression bugs and let us know your plans within 3 business days, or the patch(es) may be backed out in accordance with our regression policy.

If you need the profiling jobs you can trigger them yourself from treeherder job view or ask a sheriff to do that for you.

You can run these tests on try with ./mach try perf --alert 436

For more information on performance sheriffing please see our FAQ.

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1878764

Comment 2

[Mike Hommey [:glandium]]

Is it really only macosx1015-64-shippable-qr only or are there other platforms?

Comment 3

[Mike Hommey [:glandium]]

Answering my own question: it looks like it's mac only.

It also looks like the difference might be coming from matches_complex_selector_internal.

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1878764

Comment 5

[Ryan VanderMeulen [:RyanVM]]

Hi Mike, any news on this?

Comment 6

[Mike Hommey [:glandium]]

Still trying to figure out what to do about it.

Comment 7

[Mike Hommey [:glandium]]

It turns out bug 1899272 + bug 1900623 changed the baseline, and reverting bug 1878764 and bug 1849075 doesn't affect the results anymore. Let's call it wontfix. See bug 1900623 comment 8 and following.