1959910 - 3.72% tp5o_scroll (Linux) regression on Fri April 4 2025

Status: RESOLVED WONTFIX

(Toolkit :: Telemetry, defect)

Description

[Treeherder Bug Filer]

Perfherder has detected a talos performance regression from push 73f77fc149b9477df2cfdc57debb01146d9d07a6. As author of one of the patches included in that push, we need your help to address this regression.

Please acknowledge, and begin investigating this alert within 3 business days, or the patch(es) may be backed out in accordance with our regression policy. Our guide to handling regression bugs has information about how you can proceed with this investigation.

If you have any questions or need any help with the investigation, please reach out to [e-mail]. Alternatively, you can find help on Slack by joining #perf-help, and on Matrix you can find help by joining #perftest.

Regressions:

Ratio	Test	Platform	Options	Absolute values (old vs new)
4%	tp5o_scroll	linux1804-64-shippable-qr	e10s fission stylo webrender-sw	1.44 -> 1.49

Details of the alert can be found in the alert summary, including links to graphs and comparisons for each of the affected tests.

If you need the profiling jobs you can trigger them yourself from treeherder job view or ask [e-mail] to do that for you.

You can run all of these tests on try with ./mach try perf --alert 44648

The following documentation link provides more information about this command.

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1956726

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

It has been over 7 days with no activity on this performance regression.

:florian, since you are the author of the regressor, bug 1956726, which triggered this performance alert, could you please provide a progress update?

If this regression is something that fixes a bug, changes the baseline of the regression metrics, or otherwise will not be fixed, please consider closing it as WONTFIX. See this documentation for more information on how to handle regressions.

For additional information/help, please needinfo the performance sheriff who filed this alert (they can be found in comment #0), or reach out in #perftest, or #perfsheriffs on Element.

For more information, please visit BugBot documentation.

Comment 3

[Florian Quèze [:florian]]

Closing as WONTFIX as this doesn't seem actionable.

(In reply to Treeherder Bug Filer from comment #0)

Ratio	Test	Platform	Options	Absolute values (old vs new)
4%	tp5o_scroll	linux1804-64-shippable-qr	e10s fission stylo webrender-sw	1.44 -> 1.49

Notes:

• the https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tp5o_scroll link doesn't point to the specific section, the correct link is https://firefox-source-docs.mozilla.org/testing/perfdocs/talos.html#tp5o-scroll (sparky, do you know how to get this link fixed for future alerts?)
• no link to profiles in the regression alert :-/.
• no way to estimate if a value (without unit) going from 1.44 to 1.49 for this test is something we should worry about, so I'll assume it is not a big deal.

Comment 4

[Greg Mierzwinski [:sparky]]

I've filed bugs for the first two issues. The first one is a bug, the other is a task since we don't have any extra profiler runs in Talos.
https://bugzilla.mozilla.org/show_bug.cgi?id=1964741
https://bugzilla.mozilla.org/show_bug.cgi?id=1964742

Regarding the third issue, I think it would be good to reach out to one of the test owners about that (listed on the docs page). From the docs, its the "average frames interval while scrolling the pages of the tp5o set". It's units are 1/FPS. There's a bug open to show that in the alert comment: https://bugzilla.mozilla.org/show_bug.cgi?id=1947509