Closed Bug 1977839 Opened 11 months ago Closed 10 months ago

7.43 - 4.37% stylebench Descendant and child combinators/Mutating attributes - 2/Sync / stylebench Descendant and child combinators/Removing leaf elements - 4 + 6 more (Windows) regression on Tue July 15 2025

Categories

(Core :: Layout: Form Controls, defect)

defect

Tracking

()

RESOLVED FIXED
144 Branch
Tracking Status
firefox-esr128 --- unaffected
firefox-esr140 --- unaffected
firefox140 --- unaffected
firefox141 --- unaffected
firefox142 --- fixed
firefox143 --- fixed
firefox144 --- fixed

People

(Reporter: intermittent-bug-filer, Assigned: emilio)

References

(Regression)

Details

(Keywords: perf, perf-alert, regression)

Attachments

(3 files)

Perfherder has detected a browsertime performance regression from push 197645ffd8065cb1c8bc1137f804091695494284. As author of one of the patches included in that push, we need your help to address this regression.

Please acknowledge, and begin investigating this alert within 3 business days, or the patch(es) may be backed out in accordance with our regression policy. Our guide to handling regression bugs has information about how you can proceed with this investigation.

If you have any questions or need any help with the investigation, please reach out to aesanu@mozilla.com. Alternatively, you can find help on Slack by joining #perf-help, and on Matrix you can find help by joining #perftest.

Regressions:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
7% stylebench Descendant and child combinators/Mutating attributes - 2/Sync windows11-64-24h2-shippable fission webrender 2.06 -> 2.22 Before/After
7% stylebench Descendant and child combinators/Removing leaf elements - 4/Sync windows11-64-24h2-shippable fission webrender 3.59 -> 3.84 Before/After
6% stylebench Descendant and child combinators/Mutating attributes - 2/Sync windows11-64-24h2-shippable fission webrender 2.08 -> 2.22 Before/After
6% stylebench Descendant and child combinators/Removing leaf elements - 4/Sync windows11-64-24h2-shippable fission webrender 3.62 -> 3.82 Before/After
5% stylebench Descendant and child combinators/Removing leaf elements - 4 windows11-64-24h2-shippable fission webrender 4.59 -> 4.84 Before/After
5% stylebench Descendant and child combinators/Mutating attributes - 2 windows11-64-24h2-shippable fission webrender 3.06 -> 3.22 Before/After
4% stylebench Descendant and child combinators/Mutating attributes - 2 windows11-64-24h2-shippable fission webrender 3.08 -> 3.22 Before/After
4% stylebench Descendant and child combinators/Removing leaf elements - 4 windows11-64-24h2-shippable fission webrender 4.61 -> 4.82 Before/After

Details of the alert can be found in the alert summary, including links to graphs and comparisons for each of the affected tests.

If you need the profiling jobs you can trigger them yourself from treeherder job view or ask aesanu@mozilla.com to do that for you.

You can run all of these tests on try with ./mach try perf --alert 45983

The following documentation link provides more information about this command.

Flags: needinfo?(emilio)

I think bug 1977669 might've had something to do with it. Otherwise I'll start investigating / trying to make it faster. I'm guessing the button checks could be faster...

Depends on: 1977669

Set release status flags based on info from the regressing bug 1873301

WIP because it's pretty tentative, I'm not sure why this would be the
case but it's the only thing from the regressing patch that makes sense
to me?

Try: https://perf.compare/compare-lando-results?baseLando=143175&newLando=143176&baseRepo=try&newRepo=try&framework=13

Set release status flags based on info from the regressing bug 1873301

So I'm a bit confused at this regression, but I realized that, when I look at the alert summary now, there's a bunch of other stuff, including improvements in similar stylebench subtests.

So I'm a bit confused over-all, could I get a good overview of where my patch ended up performance wise? I just don't want to end up wasting a lot of time chasing stuff if the answer is "stuff just moved around", as it was a rather significant change.

Flags: needinfo?(emilio) → needinfo?(aesanu)

Hi! This graph can be an example, it's for stylebench on windows.
And this graph is for booking FirstVisualChange on android.

Does this help?

Flags: needinfo?(aesanu) → needinfo?(emilio)

Well, what I meant was: I can see my patch regressed some stylebench subtests, but looking at the alerts it also improved others in roughly the same amount, correct?

So I think that was mostly performance neutral for stylebench, and I should try to dig into the amazon/booking regressions. Would you agree with that assessment? Or am I misreading the alert page?

Flags: needinfo?(emilio) → needinfo?(aesanu)

Yes, it would be a good idea to dig into the amazon/booking regressions.

:sparky How would you interpret the stylebench performance?

Flags: needinfo?(aesanu) → needinfo?(gmierz2)

I agree with your assessment :emilio regarding ignoring stylebench and focusing on the large pageload changes. Looking at the stylebench results in perfcompare, the overall score didn't change at all: https://perf.compare/compare-results?baseRev=24935e432860eb5f2c5c2c7ffab8342dac8a1461&baseRepo=autoland&newRev=197645ffd8065cb1c8bc1137f804091695494284&newRepo=autoland&framework=13&search=stylebench

See the graph here too: https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&replicates=0&series=autoland,5259859,1,13&timerange=2592000&zoom=1752194091406,1753234218814,469.3876466349294,520.2598016944887

That said, something to keep in mind is that I don't know the specifics of what those subtests are testing so it's possible the regressing ones test something more important than what the ones that improved test. It could be useful to double-check this just in case.

Flags: needinfo?(gmierz2)
Severity: -- → S3

It has been over 7 days with no activity on this performance regression.

:emilio, since you are the author of the regressor, bug 1873301, which triggered this performance alert, could you please provide a progress update?

If this regression is something that fixes a bug, changes the baseline of the regression metrics, or otherwise will not be fixed, please consider closing it as WONTFIX. See this documentation for more information on how to handle regressions.

For additional information/help, please needinfo the performance sheriff who filed this alert (they can be found in comment #0), or reach out in #perftest, or #perfsheriffs on Element.

For more information, please visit BugBot documentation.

Flags: needinfo?(emilio)

I still think it's worth digging into though I'm don't have any other interesting idea there... I should try the wip patches again to look at whether they move the pageload numbers but...

Flags: needinfo?(emilio)

It has been over 7 days with no activity on this performance regression.

:emilio, since you are the author of the regressor, bug 1873301, which triggered this performance alert, could you please provide a progress update?

If this regression is something that fixes a bug, changes the baseline of the regression metrics, or otherwise will not be fixed, please consider closing it as WONTFIX. See this documentation for more information on how to handle regressions.

For additional information/help, please needinfo the performance sheriff who filed this alert (they can be found in comment #0), or reach out in #perftest, or #perfsheriffs on Element.

For more information, please visit BugBot documentation.

Flags: needinfo?(emilio)

See above?

Flags: needinfo?(emilio)
Depends on: 1985297

I think bug 1984884 fixed this, looking at the graph.

Status: NEW → RESOLVED
Closed: 10 months ago
Duplicate of bug: 1984884
Resolution: --- → DUPLICATE
Depends on: 1984884
No longer depends on: 1985297
No longer duplicate of bug: 1984884
Resolution: DUPLICATE → FIXED
See Also: → 1985297
Target Milestone: --- → 144 Branch

(In reply to Emilio Cobos Álvarez (:emilio) from comment #15)

See above?

:emilio, in the future, if this is a bug you want to keep open but are unlikely to get to resolving soon, then you can add the backlog-deferred keyword to stop the bot from asking for updates. Please only use it sparingly though if possible.

Are we sure this was fixed on version 142 and 143? There were two patches in bug 1984884 but only one was uplifted.

Yes

You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: