1815366 - 8% Regression on AWFY-Jetstream2-base64-SP-Average around Feb1

Status: RESOLVED WORKSFORME

(Core :: Performance, defect)

Description

[Mayank Bansal]

Go to https://arewefastyet.com/win10/benchmarks/raptor-desktop-jetstream2?numDays=60
Look at base64-SP-Average

Regression: https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&series=autoland,3911325,1,13&series=mozilla-central,3737938,1,13&series=mozilla-central,3737938,1,13&timerange=5184000&zoom=1674972306393,1675328901603,444.57667901908496,649.9850538731554

Suspected: bug 1808673

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

This bug has been marked as a regression. Setting status flag for Nightly to affected.

Comment 2

[Denis Palmeiro [:denispal]]

Likely a regression from bug 1808673.

Comment 3

[Olli Pettay [:smaug][[e-mail]]]

Trying to figure out how to run base64-SP.
But I don't think we should backout bug 1808673, since it improved ReactJS-Todo quite a bit
https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&series=autoland,3912919,1,13&timerange=5184000

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1808673

Comment 5

[Donal Meehan [:dmeehan]]

:smaug did you make an progress in your investigation in comment 3?
What is the impact the for 111 release or the severity?

Comment 6

[Jared Hirsch [:jhirsch] (he/him) (Needinfo please)]

I pinged :smaug on matrix and was told this shouldn't block for 111, marking fix-optional

Comment 7

[Mayank Bansal]

FWIF, the numbers have gone back up to roughly the previous range.

https://treeherder.mozilla.org/perfherder/graphs?highlightAlerts=1&highlightChangelogData=1&highlightCommonAlerts=0&selected=3911325,1651681100&series=mozilla-central,3737938,1,13&series=mozilla-central,3737938,1,13&series=autoland,3911325,1,13&timerange=5184000&zoom=1677125665768,1677358414313,470.51905330016695,662.5896875035143

But not sure which bug actually improved the score.

Comment 8

[Olli Pettay [:smaug][[e-mail]]]

Probably Bug 1817767, not sure how though :)

But I think this is now WFM

Comment 9

[Olli Pettay [:smaug][[e-mail]]]

And thanks Mayank for checking that!