Open Bug 1862221 Opened 11 months ago Updated 9 months ago

Beta 120 Performance changes when we unset EARLY_BETA_OR_EARLIER

Categories

(Testing :: Performance, defect, P5)

Product:
Testing
Component:
Performance
Version:
Firefox 120
Type:
defect

Tracking

(Not tracked)

People

(Reporter: alexandrui, Unassigned)

References

(Depends on 1 open bug, Blocks 2 open bugs)

Details

(Keywords: perf, perf-alert, regression)

No description provided.

== Change summary for alert #40053 (as of Thu, 26 Oct 2023 08:56:58 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new)
36% Base Content Explicit linux1804-64-shippable-qr fission 7,216,456.00 -> 9,804,816.00
33% Base Content Explicit macosx1015-64-shippable-qr fission 7,851,677.33 -> 10,474,853.33
11% Base Content Resident Unique Memory linux1804-64-shippable-qr fission 13,329,749.33 -> 14,800,384.00

Improvements:

Ratio Test Platform Options Absolute values (old vs new)
0.30% Base Content JS linux1804-64-shippable-qr fission 1,572,478.00 -> 1,567,805.33
0.30% Base Content JS macosx1015-64-shippable-qr fission 1,572,778.67 -> 1,568,056.00

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=40053

== Change summary for alert #40052 (as of Thu, 26 Oct 2023 08:30:30 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new)
1% installer size osx-cross-devedition nightly 86,380,161.33 -> 87,382,260.92
1% installer size osx-shippable nightly 78,293,263.00 -> 79,204,858.25
1% installer size osx-aarch64-shippable aarch64 nightly 74,699,692.50 -> 75,435,563.92
1% installer size osx-aarch64-devedition aarch64 nightly 82,555,714.17 -> 83,347,135.58

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=40052

This bug has been marked as a regression. Setting status flag for Nightly to affected.

status-firefox121: --- → affected
Severity: -- → S3
Priority: -- → P5

== Change summary for alert #40170 (as of Wed, 08 Nov 2023 08:58:12 GMT) ==

Improvements:

Ratio Test Platform Options Absolute values (old vs new)
6% perf_reftest_singletons tiny-traversal-singleton.html macosx1015-64-shippable-qr e10s fission stylo webrender 677.81 -> 640.03
6% a11yr windows10-64-shippable-qr e10s fission stylo webrender-sw 389.99 -> 368.44
5% cross_origin_pageload windows10-64-shippable-qr e10s fission stylo webrender-sw 252.00 -> 238.72
5% cross_origin_pageload windows10-64-shippable-qr e10s fission stylo webrender 251.76 -> 238.98
5% a11yr windows10-64-shippable-qr e10s fission stylo webrender 389.54 -> 369.95
... ... ... ... ...
2% sessionrestore macosx1015-64-shippable-qr e10s fission stylo webrender 1,032.71 -> 1,011.67

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=40170

== Change summary for alert #40157 (as of Tue, 07 Nov 2023 17:31:22 GMT) ==

Improvements:

Ratio Test Platform Options Absolute values (old vs new)
27% Base Content Explicit linux1804-64-shippable-qr fission 9,770,853.33 -> 7,174,160.00
25% Base Content Explicit macosx1015-64-shippable-qr fission 10,437,818.67 -> 7,833,104.00
24% Base Content Explicit windows11-64-2009-shippable-qr fission 10,465,978.67 -> 7,920,656.00
13% Base Content Resident Unique Memory windows11-64-2009-shippable-qr fission 10,360,149.33 -> 9,009,834.67
12% Base Content Resident Unique Memory linux1804-64-shippable-qr fission 14,908,928.00 -> 13,191,680.00
... ... ... ... ...
6% Resident Memory macosx1015-64-shippable-qr fission tp6 1,015,904,240.51 -> 952,709,794.96

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=40157

== Change summary for alert #40152 (as of Tue, 07 Nov 2023 14:45:42 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
185% microsoft LastVisualChange macosx1015-64-shippable-qr fission warm webrender 298.94 -> 851.00 Before/After
161% microsoft LastVisualChange windows10-64-shippable-qr fission warm webrender 295.16 -> 770.32 Before/After
151% microsoft PerceptualSpeedIndex macosx1015-64-shippable-qr fission warm webrender 182.11 -> 457.58 Before/After
149% microsoft LastVisualChange linux1804-64-shippable-qr fission warm webrender 336.38 -> 836.90 Before/After
143% microsoft PerceptualSpeedIndex windows10-64-shippable-qr fission warm webrender 183.43 -> 445.53 Before/After
121% microsoft PerceptualSpeedIndex linux1804-64-shippable-qr fission warm webrender 220.08 -> 486.34 Before/After
77% microsoft PerceptualSpeedIndex macosx1015-64-shippable-qr cold fission webrender 289.03 -> 510.40 Before/After
72% microsoft PerceptualSpeedIndex windows10-64-shippable-qr cold fission webrender 310.28 -> 533.86 Before/After
71% microsoft LastVisualChange macosx1015-64-shippable-qr cold fission webrender 544.00 -> 931.28 Before/After
56% microsoft PerceptualSpeedIndex linux1804-64-shippable-qr cold fission webrender 416.33 -> 648.70 Before/After
... ... ... ... ... ...
12% microsoft SpeedIndex linux1804-64-shippable-qr fission warm webrender 233.66 -> 261.64 Before/After
11% microsoft SpeedIndex windows10-64-shippable-qr fission warm webrender 196.31 -> 217.28 Before/After
8% instagram FirstVisualChange linux1804-64-shippable-qr bytecode-cached cold fission webrender 274.74 -> 297.57 Before/After
8% instagram fcp linux1804-64-shippable-qr bytecode-cached cold fission webrender 254.57 -> 274.66 Before/After
3% sunspider linux1804-64-shippable-qr fission webrender 199.82 -> 205.70 Before/After

Improvements:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
36% expedia fcp macosx1015-64-shippable-qr fission warm webrender 239.35 -> 153.71 Before/After
34% fandom fcp macosx1015-64-shippable-qr bytecode-cached cold fission webrender 465.07 -> 309.05 Before/After
26% fandom FirstVisualChange macosx1015-64-shippable-qr bytecode-cached cold fission webrender 553.48 -> 410.06 Before/After
25% fandom ContentfulSpeedIndex macosx1015-64-shippable-qr bytecode-cached cold fission webrender 650.30 -> 488.47 Before/After
24% fandom FirstVisualChange macosx1015-64-shippable-qr cold fission webrender 524.66 -> 397.69 Before/After
... ... ... ... ... ...
2% reddit LastVisualChange linux1804-64-shippable-qr cold fission webrender 5,159.83 -> 5,049.53 Before/After

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=40152

Blocks: 1867868
Blocks: 1872172
You need to log in before you can comment on or make changes to this bug.