Open Bug 1872172 Opened 2 years ago Updated 2 days ago

Beta 122 Performance changes when we unset EARLY_BETA_OR_EARLIER

Categories

(Testing :: Performance, defect, P5)

Product:
Testing
Component:
Performance
Version:
Firefox 122
Type:
defect

Tracking

(firefox123 affected)

Tracking Flags:
Tracking Status
firefox123 --- affected

People

(Reporter: aglavic, Unassigned)

References

(Depends on 3 open bugs, Blocks 1 open bug)

Details

(Keywords: perf, perf-alert, regression)

No description provided.

== Change summary for alert #40750 (as of Thu, 21 Dec 2023 21:32:54 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new)
27% perf_reftest_singletons getElementById-1.html linux1804-64-shippable-qr e10s fission stylo webrender 62.14 -> 78.75
10% perf_reftest_singletons window-named-property-get.html linux1804-64-shippable-qr e10s fission stylo webrender 613.01 -> 671.84
8% cross_origin_pageload windows10-64-shippable-qr e10s fission stylo webrender 233.87 -> 251.41
7% perf_reftest_singletons attr-selector-1.html linux1804-64-shippable-qr e10s fission stylo webrender 153.56 -> 164.72
7% perf_reftest_singletons nth-index-2.html linux1804-64-shippable-qr e10s fission stylo webrender 1.28 -> 1.37
6% perf_reftest_singletons tiny-traversal-singleton.html linux1804-64-shippable-qr e10s fission stylo webrender 889.34 -> 944.77
6% perf_reftest_singletons nth-index-1.html linux1804-64-shippable-qr e10s fission stylo webrender 1.28 -> 1.36
5% perf_reftest coalesce-1.html windows10-64-shippable-qr e10s fission stylo webrender 59.29 -> 62.44
4% tp5o windows10-64-shippable-qr e10s fission stylo webrender 197.41 -> 205.98
4% cross_origin_pageload windows10-64-shippable-qr e10s fission stylo webrender-sw 237.24 -> 246.85
... ... ... ... ...
3% tp5o linux1804-64-shippable-qr e10s fission stylo webrender-sw 190.73 -> 196.08
3% ts_paint linux1804-64-shippable-qr e10s fission stylo webrender-sw 712.17 -> 731.92
3% tp5n nonmain_startup_fileio windows11-64-2009-shippable-qr e10s fission stylo webrender 840,230.29 -> 863,162.00
2% tp5o linux1804-64-shippable-qr e10s fission stylo webrender 207.22 -> 211.65
2% tp5o_webext linux1804-64-shippable-qr e10s fission stylo webrender-sw 258.20 -> 263.53

Improvements:

Ratio Test Platform Options Absolute values (old vs new)
75% glvideo Mean tick time across 100 ticks: linux1804-64-shippable-qr e10s fission stylo webrender-sw 16.02 -> 4.03
75% glvideo Mean tick time across 100 ticks: linux1804-64-shippable-qr e10s fission stylo webrender 15.88 -> 4.03
62% perf_reftest recompute-position-vertical-rl.html macosx1015-64-shippable-qr e10s fission stylo webrender-sw 1.40 -> 0.54
15% tp5o responsiveness linux1804-64-shippable-qr e10s fission stylo webrender-sw 2.56 -> 2.18
15% tp5o_webext responsiveness linux1804-64-shippable-qr e10s fission stylo webrender-sw 3.50 -> 2.98
... ... ... ... ...
3% tsvgx windows10-64-shippable-qr e10s fission stylo webrender 179.25 -> 174.09

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=40750

== Change summary for alert #40720 (as of Tue, 19 Dec 2023 23:00:31 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
368% twitch fcp windows10-64-shippable-qr fission warm webrender 37.10 -> 173.64
260% twitch fcp macosx1015-64-shippable-qr fission warm webrender 52.23 -> 187.98
228% twitch fcp linux1804-64-shippable-qr fission warm webrender 67.04 -> 219.97
63% twitch FirstVisualChange linux1804-64-shippable-qr fission warm webrender 63.84 -> 104.07
60% expedia fcp macosx1015-64-shippable-qr fission warm webrender 139.36 -> 223.38 Before/After
59% twitch ContentfulSpeedIndex macosx1015-64-shippable-qr fission warm webrender 235.48 -> 374.97
49% twitch PerceptualSpeedIndex linux1804-64-shippable-qr fission warm webrender 232.00 -> 346.13
42% twitch loadtime macosx1015-64-shippable-qr fission warm webrender 511.32 -> 726.35
41% twitch loadtime windows10-64-shippable-qr fission warm webrender 551.40 -> 775.04
34% twitch loadtime linux1804-64-shippable-qr fission warm webrender 700.11 -> 939.52
... ... ... ... ... ...
3% webaudio windows10-64-shippable-qr fission webrender 79.08 -> 81.58 Before/After
3% instagram loadtime linux1804-64-shippable-qr fission warm webrender 516.15 -> 531.02 Before/After
3% instagram loadtime windows10-64-shippable-qr fission warm webrender 435.12 -> 447.03 Before/After
2% youtube SpeedIndex macosx1015-64-shippable-qr fission warm webrender 1,003.45 -> 1,025.76 Before/After
2% cnn SpeedIndex linux1804-64-shippable-qr fission warm webrender 593.20 -> 605.53 Before/After

Improvements:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
89% imgur loadtime windows10-64-shippable-qr cold fission webrender 20,755.22 -> 2,191.98 Before/After
70% imgur PerceptualSpeedIndex windows10-64-shippable-qr cold fission webrender 2,309.89 -> 696.41 Before/After
68% imgur LastVisualChange windows10-64-shippable-qr cold fission webrender 23,823.96 -> 7,616.63 Before/After
63% microsoft LastVisualChange windows10-64-shippable-qr fission warm webrender 773.13 -> 289.16 Before/After
61% microsoft LastVisualChange linux1804-64-shippable-qr fission warm webrender 832.22 -> 326.62 Before/After
... ... ... ... ... ...
2% twitter LastVisualChange windows10-64-shippable-qr bytecode-cached fission warm webrender 957.20 -> 934.42 Before/After

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=40720

== Change summary for alert #40749 (as of Thu, 21 Dec 2023 14:28:18 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new)
35% Base Content Explicit linux1804-64-shippable-qr fission 7,186,789.33 -> 9,685,861.33
31% Base Content Explicit windows11-64-2009-shippable-qr fission 7,958,885.33 -> 10,395,834.67
30% Base Content Explicit macosx1015-64-shippable-qr fission 7,842,149.33 -> 10,227,728.00
14% Base Content Resident Unique Memory windows11-64-2009-shippable-qr fission 8,964,266.67 -> 10,194,261.33
10% Base Content Resident Unique Memory linux1804-64-shippable-qr fission 13,500,562.29 -> 14,816,768.00

Improvements:

Ratio Test Platform Options Absolute values (old vs new)
3% Base Content JS windows11-64-2009-shippable-qr fission 1,548,706.67 -> 1,507,864.00
3% Base Content JS macosx1015-64-shippable-qr fission 1,546,267.33 -> 1,505,475.33
3% Base Content JS linux1804-64-shippable-qr fission 1,546,006.67 -> 1,506,008.00

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=40749

This bug has been marked as a regression. Setting status flag for Nightly to affected.

status-firefox123: --- → affected
Severity: -- → S3
Priority: -- → P5

== Change summary for alert #40797 (as of Thu, 28 Dec 2023 14:22:22 GMT) ==

Improvements:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
5% instagram LastVisualChange windows10-64-shippable-qr fission warm webrender 621.56 -> 589.45 Before/After

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=40797

== Change summary for alert #40798 (as of Thu, 28 Dec 2023 14:26:18 GMT) ==

Improvements:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
3% instagram ContentfulSpeedIndex windows10-64-shippable-qr fission warm webrender 427.46 -> 416.47 Before/After

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=40798

== Change summary for alert #40904 (as of Tue, 09 Jan 2024 00:43:58 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
175% microsoft LastVisualChange macosx1015-64-shippable-qr fission warm webrender 307.92 -> 847.23 Before/After
164% microsoft LastVisualChange windows10-64-shippable-qr fission warm webrender 291.45 -> 768.86 Before/After
155% microsoft PerceptualSpeedIndex macosx1015-64-shippable-qr fission warm webrender 180.74 -> 460.34 Before/After
153% microsoft LastVisualChange linux1804-64-shippable-qr fission warm webrender 328.54 -> 831.42 Before/After
150% microsoft PerceptualSpeedIndex windows10-64-shippable-qr fission warm webrender 179.14 -> 447.53 Before/After
120% microsoft PerceptualSpeedIndex linux1804-64-shippable-qr fission warm webrender 219.40 -> 482.57 Before/After
83% microsoft PerceptualSpeedIndex macosx1015-64-shippable-qr cold fission webrender 279.01 -> 509.60 Before/After
81% microsoft PerceptualSpeedIndex windows10-64-shippable-qr cold fission webrender 296.58 -> 537.74 Before/After
79% microsoft LastVisualChange windows10-64-shippable-qr cold fission webrender 503.52 -> 900.70 Before/After
76% microsoft LastVisualChange macosx1015-64-shippable-qr cold fission webrender 524.61 -> 922.97 Before/After
56% microsoft PerceptualSpeedIndex linux1804-64-shippable-qr cold fission webrender 410.27 -> 640.31 Before/After
44% microsoft LastVisualChange linux1804-64-shippable-qr cold fission webrender 754.92 -> 1,090.33 Before/After
18% microsoft ContentfulSpeedIndex windows10-64-shippable-qr cold fission webrender 302.66 -> 357.18 Before/After
15% microsoft SpeedIndex windows10-64-shippable-qr fission warm webrender 193.17 -> 221.85 Before/After
13% microsoft SpeedIndex windows10-64-shippable-qr cold fission webrender 379.22 -> 430.07 Before/After

Improvements:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
34% expedia fcp macosx1015-64-shippable-qr fission warm webrender 217.30 -> 142.81 Before/After
10% yahoo-mail fcp linux1804-64-shippable-qr bytecode-cached fission warm webrender 153.35 -> 138.48 Before/After
6% yahoo-mail loadtime macosx1015-64-shippable-qr bytecode-cached fission warm webrender 225.96 -> 213.38 Before/After
5% motionmark-htmlsuite-ramp windows10-64-shippable-qr fission webrender 579.06 -> 609.09 Before/After
4% yahoo-mail loadtime linux1804-64-shippable-qr bytecode-cached fission warm webrender 313.77 -> 300.57 Before/After
... ... ... ... ... ...
2% netflix largestContentfulPaint windows10-64-shippable-qr fission warm webrender 590.20 -> 577.94 Before/After

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=40904

== Change summary for alert #40920 (as of Tue, 09 Jan 2024 13:52:33 GMT) ==

Improvements:

Ratio Test Platform Options Absolute values (old vs new)
27% Base Content Explicit macosx1015-64-shippable-qr fission 10,490,213.33 -> 7,635,472.00
26% Base Content Explicit linux1804-64-shippable-qr fission 9,723,066.67 -> 7,152,997.33
25% Base Content Explicit windows11-64-2009-shippable-qr fission 10,352,485.33 -> 7,797,776.00
13% Base Content Resident Unique Memory windows11-64-2009-shippable-qr fission 10,210,474.67 -> 8,869,034.67
10% Base Content Resident Unique Memory macosx1015-64-shippable-qr fission 16,452,778.67 -> 14,738,432.00
10% Base Content Resident Unique Memory linux1804-64-shippable-qr fission 14,836,565.33 -> 13,370,880.00

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=40920

== Change summary for alert #40921 (as of Tue, 09 Jan 2024 21:00:14 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new)
6% perf_reftest_singletons parent-basic-singleton.html linux1804-64-shippable-qr e10s fission stylo webrender 93.14 -> 98.82

Improvements:

Ratio Test Platform Options Absolute values (old vs new)
8% perf_reftest_singletons tiny-traversal-singleton.html windows10-64-shippable-qr e10s fission stylo webrender 719.89 -> 661.10
8% a11yr windows10-64-shippable-qr e10s fission stylo webrender 382.42 -> 351.72
7% perf_reftest_singletons tiny-traversal-singleton.html macosx1015-64-shippable-qr e10s fission stylo webrender 690.91 -> 645.57
7% cross_origin_pageload windows10-64-shippable-qr e10s fission stylo webrender-sw 249.70 -> 233.34
6% a11yr windows10-64-shippable-qr e10s fission stylo webrender-sw 377.31 -> 353.08
... ... ... ... ...
2% ts_paint_webext windows10-64-shippable-qr e10s fission stylo webrender 428.17 -> 419.42

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=40921

Version: Firefox 120 → Firefox 122

== Change summary for alert #40932 (as of Tue, 09 Jan 2024 18:01:14 GMT) ==

Improvements:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
9% nytimes FirstVisualChange windows10-64-shippable-qr cold fission webrender 366.92 -> 334.22 Before/After
9% nytimes fcp windows10-64-shippable-qr cold fission webrender 330.92 -> 302.54 Before/After
4% nytimes PerceptualSpeedIndex windows10-64-shippable-qr cold fission webrender 713.37 -> 687.21 Before/After
4% outlook SpeedIndex linux1804-64-shippable-qr cold fission webrender 1,666.54 -> 1,606.88 Before/After

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=40932

Blocks: 1977361
You need to log in before you can comment on or make changes to this bug.