Closed Bug 1825334 Opened 2 years ago Closed 2 years ago

Beta 112 Performance changes when we unset EARLY_BETA_OR_EARLIER

Categories

(Testing :: Performance, defect, P5)

Product:
Testing
Component:
Performance
Version:
Firefox 112
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED WONTFIX

People

(Reporter: alexandrui, Unassigned)

References

Details

(Keywords: perf, perf-alert)

== Change summary for alert #37744 (as of Fri, 24 Mar 2023 17:54:01 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
43% instagram loadtime macosx1015-64-shippable-qr cold fission webrender 960.98 -> 1,372.54 Before/After
18% instagram FirstVisualChange macosx1015-64-shippable-qr cold fission webrender 205.71 -> 243.33 Before/After
12% instagram fcp macosx1015-64-shippable-qr cold fission webrender 177.88 -> 199.21 Before/After
12% instagram fcp macosx1015-64-shippable-qr bytecode-cached cold fission webrender 180.05 -> 200.83 Before/After
10% instagram LastVisualChange windows10-64-shippable-qr cold fission webrender 1,296.86 -> 1,427.92
10% instagram fcp windows10-64-shippable-qr cold fission webrender 190.21 -> 209.12
9% instagram fcp windows10-64-shippable-qr bytecode-cached cold fission webrender 192.71 -> 210.96
7% instagram LastVisualChange windows10-64-shippable-qr bytecode-cached cold fission webrender 1,303.10 -> 1,397.25
7% instagram fcp linux1804-64-shippable-qr cold fission webrender 244.55 -> 260.67 Before/After
6% instagram PerceptualSpeedIndex windows10-64-shippable-qr cold fission webrender 633.86 -> 673.67
... ... ... ... ... ...
4% instagram loadtime linux1804-64-shippable-qr cold fission webrender 1,899.86 -> 1,979.21 Before/After
4% fandom loadtime linux1804-64-shippable-qr bytecode-cached cold fission webrender 1,308.38 -> 1,357.46 Before/After
4% instagram ContentfulSpeedIndex windows10-64-shippable-qr bytecode-cached cold fission webrender 929.83 -> 962.50
3% instagram SpeedIndex windows10-64-shippable-qr cold fission webrender 906.50 -> 936.58
3% instagram SpeedIndex windows10-64-shippable-qr bytecode-cached cold fission webrender 926.00 -> 952.17

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=37744

Summary: Beta 112Performance changes when we unset EARLY_BETA_OR_EARLIER → Beta 112 Performance changes when we unset EARLY_BETA_OR_EARLIER

== Change summary for alert #37757 (as of Sun, 26 Mar 2023 17:29:21 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
4% fandom loadtime windows10-64-shippable-qr bytecode-cached cold fission webrender 1,037.02 -> 1,076.62 Before/After

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=37757

== Change summary for alert #37768 (as of Mon, 27 Mar 2023 17:03:30 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
16% ebay loadtime macosx1015-64-shippable-qr cold fission webrender 446.68 -> 517.04 Before/After
11% expedia fcp macosx1015-64-shippable-qr cold fission webrender 250.82 -> 277.83 Before/After
10% microsoft fcp macosx1015-64-shippable-qr cold fission webrender 190.39 -> 210.29 Before/After
10% expedia fcp linux1804-64-shippable-qr cold fission webrender 350.77 -> 386.75 Before/After
10% microsoft ContentfulSpeedIndex linux1804-64-shippable-qr cold fission webrender 496.33 -> 545.50 Before/After
8% microsoft loadtime windows10-64-shippable-qr cold fission webrender 257.50 -> 279.04 Before/After
8% expedia FirstVisualChange linux1804-64-shippable-qr cold fission webrender 400.00 -> 433.33 Before/After
8% microsoft SpeedIndex linux1804-64-shippable-qr cold fission webrender 588.73 -> 635.92 Before/After

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=37768

== Change summary for alert #37769 (as of Mon, 27 Mar 2023 17:12:56 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
7% expedia ContentfulSpeedIndex linux1804-64-shippable-qr cold fission webrender 606.00 -> 647.33 Before/After

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=37769

== Change summary for alert #37769 (as of Mon, 27 Mar 2023 17:12:56 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
7% expedia ContentfulSpeedIndex linux1804-64-shippable-qr cold fission webrender 606.00 -> 647.33 Before/After

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=37769

== Change summary for alert #37798 (as of Tue, 28 Mar 2023 17:07:34 GMT) ==

Regressions:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
6% microsoft ContentfulSpeedIndex linux1804-64-shippable-qr fission warm webrender 202.33 -> 214.33 Before/After

Improvements:

Ratio Test Platform Options Absolute values (old vs new) Performance Profiles
3% cnn fcp windows10-64-shippable-qr fission warm webrender 441.40 -> 427.21 Before/After
3% youtube loadtime linux1804-64-shippable-qr cold fission webrender 1,508.04 -> 1,461.96 Before/After
2% youtube SpeedIndex linux1804-64-shippable-qr cold fission webrender 1,525.42 -> 1,493.00 Before/After

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=37798

== Change summary for alert #37793 (as of Tue, 28 Mar 2023 23:36:13 GMT) ==

Improvements:

Ratio Test Platform Options Absolute values (old vs new)
58% a11yr windows10-64-shippable-qr e10s fission stylo webrender 407.65 -> 171.00
57% a11yr windows10-64-shippable-qr e10s fission stylo webrender-sw 395.11 -> 170.91
44% a11yr linux1804-64-shippable-qr e10s fission stylo webrender-sw 583.96 -> 324.59
10% tsvgr_opacity windows10-64-shippable-qr e10s fission stylo webrender 61.15 -> 54.79
6% cross_origin_pageload windows10-64-shippable-qr e10s fission stylo webrender-sw 279.63 -> 262.10
... ... ... ... ...
2% ts_paint windows10-64-shippable-qr e10s fission stylo webrender-sw 400.94 -> 392.92

For up to date results, see: https://treeherder.mozilla.org/perfherder/alerts?id=37793

Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.