Lots of regressions from bug 1210261

RESOLVED WORKSFORME

Status

()

Core
Graphics
RESOLVED WORKSFORME
2 years ago
2 years ago

People

(Reporter: mchang, Assigned: mchang)

Tracking

40 Branch
Unspecified
Windows
Points:
---
Dependency tree / graph

Firefox Tracking Flags

(Not tracked)

Details

(Assignee)

Description

2 years ago
And the regressions come rolling in, which are somewhat expected:

Regression: Mozilla-Inbound-Non-PGO - CanvasMark - WINNT 6.1 (ix) (e10s) - 16.3% decrease
Regression: Mozilla-Inbound-Non-PGO - Talos Page Switch - WINNT 5.1 (ix) - 19.5% increase
Regression: Mozilla-Inbound-Non-PGO - Tab Animation Test - WINNT 6.1 (ix) (e10s) - 3.88% increase
Regression: Mozilla-Inbound-Non-PGO - CanvasMark - WINNT 5.1 (e10s) - 16.6% decrease
Regression: Mozilla-Inbound-Non-PGO - Talos Page Switch - Ubuntu HW 12.04 x64 - 23.9% increase
Regression: Mozilla-Inbound-Non-PGO - CanvasMark - Ubuntu HW 12.04 x64 (e10s) - 18.7% decrease


A very weird improvement (but could be bug 1223907).
Improvement: Mozilla-Inbound-Non-PGO - a11y Row Major MozAfterPaint - Ubuntu HW 12.04 x64 - 4.28% decrease
(Assignee)

Comment 1

2 years ago
Regression: Mozilla-Inbound-Non-PGO - CanvasMark - WINNT 6.2 x64 (e10s) - 15.7% decrease
(Assignee)

Comment 2

2 years ago
Two more improvements clumped with bug 1223907:

Improvement: Mozilla-Inbound-Non-PGO - SVG, Opacity Row Major - Ubuntu HW 12.04 x64 - 53% decrease
Improvement: Mozilla-Inbound-Non-PGO - a11y Row Major MozAfterPaint - Ubuntu HW 12.04 x64 - 3.52% decrease
(Assignee)

Comment 3

2 years ago
Regression: Mozilla-Inbound-Non-PGO - CanvasMark - WINNT 6.1 (ix) - 30.3% decrease
Regression: Mozilla-Inbound-Non-PGO - CanvasMark - WINNT 5.1 (ix) - 31.6% decrease
Regression: Mozilla-Inbound-Non-PGO - CanvasMark - Ubuntu HW 12.04 x64 - 45.2% decrease
Regression: Mozilla-Inbound-Non-PGO - Talos Page Switch - WINNT 6.1 (ix) - 8.5% increase
Regression: Mozilla-Inbound-Non-PGO - Customization Animation Tests - WINNT 5.1 (e10s) - 5.76% increase

Improvements:
Improvement: Mozilla-Inbound-Non-PGO - a11y Row Major MozAfterPaint - WINNT 5.1 (ix) - 4.2% decrease
Improvement: Mozilla-Inbound-Non-PGO - a11y Row Major MozAfterPaint - WINNT 6.1 (ix) - 3.35% decrease
Blocks: 1220148, 1210261
(Assignee)

Comment 4

2 years ago
Regression: Mozilla-Inbound-Non-PGO - Tab Animation Test - WINNT 6.2 x64 (e10s) - 2.85% increase
Regression: Mozilla-Inbound-Non-PGO - CanvasMark - WINNT 6.2 x64 - 26.3% decrease

Improvement: Mozilla-Inbound-Non-PGO - SVG, Opacity Row Major - WINNT 6.2 x64 - 64.1% decrease
Improvement: Mozilla-Inbound-Non-PGO - SVG, Opacity Row Major - Ubuntu HW 12.04 x64 - 55.2% decrease
Improvement: Mozilla-Inbound-Non-PGO - a11y Row Major MozAfterPaint - WINNT 6.2 x64 - 4.8% decrease
Improvement: Mozilla-Inbound-Non-PGO - SVG, Opacity Row Major - WINNT 6.1 (ix) - 74.5% decrease
Improvement: Mozilla-Inbound-Non-PGO - Tp5 Optimized - WINNT 6.1 (ix) - 2.86% decrease
(Assignee)

Comment 5

2 years ago
Regression: Mozilla-Inbound-Non-PGO - Talos Page Switch - WINNT 6.2 x64 - 9.62% increase
(Assignee)

Comment 6

2 years ago
Improvement: Mozilla-Inbound-Non-PGO - SVG, Opacity Row Major - WINNT 5.1 (ix) - 73.8% decrease
compare view:
https://treeherder.mozilla.org/perf.html#/compare?originalProject=mozilla-inbound&originalRevision=b0e16f67e098&newProject=mozilla-inbound&newRevision=d1029ba11d5c

keep in mind there are some noisy tests, ones that have >5% difference or >1 platform regressing are most likely legit.  You can see the graphs and subtests easily though.

given the scope of this, do you think these peformance changes are expected, within range, and worth keeping in tree?   any possibly tweaks to make it slightly better?
and the view in alert manager:
http://alertmanager.allizom.org:8080/alerts.html?rev=d1029ba11d5c64c455412a58a2a77d14511286d6&showAll=1&testIndex=0&platIndex=0
(Assignee)

Comment 9

2 years ago
Regression: Mozilla-Inbound - CanvasMark - MacOSX 10.10 - 13.9% decrease

Improvement: Mozilla-Inbound-Non-PGO - Talos Page Switch - Ubuntu HW 12.04 x64 (e10s) - 5.01% decrease
Improvement: Mozilla-Inbound-Non-PGO - Tp5 Optimized - WINNT 6.2 x64 - 2.94% decrease

> given the scope of this, do you think these peformance changes are expected,
> within range, and worth keeping in tree?   any possibly tweaks to make it
> slightly better?

Backed out for now. We were expecting some performance differences, not sure this bad though.
(Assignee)

Comment 10

2 years ago
Bug 1210261 landed without the part that caused the regressions, which was skipping a force refresh. No regressions came out, but some improvements did! Closing this as WFM.
Status: NEW → RESOLVED
Last Resolved: 2 years ago
Resolution: --- → WORKSFORME
You need to log in before you can comment on or make changes to this bug.