1380398 - 10.98 - 12.74% ts_paint_webext (osx-10-10, windows10-64, windows7-32) regression on push 9dd2156225d334fc9c164017b7c5068273bfb7ca (Tue Jul 11 2017)

Status: RESOLVED FIXED

(WebExtensions :: General, defect, P1)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

Talos has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/mozilla-inbound/pushloghtml?changeset=9dd2156225d334fc9c164017b7c5068273bfb7ca

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

 13%  ts_paint_webext windows10-64 opt e10s     848.92 -> 957.08
 12%  ts_paint_webext windows7-32 opt e10s      981.25 -> 1,103.50
 11%  ts_paint_webext osx-10-10 opt e10s        1,388.00 -> 1,540.42


You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=7861

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a treeherder page showing the Talos jobs in a pushlog format.

To learn more about the regressing test(s), please see: https://wiki.mozilla.org/Buildbot/Talos/Tests

For information on reproducing and debugging the regression, either on try or locally, see: https://wiki.mozilla.org/Buildbot/Talos/Running

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/Buildbot/Talos/RegressionBugsHandling

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

:kmag, I see you authored the patches in bug 1364768, can you take a look at this regression which appears to be on the webext only test.

Comment 2

[Ionuț Goldan [:igoldan]]

This also landed an improvement, alongside regressions from above:

== Change summary for alert #7861 (as of July 11 2017 23:20 UTC) ==

Improvements:

 78%  tp5n nonmain_startup_fileio windows7-32 opt e10s     29,614.42 -> 6,390.25

Comment 3

[Kris Maglione [:kmag]]

This is a timing issue. We were previously (accidentally) delaying most of WebExtension startup until after first paint because the IndexedDB queries took so long. Now, startup happens earlier, which is the intended behavior, but is less performant.

I haven't decided exactly what to do about this yet, but I'm probably going to tweak the last unlanded patch for that bug to delay most of initialization for all extensions except the ones with the webRequestBlocking permission.

Comment 4

[Ionuț Goldan [:igoldan]]

:kmag Can you give an update for this issue?

Comment 5

[Kris Maglione [:kmag]]

Yes, bug 1381687 and bug 1382329 should take care of most of the regression.

I'm looking into other potential optimizations before I consider delaying most of the extension load process again, since our actual startup performance overhead is much easier to track this way, and we won't ever be able to completely delay these things when extensions with blocking webRequest permissions are installed.

Comment 6

[Ionuț Goldan [:igoldan]]

Bug 1381687 already brought considerable, but still partial improvements on ts_paint_webext. Will wait for bug 1382329.

Comment 7

[Joel Maher ( :jmaher ) (UTC -8)]

it looks like bug 1382329 has all r+ patches, we have 1 week until merge day, possibly we can have this landed and confirmed before then.

Comment 8

[Kevin Brosnan [Ex-Mozilla]]

This regression in ts_paint_webext is fixed. The current results are lower than before the July 11th regressionn.

https://treeherder.mozilla.org/perf.html#/graphs?timerange=2592000&series=%5Bmozilla-inbound,91d0cee6b8905897868871a4aa2a60775208c95c,1%5D&series=%5Bautoland,91d0cee6b8905897868871a4aa2a60775208c95c,0%5D&selected=%5Bmozilla-inbound,91d0cee6b8905897868871a4aa2a60775208c95c%5D

https://treeherder.mozilla.org/perf.html#/graphs?timerange=2592000&series=%5Bmozilla-inbound,43b86e9d30eb1c24ef91a2f7f3610cb4ac75c647,1%5D&series=%5Bautoland,43b86e9d30eb1c24ef91a2f7f3610cb4ac75c647,0%5D&selected=%5Bmozilla-inbound,43b86e9d30eb1c24ef91a2f7f3610cb4ac75c647%5D

https://treeherder.mozilla.org/perf.html#/graphs?timerange=2592000&series=%5Bmozilla-inbound,e3e3940e5854ff1bded84fd00263b7d11059ef79,1%5D&series=%5Bautoland,e3e3940e5854ff1bded84fd00263b7d11059ef79,0%5D&selected=%5Bmozilla-inbound,e3e3940e5854ff1bded84fd00263b7d11059ef79%5D

Comment 9

[Kevin Brosnan [Ex-Mozilla]]

To be clear the numbers improved after the 26th which is when 1382329 landed.