1375414 - Lots of osx regressions ranging between 5.21% and 56.73% from push 686fa05da73a7b52aa488dc7f6b695cda0e72503 (Wed Jun 21 2017)

Status: RESOLVED WONTFIX

(Release Engineering :: General, defect)

Description

[Ionuț Goldan [:igoldan]]

Talos has detected a Firefox performance regression from push:

https://hg.mozilla.org/integration/autoland/pushloghtml?changeset=686fa05da73a7b52aa488dc7f6b695cda0e72503

As author of one of the patches included in that push, we need your help to address this regression.

Regressions:

 57%  sessionrestore osx-10-10 opt e10s     855.25 -> 1,340.42
 52%  sessionrestore_no_auto_restore osx-10-10 opt e10s950.08 -> 1,440.42
 33%  bloom_basic summary osx-10-10 opt e10s698.75 -> 928.47
 31%  ts_paint_webext osx-10-10 opt e10s    1,145.17 -> 1,502.75
 31%  bloom_basic_ref summary osx-10-10 opt e10s700.44 -> 918.71
 28%  a11yr summary osx-10-10 opt e10s      419.70 -> 537.83
 28%  kraken summary osx-10-10 opt e10s     1,557.84 -> 1,988.00
 27%  ts_paint osx-10-10 opt e10s           1,113.83 -> 1,418.17
 26%  tsvgr_opacity summary osx-10-10 opt e10s332.70 -> 418.42
 24%  damp summary osx-10-10 opt e10s       266.35 -> 331.39
 23%  tp5o_webext summary osx-10-10 opt e10s268.13 -> 329.82
 22%  basic_compositor_video summary osx-10-10 opt e10s9.35 -> 11.39
 21%  cart summary osx-10-10 opt e10s       27.85 -> 33.69
 19%  tsvgx summary osx-10-10 opt e10s      402.59 -> 478.52
 17%  tcanvasmark summary osx-10-10 opt e10s7,374.33 -> 6,112.79
 17%  tart summary osx-10-10 opt e10s       10.86 -> 12.69
 13%  glvideo Mean tick time across 100 ticks:  osx-10-10 opt e10s18.19 -> 20.57
 12%  tresize osx-10-10 opt e10s            28.66 -> 32.04
 10%  tps summary osx-10-10 opt e10s        24.59 -> 26.99
  7%  glterrain summary osx-10-10 opt e10s  3.80 -> 4.08
  7%  tp5o summary osx-10-10 opt e10s       268.84 -> 286.84
  5%  dromaeo_css summary osx-10-10 opt e10s8,658.22 -> 8,207.00


You can find links to graphs and comparison views for each of the above tests at: https://treeherder.mozilla.org/perf.html#/alerts?id=7454

On the page above you can see an alert for each affected platform as well as a link to a graph showing the history of scores for this test. There is also a link to a treeherder page showing the Talos jobs in a pushlog format.

To learn more about the regressing test(s), please see: https://wiki.mozilla.org/Buildbot/Talos/Tests

For information on reproducing and debugging the regression, either on try or locally, see: https://wiki.mozilla.org/Buildbot/Talos/Running

*** Please let us know your plans within 3 business days, or the offending patch(es) will be backed out! ***

Our wiki page outlines the common responses and expectations: https://wiki.mozilla.org/Buildbot/Talos/RegressionBugsHandling

Comment 1

[Ionuț Goldan [:igoldan]]

This is more for informational purposes.

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

this is the osx cross compiled build change.

Comment 3

[(not currently active) Ted Mielczarek]

We should have landed the workaround fix before making this switch, but we didn't. :-/