1369587 - Massive (26-60%) regression in Angular2 sync Speedometer2 benchmarks on inbound today

Status: RESOLVED INVALID

(Core :: General, defect)

Description

[(no longer active)]

(I'm not listing the async tests since due to bug 1366803 they're basically a random number generator for now.)

https://arewefastyet.com/#machine=17&view=single&suite=speedometer-misc&subtest=Angular2-TypeScript-TodoMVC-Adding100Items-sync
https://arewefastyet.com/#machine=17&view=single&suite=speedometer-misc&subtest=Angular2-TypeScript-TodoMVC-CompletingAllItems-sync
https://arewefastyet.com/#machine=17&view=single&suite=speedometer-misc&subtest=Angular2-TypeScript-TodoMVC-DeletingItems-sync

regression range:
https://hg.mozilla.org/integration/mozilla-inbound/log?rev=60752371afbb6a9e0631c55ea09a05c0d767d04b%3A%3A63cd7aaf05d865a5ffc030a3c336b4cec40f45f2%20and%20!60752371afbb6a9e0631c55ea09a05c0d767d04b

My current suspects:
https://hg.mozilla.org/integration/mozilla-inbound/rev/40b3da698ff5
https://hg.mozilla.org/integration/mozilla-inbound/rev/9f6c73141311
https://hg.mozilla.org/integration/mozilla-inbound/rev/90f080141b3d

I'm making a build to back them out individually to find the culprit.

Comment 1

[(no longer active)]

Hmm, my local builds on Windows didn't reproduce any changes at all.  I need to try downloading Windows builds tomorrow at the office and test there...

Comment 2

[Jan de Mooij [:jandem]]

It went back to normal. These tests are pretty unstable unfortunately, likely due to GC/CC or something.

Comment 3

[(no longer active)]

Phew!  OK...