1234647 - [meta] tracking: e10s beta experiment crash rates

Status: RESOLVED DUPLICATE of bug 1249209

(Firefox :: General, defect)

Description

[Jim Mathies [:jimm]]

Currently we're running about 21% higher crash rates under e10s.

control:
https://crash-stats.mozilla.com/search/?product=Firefox&ActiveExperiment=%3De10s-enabled-beta-20151214%40experiments.mozilla.org&date=%3E%3D2015-12-18&ActiveExperimentBranch=%3Dcontrol&_facets=signature&_columns=date&_columns=signature&_columns=product&_columns=version&_columns=build_id&_columns=platform#crash-reports

experiment:
https://crash-stats.mozilla.com/search/?product=Firefox&ActiveExperiment=%3De10s-enabled-beta-20151214%40experiments.mozilla.org&date=%3E%3D2015-12-18&ActiveExperimentBranch=%3Dexperiment&_facets=signature&_columns=date&_columns=signature&_columns=product&_columns=version&_columns=build_id&_columns=platform#crash-reports

Comment 1

[Tracy Walker [:tracy]]

This is by pure volume.  Do we have a way to correlate this to ADI under each test group?

Comment 2

[Jim Mathies [:jimm]]

(In reply to [:tracy] Tracy Walker - QA Mentor from comment #1)
> This is by pure volume.  Do we have a way to correlate this to ADI under
> each test group?

yep - 
https://bsmedberg.github.io/telemetry-experiments-dashboard/

currently:

<jimm> experiment 496714 40%
<jimm> control 482320 39%

Comment 3

[Jim Mathies [:jimm]]

killhard abort signature report:
http://www.mathies.com/mozilla/client-abort-report-beta.txt

Comment 4

[Jonathan Howard]

Links for beta4+

control:
https://crash-stats.mozilla.com/search/?product=Firefox&ActiveExperiment=%3De10s-enabled-beta-20151214%40experiments.mozilla.org&date=%3E%3D2015-12-29&ActiveExperimentBranch=%3Dcontrol&build_id=%3E%3D20151228134903&_facets=signature&_columns=date&_columns=signature&_columns=product&_columns=version&_columns=build_id&_columns=platform#crash-reports

experiment:
https://crash-stats.mozilla.com/search/?product=Firefox&ActiveExperiment=%3De10s-enabled-beta-20151214%40experiments.mozilla.org&date=%3E%3D2015-12-29&ActiveExperimentBranch=%3Dexperiment&build_id=%3E%3D20151228134903&_facets=signature&_columns=date&_columns=signature&_columns=product&_columns=version&_columns=build_id&_columns=platform#crash-reports


Prior rank #1 (OOM | unknown | NS_ABORT_OOM | gfxContext::PushNewDT) gone. Bug 1107792

Prior rank #2 (std::_Atomic_fetch_add_4) Bug 1225829. Still around. Occurrence has been roughly halved.

Comment 5

[Jonathan Howard]

There is a significant difference (main v content) in crash submit success.

Link for complete beta population not just experiment
https://telemetry.mozilla.org/new-pipeline/dist.html#!compare=e10sEnabled&cumulative=0&end_date=2016-01-01&keys=main-crash!plugin-crash!plugin-hang!content-crash&max_channel_version=beta%252F44&measure=PROCESS_CRASH_SUBMIT_SUCCESS&min_channel_version=null&processType=false&product=Firefox&sanitize=1&sort_keys=submissions&start_date=2015-12-19&table=0&trim=1&use_submission_date=1

Comment 6

[Jonathan Howard]

Links for beta 45 with add-ons experiment.

control:
https://crash-stats.mozilla.com/search/?product=Firefox&release_channel=beta&ActiveExperiment=%3De10s-beta45-withaddons%40experiments.mozilla.org&ActiveExperimentBranch=%3Dexperiment&date=%3E%3D2016-01-29&_facets=signature&_columns=date&_columns=signature&_columns=product&_columns=version&_columns=build_id&_columns=platform#crash-reports

experiment:
https://crash-stats.mozilla.com/search/?product=Firefox&release_channel=beta&ActiveExperiment=%3De10s-beta45-withaddons%40experiments.mozilla.org&ActiveExperimentBranch=%3Dexperiment&date=%3E%3D2016-01-29&_facets=signature&_columns=date&_columns=signature&_columns=product&_columns=version&_columns=build_id&_columns=platform#crash-reports

Hard hitting Bug 1210099 new since 44, Possibly causing users to quit, percentage has decreased since start.
Two other new top signatures also stand out, not sure if related so will let someone more experience decide whether to create bugs.