712441 - How do startup crashes in js::Shape::finalize correlate with addon usage

Status: RESOLVED FIXED

(Mozilla Metrics :: Hadoop/HBase Operations, defect)

Description

[[:Cww]]

We're looking at js::Shape::finalize (and js::Shape::removeChild )

https://bugzilla.mozilla.org/show_bug.cgi?id=711794

We want to know how many of the startup (<60s uptime) crashes with the above signature come from users with no add-ons (as a percentage)?

(There may be a followup question here too.)

Comment 1

[Robert Helmer [:rhelmer]]

We don't have info on addons in the DB Socorro uses, but I believe that this is in HBase.

Comment 2

[Robert Helmer [:rhelmer]]

I just checked and see this in the JSON that is stored in HBase e.g.:
https://crash-stats.mozilla.com/dumps/446e67d0-def4-43e7-8228-7d62e2110316.jsonz
contains
"addons": [["{972ce4c6-7e08-4474-a285-3208198ce6fd}", "4.0b13pre"], ["[e-mail]", "1.0"]]

Comment 3

[Robert Helmer [:rhelmer]]

I am able to do this using the DB and pulling the JSON via thrift. If someone else if already on this let me know, I got the basic info for this and am now looking into another question about the data (details forthcoming).

Comment 4

[Robert Helmer [:rhelmer]]

Using this query against prod Socorro DB:

SELECT uuid FROM reportsWHERE signature = 'js::Shape::finalize'  
OR signature = 'js::Shape::removeChild' 
AND uptime < 60

I get 1671 total.

Ran a script to extract individual crashes based on this list of crash IDs, here are the results:

47 of 1671 (0.028%) have no addons.

Cww also provided a list of "bad addons" to check against:
http://pastebin.mozilla.org/1413927

9 of 1671 (0.005%0 contain an addon from the "bad" list.

We added the addon ID {841468a1-d7f4-4bd3-84e6-bb0f13a06c64} to the "bad" list to sanity check:

175 of 1671 (0.1%) contain the addon ID {841468a1-d7f4-4bd3-84e6-bb0f13a06c64}

Comment 5

[Robert Helmer [:rhelmer]]

Attachment: small script to extract crashes via web service

Comment 6

[Robert Helmer [:rhelmer]]

Attachment: list of "bad" addons

Comment 7

[Robert Helmer [:rhelmer]]

Attachment: list of crash IDs checked

List of crash IDs checked for comment 4

Comment 8

[Robert Helmer [:rhelmer]]

There is nothing private in this post (uses publicly available data).

Comment 9

[Robert Helmer [:rhelmer]]

(In reply to Robert Helmer [:rhelmer] from comment #4)
> Using this query against prod Socorro DB:
> 
> SELECT uuid FROM reports WHERE signature = 'js::Shape::finalize'  
> OR signature = 'js::Shape::removeChild' 
> AND uptime < 60
> 
> I get 1671 total.

Actually the operator precedence is a little off here, this is binding as "WHERE a OR (b AND c)" when we want "WHERE (a OR b) AND c". The original run had this but it got dropped along the way, sorry about that.

This query should be:

SELECT uuid FROM reports
WHERE (signature = 'js::Shape::finalize'  OR signature = 'js::Shape::removeChild')
AND uptime < 60

It does not really change the outcome:

total: 1174
no addons: 9 of 1174 (0.008%)
"bad" addons: 8 of 1174 (0.007%)

Comment 10

[Robert Helmer [:rhelmer]]

Attachment: list of crash IDs checked

Comment 11

[Robert Helmer [:rhelmer]]

(In reply to Robert Helmer [:rhelmer] from comment #4)
> 175 of 1671 (0.1%) contain the addon ID
> {841468a1-d7f4-4bd3-84e6-bb0f13a06c64}

With the revised query from comment 9 this is:

171 of 1174 (0.15%) contain the addon ID {841468a1-d7f4-4bd3-84e6-bb0f13a06c64}