Document/clarify what 'Crashes Per Active Daily User' means

VERIFIED FIXED in 1.7.8

Status

Socorro
General
VERIFIED FIXED
7 years ago
6 years ago

People

(Reporter: bjacob, Assigned: brandon)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(URL)

Attachments

(3 attachments, 1 obsolete attachment)

The graphs on the crash-stats home page are very hard to make sense of. What does the y-axis unit mean? How is 'Active Daily User' defined? Has every user really crashed twice in average? Does that include plugin crashes (I think it shouldn't)?

Some people say it's not per user but per-100-users, is that correct?

Maybe add a FAQ also explaining: why does the number of crashes per active daily user spike shortly after a release? Why do all 3 curves move together upwards/downwards on certain days?

Comment 1

7 years ago
I guess linking to a wiki page that describes "common trend patterns" or so would be a good idea for the latter part.

The others should added directly on the page as some sort of description to give people who don't know the intrincics knowledge what this really is about.
(Assignee)

Comment 2

6 years ago
Moving onto the 1.7.8 milestone.
Target Milestone: --- → 1.7.8
(Assignee)

Updated

6 years ago
Assignee: nobody → bsavage
I've documented this on the assumptions etc. wiki page, but there really needs to be something on the ADU page itself.
(Assignee)

Comment 4

6 years ago
Created attachment 529714 [details] [diff] [review]
Adding some sort of description

I used the text provided by jberkus on the assumptions page for the definition. It's placed in the search box so that users can understand the term, and effectively make decisions based on the definition. If you have a better place to put it, or improved wording, please r- and let me know what your thoughts are.
Attachment #529714 - Flags: review?(rhelmer)
Attachment #529714 - Flags: review?(rhelmer) → review+
(Assignee)

Comment 5

6 years ago
Fixed in revision 3134.
Status: NEW → RESOLVED
Last Resolved: 6 years ago
Resolution: --- → FIXED
(Reporter)

Comment 6

6 years ago
Hey! The patch here only adds a description that is certainly useful, but still the labeling of the axes of the graph shown on the crash-stats main page is not updated, and according to the clarification from your patch, it's wrong! (It should say "crashes per 100 ADUs" instead of "crashes per ADU" iiuc).
(In reply to comment #6)
> Hey! The patch here only adds a description that is certainly useful, but still
> the labeling of the axes of the graph shown on the crash-stats main page is not
> updated, and according to the clarification from your patch, it's wrong! (It
> should say "crashes per 100 ADUs" instead of "crashes per ADU" iiuc).

Reopening to cover this. We also have been discussing some open questions from comment 0:

(In reply to comment #0)
> The graphs on the crash-stats home page are very hard to make sense of. What
> does the y-axis unit mean? How is 'Active Daily User' defined? Has every user
> really crashed twice in average? Does that include plugin crashes (I think it
> shouldn't)?


It'd probably be clearer to track the plugin crash questions as a separate bug. If you want to drop by IRC (#breakpad) or post to mozilla.tools.socorro we can help figure out if this is a bug or more something for the FAQ.


> Some people say it's not per user but per-100-users, is that correct?
> 
> Maybe add a FAQ also explaining: why does the number of crashes per active
> daily user spike shortly after a release? Why do all 3 curves move together
> upwards/downwards on certain days?

It's not named clearly labeled a FAQ but I put a section about this in https://wiki.mozilla.org/Socorro/SocorroUI/Data_Assumptions_and_Gotchas#Crashes_per_ADU_spikes_shortly_after_a_release 

I don't believe we link that from the UI but we should consider doing so (perhaps renaming it to FAQ as well).

I think the remaining action for this bug is to correct labeling of the axes of the graph on the main home page dashboard, and to take any open questions to irc or the newsgroup (which should result either in more bugs filed or added to the FAQ).

Please let me know if I'm missing anything.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---

Comment 8

6 years ago
+1 for correct axes labeling.
(Assignee)

Comment 9

6 years ago
Created attachment 533415 [details] [diff] [review]
Adding improved labeling
Attachment #529714 - Attachment is obsolete: true
Attachment #533415 - Flags: review?(rhelmer)
Attachment #533415 - Flags: review?(rhelmer) → review+
(Assignee)

Updated

6 years ago
Status: REOPENED → RESOLVED
Last Resolved: 6 years ago6 years ago
Resolution: --- → FIXED
Created attachment 534945 [details]
Post-fix screenshot
Verified FIXED on:

https://crash-stats-dev.allizom.org/daily?form_selection=by_version&p=Firefox&v[]=5.0b1&throttle[]=100.00&v[]=6.0a1&throttle[]=100.00&v[]=4.2a1pre&throttle[]=100.00&v[]=4.0&throttle[]=10.00&hang_type=any&os[]=Windows&os[]=Mac&os[]=Linux&date_start=2011-05-09&date_end=2011-05-23&submit=Generate#
Status: RESOLVED → VERIFIED

Comment 12

6 years ago
(In reply to comment #10)
> Created attachment 534945 [details]
> Post-fix screenshot

Nice - same on the front page graph?
(In reply to comment #12)
> (In reply to comment #10)
> > Created attachment 534945 [details]
> > Post-fix screenshot
> 
> Nice - same on the front page graph?

Crud; missed that -- reopening, sorry.
Status: VERIFIED → REOPENED
Resolution: FIXED → ---
(Assignee)

Comment 14

6 years ago
Fixed in Subversion revision 3175.
Status: REOPENED → RESOLVED
Last Resolved: 6 years ago6 years ago
Resolution: --- → FIXED
Looks good on https://crash-stats-dev.allizom.org/products/Thunderbird/versions/3.1.9, https://crash-stats-dev.allizom.org/products/Firefox, etc.

Kairo, mind giving it an additional once-over?
Created attachment 535177 [details]
Post-fix screenshot (for the product version's homepage)
Verified FIXED per comment 15, comment 16.
Status: RESOLVED → VERIFIED
Thanks!
Component: Socorro → General
Product: Webtools → Socorro
You need to log in before you can comment on or make changes to this bug.