478261 - way to analyze "site x seems really crashy for me the last few days"

Status: RESOLVED WONTFIX

(Socorro :: General, task)

Description

[chris hofmann]

things like
 http://crash-stats.mozilla.com/topcrasher/byurl/Firefox/3.0.5 

give us some tools to see which sites are most crashy, but we also need a way to spot recent trends on each of the major sites to find out if and when they might have introduced content that is generating more frequent crashes.

a simple matrix showing crashes each day for a given site might be the start of this

      site                     day  1  2  3  4  5  6  7  8  9 10

http://mail.google.com/mail/#inbox 10 12 20 11 10 19 17 49 52 47
http://espn.go.com/ #               9 13 17 12 12 16 20 19 49 47

but we could also do something more graphical and flag the sites that have large pct. increases 

ss and aking had more ideas.

Comment 1

[Laura Thomson :laura]

This looks like "explosive crashes for URLs".

Comment 2

[Robert Kaiser]

(In reply to Laura Thomson :laura from comment #1)
> This looks like "explosive crashes for URLs".

Yes, and we don't have URL-based reports any longer, right?

Comment 3

[chris hofmann]

We actually need some URLs to give us a better idea on test coverage and risk exposure on various channels.

I've been playing with some ideas based on some conversations with metrics folks lately and their analysis of beta users and may have more to say on what we should do here soon.

Comment 4

[chris hofmann]

Attachment: top-level-use-stats

here is the kind of report that would give us much better perspective on differences we see between channels and changes over time to help us answer questions and point to areas to investigate deeper...

for instance:

* are startup crashes happening more frequently lately on anyone or all of our channels?

* same for migration (post installation) crashes

* is there a change in the number of crashes that have URLs included?

* are facebook crashes on the rise as a pct. of total crashes.

* do we have a blind spot in the case where lack of facebook testing/crashes on the aurora or beta channel might no be reflective of the final release user population?

* same for other top sites like google, youtube, yahoo, yandex, international sites...

* are plugin hangs and crashes on the rise overall or on any channel?

* are dups different between channels, or rising overall?

Comment 5

[Lonnen :lonnen]

Some of this has been implemented in other tools, none of it will be implemented as a direct feature in socorro.