516843 - Please add Topcrash by URL/Domain reports for current Camino versions

Status: RESOLVED FIXED

(Socorro :: General, task)

Description

[Smokey Ardisson (offline for a while; not following bugs - do not email)]

Current Camino versions include the ability to report URLs, so we'd like to get the topcrash by URL/domain reports running.

Right now we'd like reports for 2.0b4, 2.0b5pre, and 2.1a1pre (2.0b4 and 2.0b5pre will start reporting tonight/tomorrow, so initially there'll be no data; 2.1a1pre has been reporting URLs for a few weeks now).

From other bugs, it looks like the SQL for this is:

INSERT INTO productdims (product, version, os_name, release) VALUES ('Camino', '2.0b4', 'ALL','milestone');
INSERT INTO productdims (product, version, os_name, release) VALUES ('Camino', '2.0b4', 'Mac','milestone');
INSERT INTO productdims (product, version, os_name, release) VALUES ('Camino', '2.0b5pre', 'ALL','development');
INSERT INTO productdims (product, version, os_name, release) VALUES ('Camino', '2.0b5pre', 'Mac','development');
INSERT INTO productdims (product, version, os_name, release) VALUES ('Camino', '2.1a1pre', 'ALL','development');
INSERT INTO productdims (product, version, os_name, release) VALUES ('Camino', '2.1a1pre', 'Mac','development');

INSERT INTO tcbyurlconfig (productdims_id, enabled) 
  SELECT id, 'Y' FROM productdims WHERE product = 'Camino' AND version = '2.0b4' AND os_name = 'ALL';
INSERT INTO tcbyurlconfig (productdims_id, enabled) 
  SELECT id, 'Y' FROM productdims WHERE product = 'Camino' AND version = '2.0b5pre' AND os_name = 'ALL';
INSERT INTO tcbyurlconfig (productdims_id, enabled) 
  SELECT id, 'Y' FROM productdims WHERE product = 'Camino' AND version = '2.1a1pre' AND os_name = 'ALL';

Austin, I'd appreciate it if you could sanity-check that SQL for me first :)  Thanks!

Comment 1

[K Lars Lohn [:lars] [:klohn]]

We're in the midst of deploying a completely new system for the top crash reports.  The migration to the new system has already begun, so we will have to add these items after the completion of the migration.  The migration is slated for a push to production on Thursday.

griswolf: please translate the SQL above into SQL appropriate for the new schema and post it as an attachment to this bug.  Once the production push is complete, then we'll open another IT bug to get these added.

Comment 2

[Frank Griswold [:griswolf] [:fgriswold]]

productdims now contains the (gecko) branch. Probably something like 1.9.1 (or a bit more recent). Please specify that for each of the versions mentioned above. Thanks. (Can someone forward this request to Smokey if needed?)

Comment 3

[Frank Griswold [:griswolf] [:fgriswold]]

Also need to ask: How long do we want to collect statistics on these versions? By default: 60 days for mtbf, and 90 days for other stats. We are now using a start_date and end_date to specify these for all but mtbf (which starts with start_date and stops 60 days later). Unless I hear otherwise, we'll use 2009-09-15 as start_date and 2009-12-14 as end_date.

Comment 4

[Stuart Morgan]

Gecko branch for all three is 1.9.0
90 days is good for b4 and b5pre, 150 for 2.1a1pre

Comment 5

[Frank Griswold [:griswolf] [:fgriswold]]

Attachment: Adds visibility and productdims data for three Camino versions

The script is very verbose

Comment 6

[Smokey Ardisson (offline for a while; not following bugs - do not email)]

Looks like you guys did this recently; the reports are there, though for some reason we have very few URLs in comparison to crash reports.

I.e. for Camino 2.0b4, this morning we have 90+ crash reports in the "past week" (but really since Friday, which is when we released) http://crash-stats.mozilla.com/query/query?do_query=1&product=Camino&version=Camino%3A2.0b4 but the URL report http://crash-stats.mozilla.com/topcrasher/byurl/Camino/2.0b4
shows only 4 URLs consisting of 5 signatures with 1 crash each.

Comment 7

[K Lars Lohn [:lars] [:klohn]]

yes, we can see that there is an anomaly here.  We're also seeing a complete lack of signature information being gathered for the trend reports for Camino.  We're looking into it...

Comment 8

[Smokey Ardisson (offline for a while; not following bugs - do not email)]

Since last night's upgrade didn't seem to fix comment 6/7 like it did the by-signature report, I spun those comments off into bug 528635 for better tracking (especially since the original issue here, creation of the reports, was indeed fixed).