Closed Bug 562236 Opened 16 years ago Closed 16 years ago

Public download stats have holes in the data

Categories

(addons.mozilla.org Graveyard :: Statistics, defect, P2)

Product:
addons.mozilla.org Graveyard
Component:
Statistics
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: osunick, Assigned: clouserw)

Details

(Whiteboard: [qa-])

View this link: https://addons.mozilla.org/en-US/statistics Show daily downloads over the past 90 days. Over the past 90 days, there have been six days with 0 downloads- it's affecting our weekly downloads and doesn't appear to be backfilling. Thoughts?
Priority: -- → P2
I think Daniel's stats are getting into the db, but our cron jobs are failing. I thought they were setup to backfill automatically, but maybe not. I will investigate!
Just to see if there was anything on my side, I tried to run a backfill for 2010-04-14, and it definitely sees data in the downloads table for that date. INFO 27-04 19:25:58,569 - Log deletes.0 - Deleted 7178 records from AMO master DB table download_counts for date = '2010-04-14' INFO 27-04 19:26:11,181 - Log inserts.0 - Inserted 7178 records to AMO master DB table download_counts matching criteria date = '2010-04-14' Let me know if there is anything I can do to help.
Hrm. I just realized that the timeline at the top shows a tooltip date of 2010-04-14 as having 0 downloads, but the table below it shows the 15th as having 0 downloads. Seems one of them is off by one. I double checked my export of the 15th also and it has 7175 records.
Assignee: deinspanjer → clouserw
Target Milestone: --- → 5.11
Alright then, this is caused when a cron job fails for whatever reason. I added a patch in http://github.com/jbalogh/zamboni/commit/98bf00f928393950cd2925d6107c9986af16da94 that makes it easy to rerun these if we need to. Looking at https://addons.mozilla.org/en-US/statistics/sitecsv/date I see some missing dates, so once 5.11 is live, I'll rerun the stats jobs for: 2010-04-25 2010-04-15 2010-04-04 2010-04-03 2010-04-02 2010-03-22 2010-03-21 2010-03-09 2010-03-07 Now that we rate limit our stats processing with celery I don't expect to need this again, but it'll be there if we need it. QA: Marking this [qa-] since you won't be able to see it's effect when 5.11 goes live.
Status: NEW → RESOLVED
Closed: 16 years ago
Resolution: --- → FIXED
Whiteboard: [qa-]
Product: addons.mozilla.org → addons.mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.