459027 - "Last Day Count" is not counting all daily downloads

Status: RESOLVED FIXED

(addons.mozilla.org Graveyard :: Statistics, defect)

Description

[Simon Paquet [:sipaq]]

I've been observing this for quite some time, but never got around to file a bug.

These are the total download counts of Lightning (2313) for the last few days:

2008-10-03  2.470.811
2008-10-04  2.474.466  (+3.655)
2008-10-05  2.478.433  (+3.967)
2008-10-06  2.484.340  (+5.907)
2008-10-07  2.485.617  (+1.277)


Compare this with last four daily counts:

2008-10-04  3.596  (-59)
2008-10-05  4.266  (+299)
2008-10-06  5.418  (-489)
2008-10-07    865  (-412)

I can't find any obvious pattern in this. Maybe you can...

Comment 1

[Simon Paquet [:sipaq]]

Interesting:

The daily download counts seem to be generated anew every day for the last few days, because when I look at the csv output from today, it looks totally different than yesterday's output:

Date          Yesterday's output      Today's output      Difference
2008-10-04           3596                  3596                 0
2008-10-05           4266                  4266                 0
2008-10-06           5418                  5946              +528
2008-10-07            865                  5806             +4959  
2008-10-08                                 4998

This seems to correspond somehow with the Total downloads number. Which yesterday was at 2,485,617 and today is at 2,496,084. That's a difference of 10,467, which at least seems to nearly correspond with the added volume of 528+4959+4998 which sums up as 10,485.

Comment 2

[Michael Morgan [:morgamic]]

We had some blips in stats, but there were fixed with bug 456687.  Please reopen if you still see issues.

Comment 3

[Simon Paquet [:sipaq]]

I don't think that this is in any way related. As I said in comment 0, I've seen this for quite some time, but never got around to actually file a bug.

So looking at the last 10 days I see the following:

Date           AMO numbers      My numbers      Difference
2008-10-21        5629             5623            -6
2008-10-22        5672             5637            -35
2008-10-23        5434             5484            +50
2008-10-24        5273             5400            +127
2008-10-25        4649             4780            +131
2008-10-26        3481             3556            +75
2008-10-27        4082             3880            -202
2008-10-28        5383             5330            -53
2008-10-29        5507             5476            -31
2008-10-30        4855             5748            +897
----------        ----             ----            ----
Total            49965            50913            +948 

My numbers = Total downloads today  MINUS  Total downloads yesterday

Comment 4

[Michael Morgan [:morgamic]]

So first, we're looking at < 2% deviation over a 10 day period.  Second, seems that "today" is off by more than the others pretty consistently.  If you take out 10-30 we're looking at a tenth of a percent deviation.

Justin wrote a monitoring script in bug 453924, so we'll know if the deviation is off by a significant amount.  Of course we're curious about what is causing this but won't spend time on this unless it becomes worse.

Comment 5

[Wil Clouser [:clouserw]]

I've looked at this over the past few days for the Lightning add-on and the numbers are completely consistent for me.  I think this is fixed with our new stats handling code.  Let me know if you think differently.