993237 - Aggregate Link data after 90 days

Status: VERIFIED FIXED

(Firefox Affiliates Graveyard :: affiliates.mozilla.org, defect)

Description

[Osmose [:osmose, :mkelly]]

Metric counts older than 90 days should be aggregated and removed from the Datapoint table. Currently, the click update script simply continues to add more and more datapoints without aggregating old data. It might be useful to make a separate management command to do this instead of updating the existing one, but it may not matter either way.

Comment 1

[Justin Crawford [:hoosteeno] [:jcrawford]]

This bug is incorporated in the Affiliates 2.0 release currently live in dev: https://affiliates-dev.allizom.org/

Comment 2

[Osmose [:osmose, :mkelly]]

While this is marked as [qa-] (as there's no reasonable way for QA to test this), we still need to track this up to 90 days after launch so we can confirm that the data is being aggregated properly in production.

Should I just set a calendar reminder? :P

Comment 3

[Matt Brandt [:mbrandt]]

Are we able to test this by using a smaller time window than the 90 days?

Comment 4

[Osmose [:osmose, :mkelly]]

I could play around with the database and set some false data. But then I'd just wait 10 minutes and verify the data's gone from the database, because there's no user-visible or admin-visible output from the aggregation process right now.

I'd still like to have a 90-day reminder but that would probably be good enough to call this verified. Shall I?

Comment 5

[Justin Crawford [:hoosteeno] [:jcrawford]]

+1

Comment 6

[Osmose [:osmose, :mkelly]]

Verified manually, I created a datapoint for 91 days ago with 4 clicks, the datapoint was successfully removed and added to the aggregate amount of clicks for the link.