1014128 - Crontabberize regular data expiration in Socorro

Status: RESOLVED FIXED

(Socorro :: Database, task)

Description

[Selena Deckelmann :selenamarie :selena]

We now have a function that can clean up data without taking out a bazillion locks: 

drop_named_partition([oldest data to keep])

Put running of this on a weekly basis into our crontabber config.

Comment 1

[Selena Deckelmann :selenamarie :selena]

Have a look at socorro/cron/jobs/weekly_reports_partitions.py for a great example of what we are looking for in a new function to drop old partitions.

Also the tests for this are at: socorro/unittest/cron/jobs/test_weekly_reports_partitions.py

Comment 2

[Daniel Maher [:phrawzty]]

For reference, our data expiration policy is currently set to one (1) year.

Comment 3

[Daniel Maher [:phrawzty]]

https://github.com/mozilla/socorro/pull/2070

Comment 4

[[github robot]]

Commits pushed to master at https://github.com/mozilla/socorro

https://github.com/mozilla/socorro/commit/e422ea6cd2e901a040b1b39b33efd70168f175df
crontabberise drop_old_partitions; bug 1014128; attempt #2

https://github.com/mozilla/socorro/commit/47a4112cb7e69e9306d9582153dd03753718cf37
Merge pull request #2143 from phrawzty/bug1014128__again

fixes bug 1014128; crontabberise drop_old_partitions