488402 - Production Socorro topcrashbyurlfacts table add unique constraint and remove duplicates

Status: RESOLVED FIXED

(Socorro :: General, task)

Description

[Austin King [:ozten]]

In the last 2 days the topcrashbyurlfacts grew by 35x. The mtbffacts table experience similar exponential growth.

We need to add unique constraint to topcrashbyurlfacts on
day, productdims_id, urldims_id, and signaturedims_id


We need to add unique constraint to mtbffacts on
day, productdims_id

In order to do this we will probably need to cleanup the data first, then add the constraints.

Comment 1

[Austin King [:ozten]]

production has deleted all data for bad days.
delete from mtbffacts where day = '2009-04-11' or day = '2009-04-12' or day = '2009-04-13';

Comment 2

[Frank Griswold [:griswolf] [:fgriswold]]

Just a note to remember we need to update schema.py to reflect added unique constraints