1164519 - expire missing_symbols and raw_crashes tables

Status: RESOLVED FIXED

(Socorro :: Database, task)

Description

[Robert Helmer [:rhelmer]]

We're seeing performance problems and there hasn't been any cleanup on old tables in a good long while, missing_symbols is good low-hanging-fruit

Comment 1

[Robert Helmer [:rhelmer]]

Going to drop the following:

missing_symbols_20140512
missing_symbols_20140519
missing_symbols_20140526
missing_symbols_20140602
missing_symbols_20140609
missing_symbols_20140616
missing_symbols_20140623
missing_symbols_20140630
missing_symbols_20140707
missing_symbols_20140714
missing_symbols_20140721
missing_symbols_20140728
missing_symbols_20140804
missing_symbols_20140811
missing_symbols_20140818
missing_symbols_20140825
missing_symbols_20140901
missing_symbols_20140908
missing_symbols_20140915
missing_symbols_20140922
missing_symbols_20140929
missing_symbols_20141006
missing_symbols_20141013
missing_symbols_20141020
missing_symbols_20141027
missing_symbols_20141103
missing_symbols_20141110
missing_symbols_20141117
missing_symbols_20141124
missing_symbols_20141201
missing_symbols_20141208
missing_symbols_20141215
missing_symbols_20141222
missing_symbols_20141229
missing_symbols_20150105
missing_symbols_20150112
missing_symbols_20150119
missing_symbols_20150126
missing_symbols_20150202
missing_symbols_20150209
missing_symbols_20150216
missing_symbols_20150223

Comment 2

[Robert Helmer [:rhelmer]]

Done, we are now left with:

                    List of relations
 Schema |           Name           | Type  |    Owner    
--------+--------------------------+-------+-------------
 public | missing_symbols          | table | breakpad_rw
 public | missing_symbols_20150302 | table | breakpad_rw
 public | missing_symbols_20150309 | table | breakpad_rw
 public | missing_symbols_20150316 | table | breakpad_rw
 public | missing_symbols_20150323 | table | breakpad_rw
 public | missing_symbols_20150330 | table | breakpad_rw
 public | missing_symbols_20150406 | table | breakpad_rw
 public | missing_symbols_20150413 | table | breakpad_rw
 public | missing_symbols_20150420 | table | breakpad_rw
 public | missing_symbols_20150427 | table | breakpad_rw
 public | missing_symbols_20150504 | table | breakpad_rw
 public | missing_symbols_20150511 | table | breakpad_rw
 public | missing_symbols_20150518 | table | breakpad_rw
 public | missing_symbols_20150525 | table | breakpad_rw
 public | missing_symbols_20150601 | table | breakpad_rw
 public | missing_symbols_20150608 | table | breakpad_rw
 public | missing_symbols_20150615 | table | breakpad_rw
 public | missing_symbols_20150622 | table | breakpad_rw
 public | missing_symbols_20150629 | table | breakpad_rw
 public | missing_symbols_20150706 | table | breakpad_rw
 public | missing_symbols_20150713 | table | breakpad_rw
 public | missing_symbols_20150720 | table | breakpad_rw
 public | missing_symbols_20150727 | table | breakpad_rw
 public | missing_symbols_20150803 | table | breakpad_rw
 public | missing_symbols_20150810 | table | breakpad_rw
 public | missing_symbols_20150817 | table | breakpad_rw
 public | missing_symbols_20150824 | table | breakpad_rw
 public | missing_symbols_20150831 | table | breakpad_rw
 public | missing_symbols_20150907 | table | breakpad_rw
 public | missing_symbols_20150914 | table | breakpad_rw
 public | missing_symbols_20150921 | table | breakpad_rw
 public | missing_symbols_20150928 | table | breakpad_rw
 public | missing_symbols_20151005 | table | breakpad_rw
 public | missing_symbols_20151012 | table | breakpad_rw
 public | missing_symbols_20151019 | table | breakpad_rw
 public | missing_symbols_20151026 | table | breakpad_rw
 public | missing_symbols_20151102 | table | breakpad_rw
 public | missing_symbols_20151109 | table | breakpad_rw
 public | missing_symbols_20151116 | table | breakpad_rw
 public | missing_symbols_20151123 | table | breakpad_rw
 public | missing_symbols_20151130 | table | breakpad_rw
 public | missing_symbols_20151207 | table | breakpad_rw
 public | missing_symbols_20151214 | table | breakpad_rw
 public | missing_symbols_20151221 | table | breakpad_rw
 public | missing_symbols_20151228 | table | breakpad_rw
 public | missing_symbols_20160104 | table | breakpad_rw
 public | missing_symbols_20160111 | table | breakpad_rw
 public | missing_symbols_20160118 | table | breakpad_rw
 public | missing_symbols_20160125 | table | breakpad_rw
 public | missing_symbols_20160201 | table | breakpad_rw
 public | missing_symbols_20160208 | table | breakpad_rw
 public | missing_symbols_20160215 | table | breakpad_rw
 public | missing_symbols_20160222 | table | breakpad_rw
 public | missing_symbols_20160229 | table | breakpad_rw
 public | missing_symbols_20160307 | table | breakpad_rw
 public | missing_symbols_20160314 | table | breakpad_rw
 public | missing_symbols_20160321 | table | breakpad_rw
 public | missing_symbols_20160328 | table | breakpad_rw
(58 rows)

Comment 3

[Robert Helmer [:rhelmer]]

We're starting to have similar issues today, expiring more data:

* raw_crashes partitions from last year
* missing_symbols up to the last few months

I also noticed that the missing_symbols parent table itself is quite large, probably from the time before we had partitions from it. Removing some old data from there as well.