836716 - Get ADI pushed and backfill missing Socorro aggregation data for 2013-01-30

Status: RESOLVED FIXED

(Data & BI Services Team :: DB: MySQL, task)

Description

[Robert Kaiser]

Aggregation data on Socorro prod for the 30th is missing, so we need to backfill that data for any crash analysis work to be done on it.

Unfortunately, it looks like we still don't have the ADI yet, though, so that needs to be pushed by metrics first:

breakpad=> SELECT max(date) FROM raw_adu;
    max     
------------
 2013-01-29
(1 row)

Comment 1

[Robert Kaiser]

I just checked and it looks like raw_adu now has the data from yesterday (I checked which product/version combinations have data for 2013-01-30 there and the list looks complete to me), so the backfill can be done.

Comment 2

[Matt Pressman [:mpressman]]

Running backfill now

Comment 3

[Matt Pressman [:mpressman]]

Finished.

breakpad=# select backfill_matviews('2013-01-30', '2013-01-30');
INFO:  backfilling reports_clean
INFO:  backfilling 06:00:00 of reports_clean starting at 2013-01-30 00:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function backfill_matviews(date,date,boolean) line 52 at PERFORM
INFO:  backfilling 06:00:00 of reports_clean starting at 2013-01-30 06:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function backfill_matviews(date,date,boolean) line 52 at PERFORM
INFO:  backfilling 06:00:00 of reports_clean starting at 2013-01-30 12:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function backfill_matviews(date,date,boolean) line 52 at PERFORM
INFO:  backfilling 06:00:00 of reports_clean starting at 2013-01-30 18:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function backfill_matviews(date,date,boolean) line 52 at PERFORM
INFO:  backfilling other matviews for 2013-01-30
INFO:  adu
INFO:  signatures
INFO:  tcbs
NOTICE:  table "new_tcbs" does not exist, skipping
CONTEXT:  SQL statement "DROP TABLE IF EXISTS new_tcbs"
PL/pgSQL function backfill_matviews(date,date,boolean) line 66 at SQL statement
INFO:  crashes by user
INFO:  home page graph
INFO:  hang report (slow)
INFO:  nightly builds
INFO:  rank_compare
INFO:  explosiveness (slow)
NOTICE:  table "crash_madu" does not exist, skipping
CONTEXT:  SQL statement "DROP TABLE IF EXISTS crash_madu"
PL/pgSQL function backfill_explosiveness(date) line 5 at SQL statement
SQL statement "SELECT backfill_explosiveness(thisday)"
PL/pgSQL function backfill_matviews(date,date,boolean) line 87 at PERFORM
NOTICE:  table "xtab_mult" does not exist, skipping
CONTEXT:  SQL statement "DROP TABLE IF EXISTS xtab_mult"
PL/pgSQL function backfill_explosiveness(date) line 6 at SQL statement
SQL statement "SELECT backfill_explosiveness(thisday)"
PL/pgSQL function backfill_matviews(date,date,boolean) line 87 at PERFORM
NOTICE:  table "crash_xtab" does not exist, skipping
CONTEXT:  SQL statement "DROP TABLE IF EXISTS crash_xtab"
PL/pgSQL function backfill_explosiveness(date) line 7 at SQL statement
SQL statement "SELECT backfill_explosiveness(thisday)"
PL/pgSQL function backfill_matviews(date,date,boolean) line 87 at PERFORM
NOTICE:  table "explosive_oneday" does not exist, skipping
CONTEXT:  SQL statement "DROP TABLE IF EXISTS explosive_oneday"
PL/pgSQL function backfill_explosiveness(date) line 8 at SQL statement
SQL statement "SELECT backfill_explosiveness(thisday)"
PL/pgSQL function backfill_matviews(date,date,boolean) line 87 at PERFORM
NOTICE:  table "explosive_threeday" does not exist, skipping
CONTEXT:  SQL statement "DROP TABLE IF EXISTS explosive_threeday"
PL/pgSQL function backfill_explosiveness(date) line 9 at SQL statement
SQL statement "SELECT backfill_explosiveness(thisday)"
PL/pgSQL function backfill_matviews(date,date,boolean) line 87 at PERFORM
INFO:  correlations
 backfill_matviews 
-------------------
 t
(1 row)

breakpad=# SELECT max(date) FROM raw_adu;
    max     
------------
 2013-01-30
(1 row)