855678 - Backfill missing Socorro aggregation data for 2013-03-27

Status: RESOLVED FIXED

(Data & BI Services Team :: DB: MySQL, task)

Description

[Robert Kaiser]

Aggregation data on Socorro prod for the 27th is missing again, so we need to backfill that data for any crash analysis work to be done on it.

Comment 1

[Robert Kaiser]

Hrm, we don't even have ADI yet:

breakpad=> SELECT max(date) FROM raw_adu;
    max     
------------
 2013-03-26
(1 row)

Comment 2

[Sheeri Cabral [:sheeri]]

I don't think we have ADU from metrics yet:

breakpad=# SELECT max(date) FROM raw_adu;
    max     
------------
 2013-03-26
(1 row)

Time: 11.910 ms
breakpad=# select backfill_adu('2013-03-27');
 backfill_adu 
--------------
 t
(1 row)

Time: 68.278 ms
breakpad=# SELECT max(date) FROM raw_adu;
    max     
------------
 2013-03-26
(1 row)

Time: 0.432 ms
breakpad=#

Comment 3

[Robert Kaiser]

Looks better now:

breakpad=> SELECT max(date) FROM raw_adu;
    max     
------------
 2013-03-27
(1 row)

Comment 4

[Laura Thomson :laura]

that means backfill is ready to run - sheeri?

Comment 5

[Sheeri Cabral [:sheeri]]

Backfill in progress:

breakpad=# select backfill_matviews('2013-03-27','2013-03-27');
INFO:  backfilling reports_clean
INFO:  backfilling 06:00:00 of reports_clean starting at 2013-03-27 00:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function backfill_matviews(date,date,boolean) line 52 at PERFORM
INFO:  backfilling 06:00:00 of reports_clean starting at 2013-03-27 06:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function backfill_matviews(date,date,boolean) line 52 at PERFORM

INFO:  backfilling 06:00:00 of reports_clean starting at 2013-03-27 12:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function backfill_matviews(date,date,boolean) line 52 at PERFORM
INFO:  backfilling 06:00:00 of reports_clean starting at 2013-03-27 18:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function backfill_matviews(date,date,boolean) line 52 at PERFORM
INFO:  backfilling other matviews for 2013-03-27
INFO:  adu
INFO:  signatures

Comment 6

[Sheeri Cabral [:sheeri]]

Backfill complete, memcached restarted on webheads.

Time: 3918235.147 ms