Closed Bug 836716 Opened 12 years ago Closed 12 years ago

Get ADI pushed and backfill missing Socorro aggregation data for 2013-01-30

Categories

(Data & BI Services Team :: DB: MySQL, task)

task
Not set
major

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: kairo, Assigned: mpressman)

Details

Aggregation data on Socorro prod for the 30th is missing, so we need to backfill that data for any crash analysis work to be done on it. Unfortunately, it looks like we still don't have the ADI yet, though, so that needs to be pushed by metrics first: breakpad=> SELECT max(date) FROM raw_adu; max ------------ 2013-01-29 (1 row)
I just checked and it looks like raw_adu now has the data from yesterday (I checked which product/version combinations have data for 2013-01-30 there and the list looks complete to me), so the backfill can be done.
Assignee: server-ops-database → mpressman
Running backfill now
Finished. breakpad=# select backfill_matviews('2013-01-30', '2013-01-30'); INFO: backfilling reports_clean INFO: backfilling 06:00:00 of reports_clean starting at 2013-01-30 00:00:00+00 CONTEXT: SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )" PL/pgSQL function backfill_matviews(date,date,boolean) line 52 at PERFORM INFO: backfilling 06:00:00 of reports_clean starting at 2013-01-30 06:00:00+00 CONTEXT: SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )" PL/pgSQL function backfill_matviews(date,date,boolean) line 52 at PERFORM INFO: backfilling 06:00:00 of reports_clean starting at 2013-01-30 12:00:00+00 CONTEXT: SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )" PL/pgSQL function backfill_matviews(date,date,boolean) line 52 at PERFORM INFO: backfilling 06:00:00 of reports_clean starting at 2013-01-30 18:00:00+00 CONTEXT: SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )" PL/pgSQL function backfill_matviews(date,date,boolean) line 52 at PERFORM INFO: backfilling other matviews for 2013-01-30 INFO: adu INFO: signatures INFO: tcbs NOTICE: table "new_tcbs" does not exist, skipping CONTEXT: SQL statement "DROP TABLE IF EXISTS new_tcbs" PL/pgSQL function backfill_matviews(date,date,boolean) line 66 at SQL statement INFO: crashes by user INFO: home page graph INFO: hang report (slow) INFO: nightly builds INFO: rank_compare INFO: explosiveness (slow) NOTICE: table "crash_madu" does not exist, skipping CONTEXT: SQL statement "DROP TABLE IF EXISTS crash_madu" PL/pgSQL function backfill_explosiveness(date) line 5 at SQL statement SQL statement "SELECT backfill_explosiveness(thisday)" PL/pgSQL function backfill_matviews(date,date,boolean) line 87 at PERFORM NOTICE: table "xtab_mult" does not exist, skipping CONTEXT: SQL statement "DROP TABLE IF EXISTS xtab_mult" PL/pgSQL function backfill_explosiveness(date) line 6 at SQL statement SQL statement "SELECT backfill_explosiveness(thisday)" PL/pgSQL function backfill_matviews(date,date,boolean) line 87 at PERFORM NOTICE: table "crash_xtab" does not exist, skipping CONTEXT: SQL statement "DROP TABLE IF EXISTS crash_xtab" PL/pgSQL function backfill_explosiveness(date) line 7 at SQL statement SQL statement "SELECT backfill_explosiveness(thisday)" PL/pgSQL function backfill_matviews(date,date,boolean) line 87 at PERFORM NOTICE: table "explosive_oneday" does not exist, skipping CONTEXT: SQL statement "DROP TABLE IF EXISTS explosive_oneday" PL/pgSQL function backfill_explosiveness(date) line 8 at SQL statement SQL statement "SELECT backfill_explosiveness(thisday)" PL/pgSQL function backfill_matviews(date,date,boolean) line 87 at PERFORM NOTICE: table "explosive_threeday" does not exist, skipping CONTEXT: SQL statement "DROP TABLE IF EXISTS explosive_threeday" PL/pgSQL function backfill_explosiveness(date) line 9 at SQL statement SQL statement "SELECT backfill_explosiveness(thisday)" PL/pgSQL function backfill_matviews(date,date,boolean) line 87 at PERFORM INFO: correlations backfill_matviews ------------------- t (1 row) breakpad=# SELECT max(date) FROM raw_adu; max ------------ 2013-01-30 (1 row)
Status: NEW → RESOLVED
Closed: 12 years ago
Resolution: --- → FIXED
Product: mozilla.org → Data & BI Services Team
You need to log in before you can comment on or make changes to this bug.