If you think a bug might affect users in the 57 release, please set the correct tracking and status flags for Release Management.

Need backfill for Socorro

RESOLVED FIXED

Status

Data & BI Services Team
DB: MySQL
--
blocker
RESOLVED FIXED
5 years ago
3 years ago

People

(Reporter: laura, Assigned: sheeri)

Tracking

Details

(Reporter)

Description

5 years ago
Looks like we had a problem with crontabber last night and need to urgently manually run aggregates for last night to supply data on this week's release.
This involves running the backfill_matviews SP.
(Assignee)

Comment 1

5 years ago
breakpad=# select backfill_adu('2012-07-18');
 backfill_adu 
--------------
 t
(1 row)

breakpad=# select update_adu('2012-07-18');
ERROR:  update_adu has already been run for 2012-07-18

breakpad=# SELECT backfill_matviews('2012-07-18','2012-07-18');
INFO:  backfilling reports_clean
INFO:  backfilling 06:00:00 of reports_clean starting at 2012-07-18 00:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function "backfill_matviews" line 48 at PERFORM

(still running)
(Assignee)

Updated

5 years ago
Assignee: server-ops-database → scabral
(Assignee)

Comment 2

5 years ago
breakpad=# SELECT backfill_matviews('2012-07-18','2012-07-18');
INFO:  backfilling reports_clean
INFO:  backfilling 06:00:00 of reports_clean starting at 2012-07-18 00:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function "backfill_matviews" line 48 at PERFORM
INFO:  backfilling 06:00:00 of reports_clean starting at 2012-07-18 06:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function "backfill_matviews" line 48 at PERFORM
INFO:  backfilling 06:00:00 of reports_clean starting at 2012-07-18 12:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function "backfill_matviews" line 48 at PERFORM
INFO:  backfilling 06:00:00 of reports_clean starting at 2012-07-18 18:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function "backfill_matviews" line 48 at PERFORM
INFO:  backfilling 06:00:00 of reports_clean starting at 2012-07-19 00:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function "backfill_matviews" line 48 at PERFORM
INFO:  backfilling 05:00:00 of reports_clean starting at 2012-07-19 06:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function "backfill_matviews" line 48 at PERFORM
INFO:  backfilling other matviews for 2012-07-18
INFO:  adu
INFO:  tcbs
NOTICE:  table "new_tcbs" does not exist, skipping
CONTEXT:  SQL statement "DROP TABLE IF EXISTS new_tcbs"
PL/pgSQL function "backfill_matviews" line 58 at SQL statement
INFO:  daily crashes
INFO:  signatures
INFO:  hang report
(Assignee)

Comment 3

5 years ago
[11:12:37] <sheeri> rhelmer I am worried a bit about NOTICE:  table "new_tcbs" does not exist, skipping
[11:14:09] <rhelmer> sheeri: hmm looks ok, after backfill_tcbs(thisday) it does DROP TABLE IF EXISTS new_tcbs
[11:14:18] <rhelmer> sheeri: i don't see new_tcbs mentioned anywhere else
(Assignee)

Comment 4

5 years ago
Finished, memcached restarted:


breakpad=#  SELECT backfill_matviews('2012-07-18','2012-07-18');
INFO:  backfilling reports_clean
INFO:  backfilling 06:00:00 of reports_clean starting at 2012-07-18 00:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function "backfill_matviews" line 48 at PERFORM
INFO:  backfilling 06:00:00 of reports_clean starting at 2012-07-18 06:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function "backfill_matviews" line 48 at PERFORM
INFO:  backfilling 06:00:00 of reports_clean starting at 2012-07-18 12:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function "backfill_matviews" line 48 at PERFORM
INFO:  backfilling 06:00:00 of reports_clean starting at 2012-07-18 18:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function "backfill_matviews" line 48 at PERFORM
INFO:  backfilling 06:00:00 of reports_clean starting at 2012-07-19 00:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function "backfill_matviews" line 48 at PERFORM
INFO:  backfilling 06:00:00 of reports_clean starting at 2012-07-19 06:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function "backfill_matviews" line 48 at PERFORM
INFO:  backfilling other matviews for 2012-07-18
INFO:  adu
INFO:  tcbs
NOTICE:  table "new_tcbs" does not exist, skipping
CONTEXT:  SQL statement "DROP TABLE IF EXISTS new_tcbs"
PL/pgSQL function "backfill_matviews" line 58 at SQL statement
INFO:  daily crashes
INFO:  signatures
INFO:  hang report
INFO:  nightly builds
INFO:  rank_compare
INFO:  correlations
 backfill_matviews 
-------------------
 t
(1 row)

breakpad=#
Status: NEW → RESOLVED
Last Resolved: 5 years ago
Resolution: --- → FIXED
Product: mozilla.org → Data & BI Services Team
You need to log in before you can comment on or make changes to this bug.