ADU and aggregation data missing for 2012-10-24

RESOLVED FIXED

Status

Data & BI Services Team
DB: MySQL
RESOLVED FIXED
5 years ago
3 years ago

People

(Reporter: Robert Kaiser, Unassigned)

Tracking

Details

(Reporter)

Description

5 years ago
I saw today that once again we are missing aggregated (graph etc.) data for yesterday.

Before we can backfill, we need to get ADU data, though, as that seems to still be missing:

breakpad=> SELECT max(date) FROM raw_adu;
    max     
------------
 2012-10-23
(1 row)
There was an error with the EOD process.  We fixed it just a bit ago and the EOD succeeded and the exports are running now.  They should be done within 30 minutes.
The data was successfully exported to production.  Staging should be finished in a few moments as well.
Status: NEW → RESOLVED
Last Resolved: 5 years ago
Resolution: --- → FIXED

Comment 3

5 years ago
These should be in now (ADUs were late form Metrics)

Bumping over to DB ops for backfill for yesterday.

Updated

5 years ago
Assignee: nobody → server-ops-database
Status: RESOLVED → REOPENED
Component: General → Server Operations: Database
Product: Socorro → mozilla.org
QA Contact: cshields
Resolution: FIXED → ---
Version: unspecified → other
backfill in progress:

breakpad=# select backfill_adu('2012-10-24'); backfill_adu 
--------------
 t
(1 row)

breakpad=# select backfill_matviews('2012-10-24');
INFO:  backfilling reports_clean
INFO:  backfilling 06:00:00 of reports_clean starting at 2012-10-24 00:00:00+00
CONTEXT:  SQL statement "SELECT backfill_reports_clean( first_rc, last_rc )"
PL/pgSQL function "backfill_matviews" line 51 at PERFORM
Backfill complete.
forgot to restart the memcache webheads but at this point they should be good.
Status: REOPENED → RESOLVED
Last Resolved: 5 years ago5 years ago
Resolution: --- → FIXED
running backfill again to account for issue where two dates are now required, even for just one day's run
(Reporter)

Comment 8

5 years ago
Reopening for comment #7 - Matt, can you close the bug again when that's finished and memcache has been restarted?
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
(Reporter)

Comment 9

5 years ago
The backfill run by mpressman was successful, thanks.
Status: REOPENED → RESOLVED
Last Resolved: 5 years ago5 years ago
Resolution: --- → FIXED
Product: mozilla.org → Data & BI Services Team
You need to log in before you can comment on or make changes to this bug.