852776 - socorro crash-stats-dev only showing data through 2013-03-09

Status: RESOLVED DUPLICATE of bug 853179

(Data & BI Services Team :: DB: MySQL, task)

Description

[Matt Pressman [:mpressman]]

Although log output shows successful run of dev refresh cron, I'll manually re-run it to ensure completion.

Comment 1

[Matt Pressman [:mpressman]]

re-running dev refresh  now

Comment 2

[Matt Pressman [:mpressman]]

re-ran, no errors, yet max(date) from raw_adu still shows 2013-03-09

breakpad:5432# select max(date) from raw_adu;
    max
------------
 2013-03-09
(1 row)

The source server where it's extracting the minidb has the most recent data:
breakpad:5499# select max(date) from raw_adu;
    max
------------
 2013-03-18
(1 row)

The script /data/socorro/application/scripts/staging/loadMiniDBonDev.py may be where the problem is. I will investigate this.

Comment 3

[Matt Pressman [:mpressman]]

This may not be the script, but a different issue. lonnen pointed this out in irc:
[13:43:15] lonnen: mbrandt|mtg: mpressman: dev failures appear to be IOErrors when the processor tries to talk to hbase

Comment 4

[Matt Brandt [:mbrandt]]

Is this a duplicate of bug 853179?