Closed Bug 745731 Opened 12 years ago Closed 12 years ago

Daily crash data CSVs missing for April 14th and 15th

Categories

(mozilla.org Graveyard :: Server Operations, task)

Product:
mozilla.org Graveyard
Component:
Server Operations
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
VERIFIED FIXED

People

(Reporter: kairo, Assigned: dumitru)

Details

https://crash-analysis.mozilla.com/crash_analysis/20120414/ doesn't contain a daily crash data CSV (*-pub-crashdata.csv.gz), and https://crash-analysis.mozilla.com/crash_analysis/20120415/ doesn't even exist.

I guess the Socorro outage this weekend affected the cron jobs and those CSVs weren't created correctly.
Marcia, Sheila: FYI, this bug is why my reports (and probably chofmann's) don't exist for those days, we'll probably need to re-run our scripts for those days when this bug is fixed.
Assignee: nobody → server-ops
Component: Backend → Server Operations
Product: Socorro → mozilla.org
QA Contact: backend → phong
Version: unspecified → other
This script needs to be copied and modified, and run as "socorro" user on sp-admin01:

/data/bin/cron_daily_reports.sh

There are 4 spots in this script where this is used:
date -d "1 days ago"

This needs to be run for the 14th and the 15th, probably easiest to just copy and modify the script to run "2 days ago" then "3 days ago".

I'll file a bug to pull this script into socorro and clean it up, make date overrideable as an arg etc.
(In reply to Robert Helmer [:rhelmer] from comment #2)
> This needs to be run for the 14th and the 15th, probably easiest to just
> copy and modify the script to run "2 days ago" then "3 days ago".

It's just "2 days ago" in addition to a re-run for "1 days ago", right? The 15th is yesterday. :)
(In reply to Robert Kaiser (:kairo@mozilla.com) from comment #3)
> (In reply to Robert Helmer [:rhelmer] from comment #2)
> > This needs to be run for the 14th and the 15th, probably easiest to just
> > copy and modify the script to run "2 days ago" then "3 days ago".
> 
> It's just "2 days ago" in addition to a re-run for "1 days ago", right? The
> 15th is yesterday. :)

Yes that's right, thanks :)
Filed bug 745830 to make this simpler in the future.
Assignee: server-ops → dgherman
It looks like permissions for those files are off:

gzip: /mnt/crashanalysis/crash_analysis/20120414/20120414-pub-crashdata.csv.gz: Permission denied
gzip: /mnt/crashanalysis/crash_analysis/20120415/20120415-pub-crashdata.csv.gz: Permission denied

That's accessing them as rkaiser. The file from the 16th seems to be accessible though.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
[root@sp-admin01.phx1 crash_analysis]# chmod 644 20120414/20120414-pub-crashdata.csv.gz
[root@sp-admin01.phx1 crash_analysis]# chmod 644 20120415/20120415-pub-crashdata.csv.gz
Status: REOPENED → RESOLVED
Closed: 12 years ago → 12 years ago
Resolution: --- → FIXED
Verified, my report scripts can work with the data now! :)
Status: RESOLVED → VERIFIED
Product: mozilla.org → mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.