1175372 - build crash-analysis from puppet

Status: RESOLVED WONTFIX

(Socorro :: Infra, task)

Description

[Robert Helmer [:rhelmer]]

crash-analysis has had some customization during testing that we should capture in terraform+puppet:

* 500GB EBS volume mounted on /mnt/crashanalysis
* new user (and user crontab)
* new crontab entries in /etc/cron.d/socorro
** sync local reports up to S3
** sync S3 reports down to local volume

Comment 2

[Robert Helmer [:rhelmer]]

Historically, the socorroadmin box has performed a few functions (Correlation reports, and the daily CSV report) that would actually make more sense to have on the analysis server instead:

* crash-data-tools checked out in /data/crash-data-tools
** from https://hg.mozilla.org/users/dbaron_mozilla.com/crash-data-tools/
* new crontab entries in /etc/cron.d/socorro
** sync local reports to S3 bucket
** correlation report

Note that the rest are needed today, but should be removed soon in favor of bug 1158877:

* /data/bin/cron_daily_reports.sh (from old admin box)
* /data/socorro/application/scripts/config/{dailyurlconfig,commonconfig}.py
** copied from .dist
* new crontab entry in /etc/cron.d/socorro
** daily CSV report

(In reply to Robert Helmer [:rhelmer] from comment #0)
> ** sync S3 reports down to local volume

We actually don't need to do this bit now, since we've moved all report generation over.

I'll get all these files together into a PR, don't worry too much about the details yet :)

Comment 3

[Robert Helmer [:rhelmer]]

Need a few packages:

* hg
* awscli (pypi)

Comment 4

[Robert Helmer [:rhelmer]]

The daily CSV report also needs to have the old style /etc/socorro/common.conf with the following:

export database_name=''
export database_hostname=''
export database_username=''
export database_password=''

I've given it the replication DB.

Correlation reports we can run under envconsul (with some slight modifications).

Comment 5

[Robert Helmer [:rhelmer]]

jp, can you take this one?

Comment 6

[JP Schneider [:jp]]

I don't think we're looking to extend the life of crash analysis, but if I'm incorrect, please feel free to re-open.