706314 - Deploy script should send an e-mail

Status: RESOLVED WORKSFORME

(Socorro :: Infra, task)

Description

[Lonnen :lonnen]

We've talked about adding this to stage, but I think it would also be valuable to add to production deployments as well. Our deploy process should send an e-mail automatically to the socorro-dev mailing list. Keep the message simple and filterable, i.e. `{tag} pushed to {stage|prod}`

Comment 1

[Robert Helmer [:rhelmer]]

(In reply to Chris Lonnen :lonnen from comment #0)
> We've talked about adding this to stage, but I think it would also be
> valuable to add to production deployments as well. Our deploy process should
> send an e-mail automatically to the socorro-dev mailing list. Keep the
> message simple and filterable, i.e. `{tag} pushed to {stage|prod}`

The way this works right now is that there is an install script in the private puppet (svn) repo at /data/bin/update-socorro.sh which takes an URL to a socorro.tar.gz as the only argument.

crash-stats dev runs this from cron (with the URL /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-master/lastSuccessfulBuild/artifact/socorro.tar.gz) and stage/prod are installed by IT (running the same script, but with a specific build number instead of the "lastSuccessfulBuild" symlink).

The last thing this script does is:

echo "Socorro build installed successfully!"
echo "Downloaded from ${URL}"
echo "Checksum: ${NEW_CSUM}"
echo "Backed up original to /data/socorro.${DATE}"

So the sysadmin or cronmail sees this but no one else does.

We can easily have the script send an email. I agree that we should keep it simple/filterable.

Comment 2

[Robert Helmer [:rhelmer]]

(In reply to Chris Lonnen :lonnen from comment #0)
> We've talked about adding this to stage, but I think it would also be
> valuable to add to production deployments as well. Our deploy process should
> send an e-mail automatically to the socorro-dev mailing list. Keep the
> message simple and filterable, i.e. `{tag} pushed to {stage|prod}`

The tag is actually hard to get to (since we don't wait for a tag to start the build, and we generally in fact tag the chosen git revision after the fact). dev and stage builds won't have a tag at all.

I think the most useful thing here would be to have the jenkins build number, although with dev/stage auto-installing we won't have access to this (we could just say "latest build" in those cases though), and have the git revision inside the email (along with md5sum of the socorro.tar.gz and anything else we think is useful)

Comment 3

[Lonnen :lonnen]

Forget the tag then. I think we'll get most of the benefit with the sha and some way to determine with e-mail filters if its deploying to stage or prod. The url should be sufficient for that.

Comment 4

[Lonnen :lonnen]

Attachment: Candidate solution?

I wrote up a candidate patch against the socorro-settings repo.

Comment 5

[Lonnen :lonnen]

moving to infra and \cc'ing ops for feedback.

Comment 6

[Lonnen :lonnen]

deploys are triggered by tags which send a notification to watchers