Closed Bug 814059 Opened 12 years ago Closed 12 years ago

push Socorro 27

Categories

(Infrastructure & Operations Graveyard :: WebOps: Other, task, P3)

Tracking

(Not tracked)

VERIFIED FIXED

People

(Reporter: rhelmer, Assigned: bburton)

References

Details

(Whiteboard: [push interrupt][triaged 20121121])

This is ready to go, please deploy whenever you are ready:

https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Today is the last day of the week before a very long weekend, and IT is under a change freeze window because of that... do we really want to do this today? How big of a change is this, and what are the odds of a rollback or re-push being necessary?
Assignee: server-ops-webops → bburton
Priority: -- → P3
Whiteboard: [push interrupt][triaged 20121121]
(In reply to Jake Maul [:jakem] from comment #1)
> Today is the last day of the week before a very long weekend, and IT is
> under a change freeze window because of that... do we really want to do this
> today? How big of a change is this, and what are the odds of a rollback or
> re-push being necessary?

It is two very small bugs, one of which is important to get out this week and is highly self-contained (the other is a unit test):

https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced;target_milestone=27;product=Socorro;list_id=5016629

Rollback is highly unlikely but simple to do if we need to.
Push complete

[root@sp-admin01.phx1 ~]# /root/bin/update-socorro-all.sh https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Upgrading socorro to https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Upgrading socorro on sp-collector01.phx1.mozilla.com
Stopping socorro-crashmover: [  OK  ]
Starting socorro-crashmover: [  OK  ]
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_58_00
Upgrading socorro on sp-collector02.phx1.mozilla.com
Stopping socorro-crashmover: [  OK  ]
Starting socorro-crashmover: [  OK  ]
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_58_04
Upgrading socorro on sp-collector03.phx1.mozilla.com
Stopping socorro-crashmover: [  OK  ]
Starting socorro-crashmover: [  OK  ]
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_58_09
Upgrading socorro on sp-collector04.phx1.mozilla.com
Stopping socorro-crashmover: [  OK  ]
Starting socorro-crashmover: [  OK  ]
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_58_13
Upgrading socorro on sp-collector05.phx1.mozilla.com
Stopping socorro-crashmover: [  OK  ]
Starting socorro-crashmover: [  OK  ]
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_58_18
Upgrading socorro on sp-collector06.phx1.mozilla.com
Stopping socorro-crashmover: [  OK  ]
Starting socorro-crashmover: [  OK  ]
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_58_23
Upgrading socorro on sp-mware01.phx1.mozilla.com
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_58_28
Upgrading socorro on sp-mware02.phx1.mozilla.com
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_58_30
Upgrading socorro on sp-mware03.phx1.mozilla.com
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_58_31
Upgrading socorro on sp-processor01.phx1.mozilla.com
Stopping socorro-processor: [  OK  ]
Starting socorro-processor: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_58_33
Upgrading socorro on sp-processor02.phx1.mozilla.com
Stopping socorro-processor: [  OK  ]
Starting socorro-processor: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_58_46
Upgrading socorro on sp-processor03.phx1.mozilla.com
Stopping socorro-processor: [  OK  ]
Starting socorro-processor: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_58_50
Upgrading socorro on sp-processor04.phx1.mozilla.com
Stopping socorro-processor: [  OK  ]
Starting socorro-processor: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_59_10
Upgrading socorro on sp-processor05.phx1.mozilla.com
Stopping socorro-processor: [  OK  ]
Starting socorro-processor: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_59_14
Upgrading socorro on sp-processor06.phx1.mozilla.com
Stopping socorro-processor: [  OK  ]
Starting socorro-processor: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_59_18
Upgrading socorro on sp-processor07.phx1.mozilla.com
Stopping socorro-processor: [  OK  ]
Starting socorro-processor: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_59_37
Upgrading socorro on sp-processor08.phx1.mozilla.com
Stopping socorro-processor: [  OK  ]
Starting socorro-processor: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_59_44
Upgrading socorro on sp-processor09.phx1.mozilla.com
Stopping socorro-processor: [  OK  ]
Starting socorro-processor: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_09_59_48
Upgrading socorro on sp-processor10.phx1.mozilla.com
Stopping socorro-processor: [  OK  ]
Starting socorro-processor: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_10_00_07
Upgrading socorro on sp-web01.phx1.mozilla.com
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_10_00_12
Upgrading socorro on sp-web02.phx1.mozilla.com
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_10_00_14
Upgrading socorro on sp-web03.phx1.mozilla.com
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_10_00_18
Upgrading socorro on sp-web04.phx1.mozilla.com
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_10_00_20
Upgrading socorro on sp-web05.phx1.mozilla.com
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_10_00_23
Upgrading socorro on sp-admin01.phx1.mozilla.com
Stopping socorro-monitor: [  OK  ]
Starting socorro-monitor: [  OK  ]
Stopping httpd: [  OK  ]
Starting httpd: [  OK  ]
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_10_00_25
Upgrading socorro on tp-socorro01-master01.phx1.mozilla.com
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_10_00_30
Upgrading socorro on tp-socorro01-master02.phx1.mozilla.com
Socorro build installed successfully!
Downloaded from https://ci.mozilla.org/job/socorro-release/271/artifact/socorro.tar.gz
Checksum: fcb7f9b0ca77f1eaab56e43956a024a8
Backed up original to /data/socorro.21-11-2012_10_00_32
[sp-web01.phx1.mozilla.com] running: service memcached restart
[sp-web02.phx1.mozilla.com] running: service memcached restart
[sp-web03.phx1.mozilla.com] running: service memcached restart
[sp-web04.phx1.mozilla.com] running: service memcached restart
[sp-web05.phx1.mozilla.com] running: service memcached restart
[sp-web05.phx1.mozilla.com] finished: service memcached restart (0.551s)
[sp-web05.phx1.mozilla.com] out: Stopping memcached: [  OK  ]
[sp-web05.phx1.mozilla.com] out: Starting memcached: [  OK  ]
[sp-web03.phx1.mozilla.com] finished: service memcached restart (0.563s)
[sp-web03.phx1.mozilla.com] out: Stopping memcached: [  OK  ]
[sp-web03.phx1.mozilla.com] out: Starting memcached: [  OK  ]
[sp-web04.phx1.mozilla.com] finished: service memcached restart (0.562s)
[sp-web04.phx1.mozilla.com] out: Stopping memcached: [  OK  ]
[sp-web04.phx1.mozilla.com] out: Starting memcached: [  OK  ]
[sp-web02.phx1.mozilla.com] finished: service memcached restart (0.621s)
[sp-web02.phx1.mozilla.com] out: Stopping memcached: [  OK  ]
[sp-web02.phx1.mozilla.com] out: Starting memcached: [  OK  ]
[sp-web01.phx1.mozilla.com] finished: service memcached restart (0.621s)
[sp-web01.phx1.mozilla.com] out: Stopping memcached: [  OK  ]
[sp-web01.phx1.mozilla.com] out: Starting memcached: [  OK  ]
Status: NEW → RESOLVED
Closed: 12 years ago
Resolution: --- → FIXED
Thanks all for a wicked smooth (and turkey or tofurkey if that's your pleasure) infused release.

QA verified-
- automation passed (http://qa-selenium.mv.mozilla.com:8080/job/socorro.prod/4894/)
- manual bfts pass
Status: RESOLVED → VERIFIED
Component: Server Operations: Web Operations → WebOps: Other
Product: mozilla.org → Infrastructure & Operations
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.