Closed Bug 1029122 Opened 11 years ago Closed 11 years ago

Push Socorro Release 20140623

Categories

(Socorro :: Infra, task)

Product:
Socorro
Component:
Infra
Platform:
x86
macOS
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: peterbe, Unassigned)

References

Details

Upgrading socorro to https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz upgrading collectors (in parallel) [socorro-collector1.webapp.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector2.webapp.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector3.webapp.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector4.webapp.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector5.webapp.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector6.webapp.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector3.webapp.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (7.548s) [socorro-collector3.webapp.phx1.mozilla.com] out: Stopping socorro-crashmover: [ OK ] [socorro-collector3.webapp.phx1.mozilla.com] out: Starting socorro-crashmover: [ OK ] [socorro-collector3.webapp.phx1.mozilla.com] out: Stopping httpd: [ OK ] [socorro-collector3.webapp.phx1.mozilla.com] out: Starting httpd: [ OK ] [socorro-collector3.webapp.phx1.mozilla.com] out: Socorro build installed successfully! [socorro-collector3.webapp.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector3.webapp.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [socorro-collector3.webapp.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_20_28_07 [socorro-collector1.webapp.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (8.763s) [socorro-collector1.webapp.phx1.mozilla.com] out: Stopping socorro-crashmover: [ OK ] [socorro-collector1.webapp.phx1.mozilla.com] out: Starting socorro-crashmover: [ OK ] [socorro-collector1.webapp.phx1.mozilla.com] out: Stopping httpd: [ OK ] [socorro-collector1.webapp.phx1.mozilla.com] out: Starting httpd: [ OK ] [socorro-collector1.webapp.phx1.mozilla.com] out: Socorro build installed successfully! [socorro-collector1.webapp.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector1.webapp.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [socorro-collector1.webapp.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_28_07 [socorro-collector5.webapp.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (17.581s) [socorro-collector5.webapp.phx1.mozilla.com] out: Stopping socorro-crashmover: [ OK ] [socorro-collector5.webapp.phx1.mozilla.com] out: Starting socorro-crashmover: [ OK ] [socorro-collector5.webapp.phx1.mozilla.com] out: Stopping httpd: [ OK ] [socorro-collector5.webapp.phx1.mozilla.com] out: Starting httpd: [ OK ] [socorro-collector5.webapp.phx1.mozilla.com] out: Socorro build installed successfully! [socorro-collector5.webapp.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector5.webapp.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [socorro-collector5.webapp.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_20_28_07 [socorro-collector6.webapp.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (17.581s) [socorro-collector6.webapp.phx1.mozilla.com] out: Stopping socorro-crashmover: [ OK ] [socorro-collector6.webapp.phx1.mozilla.com] out: Starting socorro-crashmover: [ OK ] [socorro-collector6.webapp.phx1.mozilla.com] out: Stopping httpd: [ OK ] [socorro-collector6.webapp.phx1.mozilla.com] out: Starting httpd: [ OK ] [socorro-collector6.webapp.phx1.mozilla.com] out: Socorro build installed successfully! [socorro-collector6.webapp.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector6.webapp.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [socorro-collector6.webapp.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_20_28_07 [socorro-collector4.webapp.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (17.581s) [socorro-collector4.webapp.phx1.mozilla.com] out: Stopping socorro-crashmover: [ OK ] [socorro-collector4.webapp.phx1.mozilla.com] out: Starting socorro-crashmover: [ OK ] [socorro-collector4.webapp.phx1.mozilla.com] out: Stopping httpd: [ OK ] [socorro-collector4.webapp.phx1.mozilla.com] out: Starting httpd: [ OK ] [socorro-collector4.webapp.phx1.mozilla.com] out: Socorro build installed successfully! [socorro-collector4.webapp.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector4.webapp.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [socorro-collector4.webapp.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_20_28_07 [socorro-collector2.webapp.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (17.861s) [socorro-collector2.webapp.phx1.mozilla.com] out: Stopping socorro-crashmover: [ OK ] [socorro-collector2.webapp.phx1.mozilla.com] out: Starting socorro-crashmover: [ OK ] [socorro-collector2.webapp.phx1.mozilla.com] out: Stopping httpd: [ OK ] [socorro-collector2.webapp.phx1.mozilla.com] out: Starting httpd: [ OK ] [socorro-collector2.webapp.phx1.mozilla.com] out: Socorro build installed successfully! [socorro-collector2.webapp.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector2.webapp.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [socorro-collector2.webapp.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_20_28_07 upgrading mware (in parallel) [sp-mware01.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-mware02.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-mware03.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-mware02.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (5.724s) [sp-mware02.phx1.mozilla.com] out: Stopping httpd: [ OK ] [sp-mware02.phx1.mozilla.com] out: Starting httpd: [ OK ] [sp-mware02.phx1.mozilla.com] out: Socorro build installed successfully! [sp-mware02.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-mware02.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [sp-mware02.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_28_25 [sp-mware01.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (6.115s) [sp-mware01.phx1.mozilla.com] out: Stopping httpd: [ OK ] [sp-mware01.phx1.mozilla.com] out: Starting httpd: [ OK ] [sp-mware01.phx1.mozilla.com] out: Socorro build installed successfully! [sp-mware01.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-mware01.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [sp-mware01.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_28_25 [sp-mware03.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (6.381s) [sp-mware03.phx1.mozilla.com] out: Stopping httpd: [ OK ] [sp-mware03.phx1.mozilla.com] out: Starting httpd: [ OK ] [sp-mware03.phx1.mozilla.com] out: Socorro build installed successfully! [sp-mware03.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-mware03.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [sp-mware03.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_28_25 upgrading processors (in parallel) [sp-processor01.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor02.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor03.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor04.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor05.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor06.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor07.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor08.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor09.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor10.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor09.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (10.727s) [sp-processor09.phx1.mozilla.com] out: Stopping socorro-processor: [ OK ] [sp-processor09.phx1.mozilla.com] out: Starting socorro-processor: [ OK ] [sp-processor09.phx1.mozilla.com] out: Socorro build installed successfully! [sp-processor09.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor09.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [sp-processor09.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_28_32 [sp-processor10.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (11.485s) [sp-processor10.phx1.mozilla.com] out: Stopping socorro-processor: [ OK ] [sp-processor10.phx1.mozilla.com] out: Starting socorro-processor: [ OK ] [sp-processor10.phx1.mozilla.com] out: Socorro build installed successfully! [sp-processor10.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor10.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [sp-processor10.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_28_32 [sp-processor04.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (12.013s) [sp-processor04.phx1.mozilla.com] out: Stopping socorro-processor: [ OK ] [sp-processor04.phx1.mozilla.com] out: Starting socorro-processor: [ OK ] [sp-processor04.phx1.mozilla.com] out: Socorro build installed successfully! [sp-processor04.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor04.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [sp-processor04.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_28_32 [sp-processor02.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (12.013s) [sp-processor02.phx1.mozilla.com] out: Stopping socorro-processor: [ OK ] [sp-processor02.phx1.mozilla.com] out: Starting socorro-processor: [ OK ] [sp-processor02.phx1.mozilla.com] out: Socorro build installed successfully! [sp-processor02.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor02.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [sp-processor02.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_28_32 [sp-processor03.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (41.391s) [sp-processor03.phx1.mozilla.com] out: Stopping socorro-processor: [ OK ] [sp-processor03.phx1.mozilla.com] out: Starting socorro-processor: [ OK ] [sp-processor03.phx1.mozilla.com] out: Socorro build installed successfully! [sp-processor03.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor03.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [sp-processor03.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_28_32 [sp-processor01.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (41.392s) [sp-processor01.phx1.mozilla.com] out: Stopping socorro-processor: [ OK ] [sp-processor01.phx1.mozilla.com] out: Starting socorro-processor: [ OK ] [sp-processor01.phx1.mozilla.com] out: Socorro build installed successfully! [sp-processor01.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor01.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [sp-processor01.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_28_32 [sp-processor06.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (43.268s) [sp-processor06.phx1.mozilla.com] out: Stopping socorro-processor: [ OK ] [sp-processor06.phx1.mozilla.com] out: Starting socorro-processor: [ OK ] [sp-processor06.phx1.mozilla.com] out: Socorro build installed successfully! [sp-processor06.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor06.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [sp-processor06.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_28_32 [sp-processor07.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (43.269s) [sp-processor07.phx1.mozilla.com] out: Stopping socorro-processor: [ OK ] [sp-processor07.phx1.mozilla.com] out: Starting socorro-processor: [ OK ] [sp-processor07.phx1.mozilla.com] out: Socorro build installed successfully! [sp-processor07.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor07.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [sp-processor07.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_28_32 [sp-processor08.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (43.269s) [sp-processor08.phx1.mozilla.com] out: Stopping socorro-processor: [ OK ] [sp-processor08.phx1.mozilla.com] out: Starting socorro-processor: [ OK ] [sp-processor08.phx1.mozilla.com] out: Socorro build installed successfully! [sp-processor08.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor08.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [sp-processor08.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_28_32 [sp-processor05.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (43.270s) [sp-processor05.phx1.mozilla.com] out: Stopping socorro-processor: [ OK ] [sp-processor05.phx1.mozilla.com] out: Starting socorro-processor: [ OK ] [sp-processor05.phx1.mozilla.com] out: Socorro build installed successfully! [sp-processor05.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor05.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [sp-processor05.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_28_32 upgrading db servers (in parallel) [socorro1.db.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro2.db.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro2.db.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (5.714s) [socorro2.db.phx1.mozilla.com] out: Socorro build installed successfully! [socorro2.db.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro2.db.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [socorro2.db.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_29_15 [socorro1.db.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (9.344s) [socorro1.db.phx1.mozilla.com] out: Socorro build installed successfully! [socorro1.db.phx1.mozilla.com] out: Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro1.db.phx1.mozilla.com] out: Checksum: 29d963732ca9a0c8603b4fc2db199688 [socorro1.db.phx1.mozilla.com] out: Backed up original to /data/socorro.23-06-2014_13_29_15 upgrading admin host Stopping httpd: [ OK ] Starting httpd: [ OK ] Socorro build installed successfully! Downloaded from https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz Checksum: 29d963732ca9a0c8603b4fc2db199688 Backed up original to /data/socorro.23-06-2014_13_29_24 upgrading django servers (in parallel) DIR: /data/crashstats/src/crash-stats.mozilla.org ENV: crashstats SITE: crash-stats.mozilla.org APP: socorro Upgrading socorro-crashstats (django) prod Upgrading socorro to https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz /data/crashstats/src/crash-stats.mozilla.org /home/pbengtsson finished upgrading socorro to https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → FIXED
Upgrading socorro to https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz upgrading collectors (in parallel) [socorro-collector1.webapp.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector2.webapp.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector3.webapp.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector4.webapp.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector5.webapp.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector6.webapp.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro-collector3.webapp.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (3.359s) [socorro-collector2.webapp.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (3.524s) [socorro-collector1.webapp.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (3.525s) [socorro-collector6.webapp.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (3.603s) [socorro-collector5.webapp.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (3.606s) [socorro-collector4.webapp.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (3.607s) upgrading mware (in parallel) [sp-mware01.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-mware02.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-mware03.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-mware03.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (1.618s) [sp-mware02.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (1.769s) [sp-mware01.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (2.309s) upgrading processors (in parallel) [sp-processor01.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor02.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor03.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor04.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor05.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor06.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor07.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor08.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor09.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor10.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [sp-processor02.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (2.299s) [sp-processor09.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (2.671s) [sp-processor03.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (4.014s) [sp-processor08.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (4.134s) [sp-processor10.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (4.568s) [sp-processor04.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (4.958s) [sp-processor07.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (5.070s) [sp-processor06.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (5.070s) [sp-processor01.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (5.495s) [sp-processor05.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (5.500s) upgrading db servers (in parallel) [socorro1.db.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro2.db.phx1.mozilla.com] running: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz [socorro2.db.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (1.180s) [socorro1.db.phx1.mozilla.com] finished: sudo /data/bin/update-socorro.sh https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz (1.769s) upgrading admin host upgrading django servers (in parallel) DIR: /data/crashstats/src/crash-stats.mozilla.org ENV: crashstats SITE: crash-stats.mozilla.org APP: socorro Upgrading socorro-crashstats (django) prod Upgrading socorro to https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz /data/crashstats/src/crash-stats.mozilla.org /home/pbengtsson /data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/core/management/__init__.py:465: DeprecationWarning: The 'execute_manager' function is deprecated, you likely need to update your 'manage.py'; please see the Django 1.4 release notes (https://docs.djangoproject.com/en/dev/releases/1.4/). DeprecationWarning) /data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/core/management/__init__.py:409: DeprecationWarning: The 'setup_environ' function is deprecated, you likely need to update your 'manage.py'; please see the Django 1.4 release notes (https://docs.djangoproject.com/en/dev/releases/1.4/). DeprecationWarning) Traceback (most recent call last): File "socorro/webapp-django/manage.py", line 27, in <module> manage.main() File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/src/funfactory/funfactory/manage.py", line 143, in main execute_manager(current_settings) File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/core/management/__init__.py", line 469, in execute_manager utility.execute() File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/core/management/__init__.py", line 392, in execute self.fetch_command(subcommand).run_from_argv(self.argv) File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/core/management/__init__.py", line 272, in fetch_command klass = load_command_class(app_name, subcommand) File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/core/management/__init__.py", line 77, in load_command_class module = import_module('%s.management.commands.%s' % (app_name, name)) File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/utils/importlib.py", line 35, in import_module __import__(name) File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/core/management/commands/syncdb.py", line 8, in <module> from django.core.management.sql import custom_sql_for_model, emit_post_sync_signal File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/core/management/sql.py", line 9, in <module> from django.db import models File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/db/__init__.py", line 40, in <module> backend = load_backend(connection.settings_dict['ENGINE']) File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/db/__init__.py", line 34, in __getattr__ return getattr(connections[DEFAULT_DB_ALIAS], item) File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/db/utils.py", line 93, in __getitem__ backend = load_backend(db['ENGINE']) File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/db/utils.py", line 27, in load_backend return import_module('.base', backend_name) File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/utils/importlib.py", line 35, in import_module __import__(name) File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/db/backends/postgresql_psycopg2/base.py", line 14, in <module> from django.db.backends.postgresql_psycopg2.creation import DatabaseCreation File "/data/crashstats/src/crash-stats.mozilla.org/socorro/webapp-django/vendor/lib/python/django/db/backends/postgresql_psycopg2/creation.py", line 1, in <module> import psycopg2.extensions ImportError: No module named psycopg2.extensions ln: creating symbolic link `socorro/webapp-django/media/symbols-upload': File exists [2014-06-23 20:49:57] Running rsync_project [2014-06-23 20:49:57] [localhost] running: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --exclude '.svn*' --exclude 'CVS' --exclude '.bzr*' --delete /data/crashstats/src/crash-stats.mozilla.org/ /data/crashstats/www/crash-stats.mozilla.org/ [2014-06-23 20:50:01] [localhost] finished: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --exclude '.svn*' --exclude 'CVS' --exclude '.bzr*' --delete /data/crashstats/src/crash-stats.mozilla.org/ /data/crashstats/www/crash-stats.mozilla.org/ (4.274s) [2014-06-23 20:50:01] Finished rsync_project (4.274s) [2014-06-23 20:50:01] Running commit_www [2014-06-23 20:50:01] [localhost] running: cd /data/crashstats/www && /usr/bin/git add .; /usr/bin/git commit -a -m 'deploy ['crash-stats.mozilla.org']' [2014-06-23 20:50:02] [localhost] failed: cd /data/crashstats/www && /usr/bin/git add .; /usr/bin/git commit -a -m 'deploy ['crash-stats.mozilla.org']' (1.111s) [localhost] out: # On branch master [localhost] out: nothing to commit (working directory clean) [2014-06-23 20:50:03] [socorro1.webapp.phx1.mozilla.com] running: /data/bin/update-www.sh [2014-06-23 20:50:03] [socorro2.webapp.phx1.mozilla.com] running: /data/bin/update-www.sh [2014-06-23 20:50:03] [socorro3.webapp.phx1.mozilla.com] running: /data/bin/update-www.sh [2014-06-23 20:50:03] [socorro4.webapp.phx1.mozilla.com] running: /data/bin/update-www.sh [2014-06-23 20:50:03] [socorro4.webapp.phx1.mozilla.com] finished: /data/bin/update-www.sh (0.786s) [2014-06-23 20:50:03] [socorro2.webapp.phx1.mozilla.com] finished: /data/bin/update-www.sh (0.866s) [2014-06-23 20:50:03] [socorro1.webapp.phx1.mozilla.com] finished: /data/bin/update-www.sh (0.867s) [socorro1.webapp.phx1.mozilla.com] out: Not removing crash-stats.mozilla.org/app/ [2014-06-23 20:50:03] [socorro3.webapp.phx1.mozilla.com] finished: /data/bin/update-www.sh (0.950s) [2014-06-23 20:50:04] [socorro1.webapp.phx1.mozilla.com] running: service httpd restart [2014-06-23 20:50:04] [socorro2.webapp.phx1.mozilla.com] running: service httpd restart [2014-06-23 20:50:04] [socorro3.webapp.phx1.mozilla.com] running: service httpd restart [2014-06-23 20:50:04] [socorro4.webapp.phx1.mozilla.com] running: service httpd restart [2014-06-23 20:50:04] [socorro3.webapp.phx1.mozilla.com] finished: service httpd restart (0.369s) [socorro3.webapp.phx1.mozilla.com] out: Stopping httpd: [ OK ] [socorro3.webapp.phx1.mozilla.com] out: Starting httpd: [ OK ] [2014-06-23 20:50:04] [socorro2.webapp.phx1.mozilla.com] finished: service httpd restart (0.382s) [socorro2.webapp.phx1.mozilla.com] out: Stopping httpd: [ OK ] [socorro2.webapp.phx1.mozilla.com] out: Starting httpd: [ OK ] [2014-06-23 20:50:04] [socorro1.webapp.phx1.mozilla.com] finished: service httpd restart (0.398s) [socorro1.webapp.phx1.mozilla.com] out: Stopping httpd: [ OK ] [socorro1.webapp.phx1.mozilla.com] out: Starting httpd: [ OK ] [2014-06-23 20:50:04] [socorro4.webapp.phx1.mozilla.com] finished: service httpd restart (0.413s) [socorro4.webapp.phx1.mozilla.com] out: Stopping httpd: [ OK ] [socorro4.webapp.phx1.mozilla.com] out: Starting httpd: [ OK ] [2014-06-23 20:50:04] [socorro-memcache1.webapp.phx1.mozilla.com] running: service memcached restart [2014-06-23 20:50:04] [socorro-memcache2.webapp.phx1.mozilla.com] running: service memcached restart [2014-06-23 20:50:04] [socorro-memcache2.webapp.phx1.mozilla.com] finished: service memcached restart (0.304s) [socorro-memcache2.webapp.phx1.mozilla.com] out: Stopping memcached: [ OK ] [socorro-memcache2.webapp.phx1.mozilla.com] out: Starting memcached: [ OK ] [2014-06-23 20:50:04] [socorro-memcache1.webapp.phx1.mozilla.com] finished: service memcached restart (0.307s) [socorro-memcache1.webapp.phx1.mozilla.com] out: Stopping memcached: [ OK ] [socorro-memcache1.webapp.phx1.mozilla.com] out: Starting memcached: [ OK ] finished upgrading socorro to https://ci.mozilla.org/job/socorro-release/1142/artifact/socorro.tar.gz
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
There were missing WSGI file changes. rhelmer had modified an apache conf file in our config but the one that needed modification was located outside of the config that most of the socorro team (including rhelmer) has access to modify.
Status: REOPENED → RESOLVED
Closed: 11 years ago → 11 years ago
Depends on: 1024619
Resolution: --- → FIXED
During the confusion I asked peter to push a second time, which revealed the error which didn't show up the first time. I also inexplicably disabled puppet on stage for a short time.
Blocks: 1032497
No longer blocks: 1032497
You need to log in before you can comment on or make changes to this bug.