800007 - please update AUS to AUS2_PRODUCTION tag

Status: RESOLVED FIXED

(mozilla.org Graveyard :: Server Operations, task)

Description

[[e-mail] (:bhearsum)]

Emergency update for bug 799999. You should get rev 1.229 of config-dist.php

Comment 1

[Peter Radcliffe [:pir]]

[root@ip-admin02 ~]# cd /data/sync/dist/aus2.mozilla.org/app
[root@ip-admin02 app]# cvs -q up -dP -r AUS2_PRODUCTION
? backup
? inc/config.php
P inc/config-dist.php
[root@ip-admin02 app]# cd inc/
[root@ip-admin02 inc]# md5sum config-dist.php
84b25b32893980dafe3e757aad779070  config-dist.php
[root@ip-admin02 inc]# md5sum config.php # should be different from above
a1680ee89ab466e94e45b46eed9bcfcf  config.php
[root@ip-admin02 inc]# cp config.php ../backup/config.php.`date '+%Y%m%d'`
[root@ip-admin02 inc]# cp config-dist.php config.php
[root@ip-admin02 inc]# md5sum config.php # should now match config-dist.php md5sum
84b25b32893980dafe3e757aad779070  config.php
[root@ip-admin02 inc]# git add config*
[root@ip-admin02 inc]# git commit -m "bug 800007"
[master 0e5a5f9] bug 800007
 Committer: root <[e-mail]>
Your name and email address were configured automatically based
on your username and hostname. Please check that they are accurate.
You can suppress this message by setting them explicitly:

    git config --global user.name "Your Name"
    git config --global user.email [e-mail]

If the identity used for this commit is wrong, you can fix it with:

    git commit --amend --author='Your Name <[e-mail]>'

 2 files changed, 46 insertions(+), 0 deletions(-)
[root@ip-admin02 inc]# issue-multi-command dist /data/bin/libget/get-php5-www-git.sh
[pp-app-dist02] run: /data/bin/libget/get-php5-www-git.sh
[pp-app-dist04] run: /data/bin/libget/get-php5-www-git.sh
[pp-app-dist03] run: /data/bin/libget/get-php5-www-git.sh
[pp-app-dist08] run: /data/bin/libget/get-php5-www-git.sh
[pp-app-dist05] run: /data/bin/libget/get-php5-www-git.sh
[pp-app-dist07] run: /data/bin/libget/get-php5-www-git.sh
[pp-app-dist06] run: /data/bin/libget/get-php5-www-git.sh
[pp-app-dist09] run: /data/bin/libget/get-php5-www-git.sh
[pp-app-dist01] run: /data/bin/libget/get-php5-www-git.sh
[root@ip-admin02 inc]# issue-multi-command dist md5sum /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist02] run: md5sum /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist02] out: 84b25b32893980dafe3e757aad779070  /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist04] run: md5sum /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist04] out: 84b25b32893980dafe3e757aad779070  /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist06] run: md5sum /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist06] out: 84b25b32893980dafe3e757aad779070  /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist07] run: md5sum /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist07] out: 84b25b32893980dafe3e757aad779070  /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist08] run: md5sum /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist08] out: 84b25b32893980dafe3e757aad779070  /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist01] run: md5sum /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist01] out: 84b25b32893980dafe3e757aad779070  /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist05] run: md5sum /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist05] out: 84b25b32893980dafe3e757aad779070  /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist03] run: md5sum /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist03] out: 84b25b32893980dafe3e757aad779070  /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist09] run: md5sum /data/www/aus2.mozilla.org/app/inc/config.php
[pp-app-dist09] out: 84b25b32893980dafe3e757aad779070  /data/www/aus2.mozilla.org/app/inc/config.php
[root@ip-admin02 inc]#

Comment 2

[Peter Radcliffe [:pir]]

Repushed when the first push cause problems (huge load).
A new push with fixes was requested but the load on the servers was so high the commands wouldn't run.

After realising it was never going to succeed we took some machines out of Zeus and got them updated and recovered, then took more out. 3 machines had been DoSed into the ground so hard they needed rebooting.

Eventually everything was back and update command hand run on each.

Comment 3

[[e-mail] (:bhearsum)]

Thank you for fixing things up. I'm really sorry this ended up eating so much of your time :(.