616869 - [AMO] Update addons.mozilla.org on 12/7 @ 1600

Status: VERIFIED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Description

[Wil Clouser [:clouserw]]

Please update AMO on Dec 7th.  This is a pretty small push in anticipation of an upcoming sizable one.  No downtime expected.  More details to follow.  Thanks.

Comment 1

[matthew zeier [:mrz]]

On the calender but no announcement.

Comment 2

[Wil Clouser [:clouserw]]

Here is what we have so far.  Should be a simple push, nothing with remora: http://etherpad.mozilla.org:9000/amo-5-12-4-push

Comment 3

[Wil Clouser [:clouserw]]

Nothing with remora this time
1) Update to 5.12.4
2) Update submodules
3) Update vendor
4) ./manage.py compress_assets
5) schematic migrations
6) Add some settings to settings_local.  These paths need to be shared across servers and have r+w:
TMP_PATH = os.path.join(NETAPP_STORAGE, 'tmp')
SPHINX_CATALOG_PATH = TMP_PATH + '/data/sphinx'
SPHINX_LOG_PATH = TMP_PATH + '/log/searchd'
7) push site
8) clear memcache & redis
9) update and restart sphinx
10) restart celeryd
11) import scripts/crontab/prod to crontab

Comment 4

[Jeremy Orem [:oremj]]

+ git fetch -t origin
remote: Counting objects: 804, done.
remote: Compressing objects: 100% (320/320), done.
remote: Total 664 (delta 464), reused 494 (delta 305)
Receiving objects: 100% (664/664), 277.34 KiB, done.
Resolving deltas: 100% (464/464), completed with 81 local objects.
From git://github.com/jbalogh/zamboni
 * [new tag]         5.12.4     -> 5.12.4
+ git checkout 5.12.4
M	locale
Previous HEAD position was 3c5bd61... tag 5.12.3 locales
HEAD is now at 809a743... a command to email unreviewed/purgatory add-on owners (bugs 612050 and 616203)
+ git submodule update --init
remote: Counting objects: 392, done.
remote: Compressing objects: 100% (124/124), done.
remote: Total 318 (delta 185), reused 318 (delta 185)
Receiving objects: 100% (318/318), 9.87 MiB | 718 KiB/s, done.
Resolving deltas: 100% (185/185), completed with 24 local objects.
From git://github.com/jbalogh/amo-locales2
   4f1749e..891ccb0  master     -> origin/master
Submodule path 'locale': checked out '891ccb046e85907841a9efd76f321f2314d02312'
+ set +x
+ pushd vendor
+ git fetch -t origin
remote: Counting objects: 38, done.
remote: Compressing objects: 100% (17/17), done.
remote: Total 29 (delta 15), reused 25 (delta 11)
Unpacking objects: 100% (29/29), done.
From git://github.com/jbalogh/zamboni-lib
 * [new tag]         5.12.4     -> 5.12.4
+ git checkout 5.12.4
M	src/django
M	src/django-cache-machine
M	src/nuggets
Previous HEAD position was 5e6d53a... updating nuggets for bug 607448
HEAD is now at cea5eb6... updating cache machine
+ git submodule update --init
Submodule 'src/django-qunit' (git://github.com/kumar303/django-qunit.git) registered for path 'src/django-qunit'
remote: Counting objects: 13215, done.
remote: Compressing objects: 100% (4321/4321), done.
remote: Total 12095 (delta 9295), reused 10186 (delta 7702)
Receiving objects: 100% (12095/12095), 4.00 MiB | 1.99 MiB/s, done.
Resolving deltas: 100% (9295/9295), completed with 524 local objects.
From git://github.com/django/django
   07e9429..6c2beec  1.2.X      -> origin/1.2.X
   7731985..9ded917  master     -> origin/master
   61a43e9..b9b6d33  soc2010/app-loading -> origin/soc2010/app-loading
   876b022..78f410b  soc2010/query-refactor -> origin/soc2010/query-refactor
   a4e2f9b..ad09605  soc2010/test-refactor -> origin/soc2010/test-refactor
Submodule path 'src/django': checked out 'cde55842c028c056d76da2ca8cab00e11536414c'
remote: Counting objects: 18, done.
remote: Compressing objects: 100% (8/8), done.
remote: Total 12 (delta 5), reused 11 (delta 4)
Unpacking objects: 100% (12/12), done.
From git://github.com/jbalogh/django-cache-machine
   39b1b04..d2175e0  redis+byid -> origin/redis+byid
Submodule path 'src/django-cache-machine': checked out 'd2175e0ef4f8f449055025e3efe7b8932dde7af9'
Cloning into src/django-qunit...
remote: Counting objects: 84, done.
remote: Compressing objects: 100% (51/51), done.
remote: Total 84 (delta 27), reused 78 (delta 22)
Receiving objects: 100% (84/84), 23.27 KiB, done.
Resolving deltas: 100% (27/27), done.
Submodule path 'src/django-qunit': checked out '7543d345554c5c2621a4b57facc6d256116baba5'
remote: Counting objects: 10, done.
remote: Compressing objects: 100% (9/9), done.
remote: Total 9 (delta 5), reused 0 (delta 0)
Unpacking objects: 100% (9/9), done.
From git://github.com/mozilla/nuggets
   0d36965..9c8e2f8  master     -> origin/master
Submodule path 'src/nuggets': checked out '9c8e2f80df90ad5d1bfac69b75786bc3087c6b9c'
+ popd
+ set +x
+ git fetch -t origin
remote: Counting objects: 804, done.
remote: Compressing objects: 100% (320/320), done.
remote: Total 664 (delta 464), reused 494 (delta 305)
Receiving objects: 100% (664/664), 277.34 KiB, done.
Resolving deltas: 100% (464/464), completed with 81 local objects.
From git://github.com/jbalogh/zamboni
 * [new tag]         5.12.4     -> 5.12.4
+ git checkout 5.12.4
error: You have local changes to 'settings.py'; cannot switch branches.
+ git submodule update --init
+ set +x
+ pushd vendor
+ git fetch -t origin
remote: Counting objects: 38, done.
remote: Compressing objects: 100% (17/17), done.
remote: Total 29 (delta 15), reused 25 (delta 11)
Unpacking objects: 100% (29/29), done.
From git://github.com/jbalogh/zamboni-lib
 * [new tag]         5.12.4     -> 5.12.4
+ git checkout 5.12.4
M	src/check
M	src/commonware
M	src/django
M	src/django-cache-machine
M	src/django-multidb-router
M	src/django-piston
M	src/django-queryset-transform
M	src/easy-thumbnails
M	src/happyforms
M	src/hera
M	src/nuggets
M	src/tower
Previous HEAD position was 5e6d53a... updating nuggets for bug 607448
HEAD is now at cea5eb6... updating cache machine
+ git submodule update --init
Submodule 'src/django-qunit' (git://github.com/kumar303/django-qunit.git) registered for path 'src/django-qunit'
remote: Counting objects: 13215, done.
remote: Compressing objects: 100% (4321/4321), done.
remote: Total 12095 (delta 9295), reused 10186 (delta 7702)
Receiving objects: 100% (12095/12095), 4.00 MiB | 774 KiB/s, done.
Resolving deltas: 100% (9295/9295), completed with 524 local objects.
From git://github.com/django/django
   07e9429..6c2beec  1.2.X      -> origin/1.2.X
   7731985..9ded917  master     -> origin/master
   61a43e9..b9b6d33  soc2010/app-loading -> origin/soc2010/app-loading
   876b022..78f410b  soc2010/query-refactor -> origin/soc2010/query-refactor
   a4e2f9b..ad09605  soc2010/test-refactor -> origin/soc2010/test-refactor
Submodule path 'src/django': checked out 'cde55842c028c056d76da2ca8cab00e11536414c'
remote: Counting objects: 18, done.
remote: Compressing objects: 100% (8/8), done.
remote: Total 12 (delta 5), reused 11 (delta 4)
Unpacking objects: 100% (12/12), done.
From git://github.com/jbalogh/django-cache-machine
   39b1b04..d2175e0  redis+byid -> origin/redis+byid
Submodule path 'src/django-cache-machine': checked out 'd2175e0ef4f8f449055025e3efe7b8932dde7af9'
Cloning into src/django-qunit...
remote: Counting objects: 84, done.
remote: Compressing objects: 100% (51/51), done.
remote: Total 84 (delta 27), reused 78 (delta 22)
Receiving objects: 100% (84/84), 23.27 KiB, done.
Resolving deltas: 100% (27/27), done.
Submodule path 'src/django-qunit': checked out '7543d345554c5c2621a4b57facc6d256116baba5'
remote: Counting objects: 10, done.
remote: Compressing objects: 100% (9/9), done.
remote: Total 9 (delta 5), reused 0 (delta 0)
Unpacking objects: 100% (9/9), done.
From git://github.com/mozilla/nuggets
   0d36965..9c8e2f8  master     -> origin/master
Submodule path 'src/nuggets': checked out '9c8e2f80df90ad5d1bfac69b75786bc3087c6b9c'
+ popd
+ set +x
Compess assets? [y/n]: y
Traceback (most recent call last):
  File "manage.py", line 54, in <module>
    import log_settings
  File "/data/amo_python/src/prod/zamboni/log_settings.py", line 31, in <module>
    'format': '%s: [%%(REMOTE_ADDR)s] %s' % (settings.SYSLOG_TAG,
  File "/data/amo_python/src/prod/zamboni/vendor/src/django/django/utils/functional.py", line 276, in __getattr__
    self._setup()
  File "/data/amo_python/src/prod/zamboni/vendor/src/django/django/conf/__init__.py", line 41, in _setup
    self._wrapped = Settings(settings_module)
  File "/data/amo_python/src/prod/zamboni/vendor/src/django/django/conf/__init__.py", line 126, in __init__
    logging_config_func(self.LOGGING)
  File "/data/amo_python/src/prod/zamboni/vendor/src/django/django/utils/dictconfig.py", line 553, in dictConfig
    dictConfigClass(config).configure()
  File "/data/amo_python/src/prod/zamboni/vendor/src/django/django/utils/dictconfig.py", line 277, in configure
    raise ValueError("dictionary doesn't specify a version")
ValueError: dictionary doesn't specify a version

Comment 5

[Jeremy Orem [:oremj]]

[root@mradm02 ~]# ./bin/zamboni_quick_update.sh 5.12.4 5.12.4
+ git fetch -t origin
+ git checkout 5.12.4
HEAD is now at 809a743... a command to email unreviewed/purgatory add-on owners (bugs 612050 and 616203)
+ git submodule update --init
+ set +x
+ pushd vendor
+ git fetch -t origin
+ git checkout 5.12.4
M	src/check
M	src/commonware
M	src/django
M	src/django-multidb-router
M	src/django-piston
M	src/django-queryset-transform
M	src/easy-thumbnails
M	src/hera
M	src/nuggets
M	src/tower
HEAD is now at cea5eb6... updating cache machine
+ git submodule update --init
+ popd
+ set +x
+ git fetch -t origin
+ git checkout 5.12.4
M	locale
Previous HEAD position was 3c5bd61... tag 5.12.3 locales
HEAD is now at 809a743... a command to email unreviewed/purgatory add-on owners (bugs 612050 and 616203)
+ git submodule update --init
remote: Counting objects: 392, done.
remote: Compressing objects: 100% (124/124), done.
remote: Total 318 (delta 185), reused 318 (delta 185)
Receiving objects: 100% (318/318), 9.87 MiB | 2.34 MiB/s, done.
Resolving deltas: 100% (185/185), completed with 24 local objects.
From git://github.com/jbalogh/amo-locales2
   4f1749e..891ccb0  master     -> origin/master
Submodule path 'locale': checked out '891ccb046e85907841a9efd76f321f2314d02312'
+ set +x
+ pushd vendor
+ git fetch -t origin
+ git checkout 5.12.4
M	src/commonware
M	src/django
M	src/django-multidb-router
M	src/django-piston
M	src/nuggets
M	src/tower
HEAD is now at cea5eb6... updating cache machine
+ git submodule update --init
+ popd
+ set +x
Compess assets? [y/n]: y
Run schematic? [y/n]: y
Running migration 96:
DROP TABLE IF EXISTS `submit_step`;
CREATE TABLE `submit_step` (
    `id` integer AUTO_INCREMENT NOT NULL PRIMARY KEY,
    `addon_id` int(11) UNSIGNED NOT NULL,
    `step` integer NOT NULL
) ENGINE=InnoDB DEFAULT CHARSET=utf8;

ALTER TABLE `submit_step`
    ADD CONSTRAINT FOREIGN KEY (`addon_id`) REFERENCES `addons` (`id`);

That took 0.38 seconds
################################################## 

Running migration 97:
CREATE INDEX avg_addon_idx ON perf_results (average, addon_id);

That took 0.29 seconds
################################################## 

Push live? [y/n]: y
Push and restart celeryd? [y/n]: y

Comment 6

[Jeremy Orem [:oremj]]

X > 7) push site
X > 8) clear memcache & redis
X > 9) update and restart sphinx
X > 10) restart celeryd
X > 11) import scripts/crontab/prod to crontab

Comment 7

[krupa raj[:krupa]]

verified