Push SUMO 2012-01-24 @ 3pm PT

RESOLVED FIXED

Status

Infrastructure & Operations
WebOps: Other
RESOLVED FIXED
6 years ago
5 years ago

People

(Reporter: rrosario, Assigned: jd)

Tracking

Details

(Reporter)

Description

6 years ago
Normal SUMO push, 01-24.

Updated

6 years ago
Depends on: 719951
ElasticSearch needs to be set up in production.

Need to add the following to settings_local.py:

ES_HOSTS = [ ... ]  # Whatever the ES host for production should be
ES_LIVE_INDEXING = True

I think that's it. If production is sharing an ES cluster with either dev or staging, then we need to set ES_INDEXES, too. Does anyone know if that's the case? (I'm hoping it isn't.)
(Reporter)

Comment 2

6 years ago
Also, can we verify that sphinx is using the latest stopwords.txt from our repo (configs/sphinx/stopwords.txt). Search on prod is behaving differently than -dev and -stage and we suspect this file may be out of date.
Specifically, Firefox is on the list of stop words and shouldn't be anymore.
(Assignee)

Updated

6 years ago
Assignee: server-ops → jcrowe
(Assignee)

Comment 4

6 years ago
This is done.  I placed the optipng and elasticsearch configurations in the settings file.

I had to manually push the stopwords.txt file to the sphinx servers.  After that I checked that there was no reference to Firefox in the stopwords.txt file on the sphinx node.

Full output follows:

./update 2012-01-24
+ cd /data/support/src/support.mozilla.org/kitsune
+ echo -e 'Fetching tags...'
Fetching tags...
+ git fetch -t
remote: Counting objects: 294, done.
remote: Compressing objects: 100% (103/103), done.
remote: Total 227 (delta 151), reused 185 (delta 117)
Receiving objects: 100% (227/227), 86.74 KiB, done.
Resolving deltas: 100% (151/151), completed with 50 local objects.
From git://github.com/mozilla/kitsune
 * [new tag]         2012-01-24 -> 2012-01-24
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ echo -e 'Updating code...'
Updating code...
+ git checkout 2012-01-24
M       vendor/src/django-cronjobs
M       vendor/src/django-extensions
M       vendor/src/django-multidb-router
M       vendor/src/elasticutils
M       vendor/src/oedipus
Previous HEAD position was baaeed1... [bug 718889] Correctly enable gallery radio buttons.
HEAD is now at 57f4faf... [bug 718826, 715932] Make ES indexing less sucky
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ echo -e 'Sync submodule...'
Sync submodule...
+ git submodule sync
Synchronizing submodule url for 'media/global'
Synchronizing submodule url for 'templates/global'
Synchronizing submodule url for 'vendor/src/bleach'
Synchronizing submodule url for 'vendor/src/cache-panel'
Synchronizing submodule url for 'vendor/src/celery'
Synchronizing submodule url for 'vendor/src/check'
Synchronizing submodule url for 'vendor/src/commonware'
Synchronizing submodule url for 'vendor/src/django'
Synchronizing submodule url for 'vendor/src/django-adminplus'
Synchronizing submodule url for 'vendor/src/django-arecibo'
Synchronizing submodule url for 'vendor/src/django-authority'
Synchronizing submodule url for 'vendor/src/django-cache-machine'
Synchronizing submodule url for 'vendor/src/django-celery'
Synchronizing submodule url for 'vendor/src/django-cronjobs'
Synchronizing submodule url for 'vendor/src/django-csp'
Synchronizing submodule url for 'vendor/src/django-debug-toolbar'
Synchronizing submodule url for 'vendor/src/django-extensions'
Synchronizing submodule url for 'vendor/src/django-mobility'
Synchronizing submodule url for 'vendor/src/django-mozilla-product-details'
Synchronizing submodule url for 'vendor/src/django-multidb-router'
Synchronizing submodule url for 'vendor/src/django-nose'
Synchronizing submodule url for 'vendor/src/django-picklefield'
Synchronizing submodule url for 'vendor/src/django-qunit'
Synchronizing submodule url for 'vendor/src/django-ratelimit'
Synchronizing submodule url for 'vendor/src/django-recaptcha'
Synchronizing submodule url for 'vendor/src/django-session-csrf'
Synchronizing submodule url for 'vendor/src/django-tidings'
Synchronizing submodule url for 'vendor/src/django-timezones'
Synchronizing submodule url for 'vendor/src/django-waffle'
Synchronizing submodule url for 'vendor/src/elasticutils'
Synchronizing submodule url for 'vendor/src/jingo'
Synchronizing submodule url for 'vendor/src/jingo-minify'
Synchronizing submodule url for 'vendor/src/jstestnetlib'
Synchronizing submodule url for 'vendor/src/kombu'
Synchronizing submodule url for 'vendor/src/oedipus'
Synchronizing submodule url for 'vendor/src/py-wikimarkup'
Synchronizing submodule url for 'vendor/src/pystatsd'
Synchronizing submodule url for 'vendor/src/python-recaptcha'
Synchronizing submodule url for 'vendor/src/redis-py'
Synchronizing submodule url for 'vendor/src/schematic'
Synchronizing submodule url for 'vendor/src/sphinxapi'
Synchronizing submodule url for 'vendor/src/test-utils'
Synchronizing submodule url for 'vendor/src/tower'
Synchronizing submodule url for 'vendor/src/tweepy'
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ echo -e 'Update submodule...'
Update submodule...
+ git submodule update --init --recursive
Submodule 'vendor/src/django-tastypie' (https://github.com/toastdriven/django-tastypie.git) registered for path 'vendor/src/django-tastypie'
Submodule 'vendor/src/zendesk' (git://github.com/eventbrite/zendesk.git) registered for path 'vendor/src/zendesk'
remote: Counting objects: 200, done.
remote: Compressing objects: 100% (105/105), done.
remote: Total 158 (delta 121), reused 89 (delta 53)
Receiving objects: 100% (158/158), 16.04 KiB, done.
Resolving deltas: 100% (121/121), completed with 23 local objects.
From https://github.com/django-extensions/django-extensions
   7d1030b..4da5513  master     -> origin/master
Submodule path 'vendor/src/django-extensions': checked out 'd5bbec16d41e2435d579b48bb6bce9cb17186fc1'
Initialized empty Git repository in /data/support/src/support.mozilla.org/kitsune/vendor/src/django-tastypie/.git/
remote: Counting objects: 3289, done.
remote: Compressing objects: 100% (1022/1022), done.
remote: Total 3289 (delta 2506), reused 2995 (delta 2240)
Receiving objects: 100% (3289/3289), 563.49 KiB | 967 KiB/s, done.
Resolving deltas: 100% (2506/2506), done.
Submodule path 'vendor/src/django-tastypie': checked out 'ea480e53801d613f3093f3065e492ec9145ad687'
remote: Counting objects: 159, done.
remote: Compressing objects: 100% (54/54), done.
remote: Total 129 (delta 88), reused 116 (delta 75)
Receiving objects: 100% (129/129), 13.70 KiB, done.
Resolving deltas: 100% (88/88), completed with 16 local objects.
From git://github.com/davedash/elasticutils
   ed47fe6..a140ebd  flightdeck -> origin/flightdeck
   d340ef9..c9fc5f4  master     -> origin/master
   7f57eaa..0ce3b9c  sumo       -> origin/sumo
Submodule path 'vendor/src/elasticutils': checked out '0ce3b9c81e57588d6d7f61572af0b7c2451f9a30'
Initialized empty Git repository in /data/support/src/support.mozilla.org/kitsune/vendor/src/zendesk/.git/
remote: Counting objects: 111, done.
remote: Compressing objects: 100% (74/74), done.
remote: Total 111 (delta 60), reused 71 (delta 27)
Receiving objects: 100% (111/111), 20.76 KiB, done.
Resolving deltas: 100% (60/60), done.
Submodule path 'vendor/src/zendesk': checked out 'ef31c13453c249606505201ca88c9c556eb42d4c'
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ cd /data/support/src/support.mozilla.org/kitsune
+ find /data/support/src/support.mozilla.org/kitsune -name '*.pyc' -delete
+ python ./manage.py cron get_highcharts
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ python ./manage.py compress_assets
To turn on cache busting, use settings.CACHEBUST_IMGS
Minifying /data/support/src/support.mozilla.org/kitsune/media/css/wiki-all.css (using YUI Compressor)
Minifying /data/support/src/support.mozilla.org/kitsune/media/css/kpi.dashboard-all.css (using YUI Compressor)
Minifying /data/support/src/support.mozilla.org/kitsune/media/js/kpi.dashboard-all.js (using YUI Compressor)
Unchanged files skipped for minification: 37
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ python ./vendor/src/schematic/schematic migrations/
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ cd /data/support/src/support.mozilla.org/kitsune/locale
+ svn up
U    uk/LC_MESSAGES/javascript.po
U    uk/LC_MESSAGES/messages.po
U    ms/LC_MESSAGES/javascript.po
U    ms/LC_MESSAGES/messages.po
U    my/LC_MESSAGES/javascript.po
U    my/LC_MESSAGES/messages.po
U    fa/LC_MESSAGES/javascript.po
U    fa/LC_MESSAGES/messages.po
U    hi_IN/LC_MESSAGES/javascript.po
U    hi_IN/LC_MESSAGES/messages.po
U    pa_IN/LC_MESSAGES/javascript.po
U    pa_IN/LC_MESSAGES/messages.po
U    bg/LC_MESSAGES/javascript.po
U    bg/LC_MESSAGES/messages.po
U    ja/LC_MESSAGES/javascript.po
U    ja/LC_MESSAGES/messages.po
U    nb_NO/LC_MESSAGES/javascript.po
U    nb_NO/LC_MESSAGES/messages.po
U    xx_testing/LC_MESSAGES/javascript.po
U    xx_testing/LC_MESSAGES/messages.po
U    hy_AM/LC_MESSAGES/javascript.po
U    hy_AM/LC_MESSAGES/messages.po
U    fi/LC_MESSAGES/javascript.po
U    fi/LC_MESSAGES/messages.po
U    gu_IN/LC_MESSAGES/javascript.po
U    gu_IN/LC_MESSAGES/messages.po
U    bs/LC_MESSAGES/javascript.po
U    bs/LC_MESSAGES/messages.po
U    fr/LC_MESSAGES/javascript.po
U    fr/LC_MESSAGES/messages.po
U    nl/LC_MESSAGES/javascript.po
U    nl/LC_MESSAGES/messages.po
U    no/LC_MESSAGES/javascript.po
U    no/LC_MESSAGES/messages.po
U    sr_CYRL/LC_MESSAGES/javascript.po
U    sr_CYRL/LC_MESSAGES/messages.po
U    rm/LC_MESSAGES/javascript.po
U    rm/LC_MESSAGES/messages.po
U    vi/LC_MESSAGES/javascript.po
U    vi/LC_MESSAGES/messages.po
U    ro/LC_MESSAGES/javascript.po
U    ro/LC_MESSAGES/messages.po
U    ca/LC_MESSAGES/javascript.po
U    ca/LC_MESSAGES/messages.po
U    ru/LC_MESSAGES/javascript.po
U    ru/LC_MESSAGES/messages.po
U    pt_PT/LC_MESSAGES/javascript.po
U    pt_PT/LC_MESSAGES/messages.po
U    rw/LC_MESSAGES/javascript.po
U    rw/LC_MESSAGES/messages.po
U    gd/LC_MESSAGES/javascript.po
U    gd/LC_MESSAGES/messages.po
U    zh_TW/LC_MESSAGES/javascript.po
U    zh_TW/LC_MESSAGES/messages.po
U    oc/LC_MESSAGES/javascript.po
U    oc/LC_MESSAGES/messages.po
U    gl/LC_MESSAGES/javascript.po
U    gl/LC_MESSAGES/messages.po
U    sr_LATN/LC_MESSAGES/javascript.po
U    sr_LATN/LC_MESSAGES/messages.po
U    cs/LC_MESSAGES/javascript.po
U    cs/LC_MESSAGES/messages.po
U    kk/LC_MESSAGES/javascript.po
U    kk/LC_MESSAGES/messages.po
U    fy_NL/LC_MESSAGES/javascript.po
U    fy_NL/LC_MESSAGES/messages.po
U    km/LC_MESSAGES/javascript.po
U    km/LC_MESSAGES/messages.po
U    kn/LC_MESSAGES/javascript.po
U    kn/LC_MESSAGES/messages.po
U    ko/LC_MESSAGES/javascript.po
U    ko/LC_MESSAGES/messages.po
U    si/LC_MESSAGES/javascript.po
U    si/LC_MESSAGES/messages.po
U    sk/LC_MESSAGES/javascript.po
U    sk/LC_MESSAGES/messages.po
U    sl/LC_MESSAGES/javascript.po
U    sl/LC_MESSAGES/messages.po
U    sv_SE/LC_MESSAGES/javascript.po
U    sv_SE/LC_MESSAGES/messages.po
U    sq/LC_MESSAGES/javascript.po
U    sq/LC_MESSAGES/messages.po
U    da/LC_MESSAGES/javascript.po
U    da/LC_MESSAGES/messages.po
U    de/LC_MESSAGES/javascript.po
U    de/LC_MESSAGES/messages.po
U    he/LC_MESSAGES/javascript.po
U    he/LC_MESSAGES/messages.po
U    pt_BR/LC_MESSAGES/javascript.po
U    pt_BR/LC_MESSAGES/messages.po
U    te/LC_MESSAGES/javascript.po
U    te/LC_MESSAGES/messages.po
U    hr/LC_MESSAGES/javascript.po
U    hr/LC_MESSAGES/messages.po
U    th/LC_MESSAGES/javascript.po
U    th/LC_MESSAGES/messages.po
U    pl/LC_MESSAGES/javascript.po
U    pl/LC_MESSAGES/messages.po
U    hu/LC_MESSAGES/javascript.po
U    hu/LC_MESSAGES/messages.po
U    lt/LC_MESSAGES/javascript.po
U    lt/LC_MESSAGES/messages.po
U    tr/LC_MESSAGES/javascript.po
U    tr/LC_MESSAGES/messages.po
U    bn_IN/LC_MESSAGES/javascript.po
U    bn_IN/LC_MESSAGES/messages.po
U    ast/LC_MESSAGES/javascript.po
U    ast/LC_MESSAGES/messages.po
U    ta_LK/LC_MESSAGES/javascript.po
U    ta_LK/LC_MESSAGES/messages.po
U    ak/LC_MESSAGES/javascript.po
U    ak/LC_MESSAGES/messages.po
U    fur/LC_MESSAGES/javascript.po
U    fur/LC_MESSAGES/messages.po
U    id/LC_MESSAGES/javascript.po
U    id/LC_MESSAGES/messages.po
U    templates/LC_MESSAGES/javascript.pot
U    templates/LC_MESSAGES/messages.pot
U    el/LC_MESSAGES/javascript.po
U    el/LC_MESSAGES/messages.po
U    zh_CN/LC_MESSAGES/javascript.po
U    zh_CN/LC_MESSAGES/messages.po
U    ar/LC_MESSAGES/javascript.po
U    ar/LC_MESSAGES/messages.po
U    as/LC_MESSAGES/javascript.po
U    as/LC_MESSAGES/messages.po
U    eo/LC_MESSAGES/javascript.po
U    eo/LC_MESSAGES/messages.po
U    bn_BD/LC_MESSAGES/javascript.po
U    bn_BD/LC_MESSAGES/messages.po
U    ga_IE/LC_MESSAGES/javascript.po
U    ga_IE/LC_MESSAGES/messages.po
U    mk/LC_MESSAGES/javascript.po
U    mk/LC_MESSAGES/messages.po
U    es/LC_MESSAGES/javascript.po
U    es/LC_MESSAGES/messages.po
U    et/LC_MESSAGES/javascript.po
U    et/LC_MESSAGES/messages.po
U    en_US/LC_MESSAGES/javascript.po
U    en_US/LC_MESSAGES/messages.po
U    eu/LC_MESSAGES/javascript.po
U    eu/LC_MESSAGES/messages.po
U    mn/LC_MESSAGES/javascript.po
U    mn/LC_MESSAGES/messages.po
U    is/LC_MESSAGES/javascript.po
U    is/LC_MESSAGES/messages.po
U    it/LC_MESSAGES/javascript.po
U    it/LC_MESSAGES/messages.po
U    mr/LC_MESSAGES/javascript.po
U    mr/LC_MESSAGES/messages.po
Updated to revision 100343.
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ ./compile-mo.sh .
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ cd /data/support/src/support.mozilla.org/kitsune/scripts/crontab
+ ./gen-crons.py -k /data/support/src/support.mozilla.org/kitsune -u apache
+ checkretval
+ retval=0
+ [[ 0 -gt 0 ]]
+ cd /data/support/src/support.mozilla.org/kitsune
+ find /data/support/src/support.mozilla.org/kitsune -name '*.pyc' -delete
+ read -p 'Do you really want to push SUMO and reload apache? [y/n] ' YESNO
Do you really want to push SUMO and reload apache? [y/n] y
+ [[ y != \y ]]
+ /data/support/deploy -n support.mozilla.org
[2012-01-24 15:02:41] Running rsync_project
[2012-01-24 15:02:41] [localhost] running: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --delete /data/support/src/support.mozilla.org/ /data/support/www/support.mozilla.org/
[2012-01-24 15:02:50] [localhost] finished: /usr/bin/rsync -aq --include '.gitkeep' --exclude '.git*' --exclude '.hg*' --delete /data/support/src/support.mozilla.org/ /data/support/www/support.mozilla.org/ (8.482s)
+ issue-multi-command support /data/bin/update-www.sh
[2012-01-24 15:02:50] [support1.webapp.phx1.mozilla.com] running: /data/bin/update-www.sh
[2012-01-24 15:02:50] [support2.webapp.phx1.mozilla.com] running: /data/bin/update-www.sh
[2012-01-24 15:02:50] [support3.webapp.phx1.mozilla.com] running: /data/bin/update-www.sh
[2012-01-24 15:02:50] [support4.webapp.phx1.mozilla.com] running: /data/bin/update-www.sh
[2012-01-24 15:02:50] [support5.webapp.phx1.mozilla.com] running: /data/bin/update-www.sh
[2012-01-24 15:02:53] [support2.webapp.phx1.mozilla.com] finished: /data/bin/update-www.sh (3.234s)
[2012-01-24 15:02:53] [support3.webapp.phx1.mozilla.com] finished: /data/bin/update-www.sh (3.433s)
[2012-01-24 15:02:53] [support5.webapp.phx1.mozilla.com] finished: /data/bin/update-www.sh (3.678s)
[2012-01-24 15:02:54] [support4.webapp.phx1.mozilla.com] finished: /data/bin/update-www.sh (3.926s)
[2012-01-24 15:02:54] [support1.webapp.phx1.mozilla.com] finished: /data/bin/update-www.sh (4.694s)
+ issue-multi-command support-celery /data/bin/update-www.sh
[2012-01-24 15:02:54] [sumocelery1.webapp.phx1.mozilla.com] running: /data/bin/update-www.sh
[2012-01-24 15:02:56] [sumocelery1.webapp.phx1.mozilla.com] finished: /data/bin/update-www.sh (1.292s)
+ scp /data/support/src/support.mozilla.org/kitsune/configs/sphinx/sphinx.conf pp-app-sphinx01.phx.mozilla.com:/data/sphinx/support/sphinx.conf
sphinx.conf                                                                                                                      100%   12KB  12.3KB/s   00:00    
+ scp /data/support/src/support.mozilla.org/kitsune/configs/sphinx/sphinx.conf pp-app-sphinx02.phx.mozilla.com:/data/sphinx/support/sphinx.conf
sphinx.conf                                                                                                                      100%   12KB  12.3KB/s   00:00    
+ scp /data/support/src/support.mozilla.org/kitsune/configs/sphinx/stopwords.txt pp-app-sphinx01.phx.mozilla.com:/data/sphinx/support/stopwords.txt
stopwords.txt                                                                                                                    100%  954     0.9KB/s   00:00    
+ scp /data/support/src/support.mozilla.org/kitsune/configs/sphinx/stopwords.txt pp-app-sphinx02.phx.mozilla.com:/data/sphinx/support/stopwords.txt
stopwords.txt                                                                                                                    100%  954     0.9KB/s   00:00    
+ echo 'Restarting httpd...'
Restarting httpd...
+ issue-multi-command support /sbin/service httpd graceful
[2012-01-24 15:02:58] [support1.webapp.phx1.mozilla.com] running: /sbin/service httpd graceful
[2012-01-24 15:02:58] [support2.webapp.phx1.mozilla.com] running: /sbin/service httpd graceful
[2012-01-24 15:02:58] [support3.webapp.phx1.mozilla.com] running: /sbin/service httpd graceful
[2012-01-24 15:02:58] [support4.webapp.phx1.mozilla.com] running: /sbin/service httpd graceful
[2012-01-24 15:02:58] [support5.webapp.phx1.mozilla.com] running: /sbin/service httpd graceful
[2012-01-24 15:02:58] [support1.webapp.phx1.mozilla.com] finished: /sbin/service httpd graceful (0.783s)
[2012-01-24 15:02:58] [support2.webapp.phx1.mozilla.com] finished: /sbin/service httpd graceful (0.794s)
[2012-01-24 15:02:58] [support3.webapp.phx1.mozilla.com] finished: /sbin/service httpd graceful (0.836s)
[2012-01-24 15:02:59] [support5.webapp.phx1.mozilla.com] finished: /sbin/service httpd graceful (0.873s)
[2012-01-24 15:02:59] [support4.webapp.phx1.mozilla.com] finished: /sbin/service httpd graceful (0.953s)
+ echo 'Restarting Celery...'
Restarting Celery...
+ issue-multi-command support-celery /sbin/service celeryd-kitsune-prod restart
[2012-01-24 15:02:59] [sumocelery1.webapp.phx1.mozilla.com] running: /sbin/service celeryd-kitsune-prod restart
[2012-01-24 15:03:11] [sumocelery1.webapp.phx1.mozilla.com] finished: /sbin/service celeryd-kitsune-prod restart (12.564s)
[sumocelery1.webapp.phx1.mozilla.com] out: Restarting celery-kitsune-prod: celery-kitsune-prod: stopped
[sumocelery1.webapp.phx1.mozilla.com] out: celery-kitsune-prod: started
[sumocelery1.webapp.phx1.mozilla.com] out: [  OK  ]
Status: NEW → RESOLVED
Last Resolved: 6 years ago
Resolution: --- → FIXED
Component: Server Operations: Web Operations → WebOps: Other
Product: mozilla.org → Infrastructure & Operations
You need to log in before you can comment on or make changes to this bug.