production deploy demos.mozilla.org 1.4 release aka Phase IV

VERIFIED FIXED

Status

Infrastructure & Operations
WebOps: Other
VERIFIED FIXED
7 years ago
4 years ago

People

(Reporter: lmesa, Assigned: cshields)

Tracking

Details

(Whiteboard: [3/25 9AM], URL)

(Reporter)

Description

7 years ago
Hi, we have a web code + db migration push for Web O Wonder as part of the Fx 4
mobile and desktop launches.

We need to do this no later than 3/28 to support the Firefox 4 Mobile launch. 
We'll have a final confirmed push date today. 


Austin will comment on the bug with further instructions.

Comment 1

7 years ago
Note: QA is still testing stage.

Deployment instructions:
1) git pull origin master in webowonder-demos
This is the repo that serves up https://mozillademos.org

2) svn update in the locale directory
This is under the Django app that serves up https://demos.mozilla.org

3) Run './bin/update_site.py -e prod -v' in webowonder
This is the repro that is the Django app for https://demos.mozilla.org
This command migrates the db, compresses assets, etc.
Component: Server Operations → Server Operations: Web Content Push

Comment 2

7 years ago
4) Add Zeus traffic script as created for stage in Bug#640034
(Reporter)

Comment 3

7 years ago
(In reply to comment #2)
> 4) Add Zeus traffic script as created for stage in Bug#640034

Just spoke with Raymond and Paul and an AM push on Friday the 25th. 

Also, just spoke with Jeremy and that also sounds good to him.
Whiteboard: [3/25 9AM]
(Assignee)

Comment 4

7 years ago
(In reply to comment #1)
> Deployment instructions:
> 1) git pull origin master in webowonder-demos
> This is the repo that serves up https://mozillademos.org

[root@mradm02 mozillademos.org]# git pull origin master
remote: Counting objects: 72, done.
remote: Compressing objects: 100% (54/54), done.
remote: Total 54 (delta 41), reused 0 (delta 0)
Unpacking objects: 100% (54/54), done.
From https://github.com/mozilla/webowonder-demos
 * branch            master     -> FETCH_HEAD
Updating c819fc1..db779c7
Fast-forward
 demos/dashboard-mobile/demos/audiodataapi.html     |   50 ++++++-------------
 demos/dashboard-mobile/demos/video.html            |   11 +----
 demos/dashboard-mobile/demos/webgl.html            |    5 +-
 .../dashboard-mobile/demos/webgl_assets/gldemo.js  |   33 ++++---------
 demos/dashboard-mobile/screenshot.jpg              |  Bin 0 -> 14113 bytes
 demos/dashboard/demo.html                          |    4 +-
 demos/doubleui-mobile/screenshot.jpg               |  Bin 0 -> 11886 bytes
 demos/globetweeter/demo.html                       |    4 +-
 demos/holo-mobile/screenshot.jpg                   |  Bin 0 -> 46858 bytes
 demos/planetarium/demo.html                        |   10 ++--
 demos/runfield-mobile/screenshot.jpg               |  Bin 0 -> 44681 bytes
 11 files changed, 38 insertions(+), 79 deletions(-)
 create mode 100644 demos/dashboard-mobile/screenshot.jpg
 create mode 100644 demos/doubleui-mobile/screenshot.jpg
 create mode 100644 demos/holo-mobile/screenshot.jpg
 create mode 100644 demos/runfield-mobile/screenshot.jpg

> 2) svn update in the locale directory
> This is under the Django app that serves up https://demos.mozilla.org

[root@mradm02 locale]# svn up
U    uk/LC_MESSAGES/messages.po
U    zh-CN/LC_MESSAGES/messages.po
U    sq/LC_MESSAGES/messages.po
U    sr/LC_MESSAGES/messages.po
U    de/LC_MESSAGES/messages.po
U    ja/LC_MESSAGES/messages.po
U    he/LC_MESSAGES/messages.po
U    fr/LC_MESSAGES/messages.po
U    nl/LC_MESSAGES/messages.po
U    th/LC_MESSAGES/messages.po
U    pl/LC_MESSAGES/messages.po
U    hu/LC_MESSAGES/messages.po
U    rm/LC_MESSAGES/messages.po
U    fy/LC_MESSAGES/messages.po
U    vi/LC_MESSAGES/messages.po
U    ro/LC_MESSAGES/messages.po
U    ca/LC_MESSAGES/messages.po
U    pt/LC_MESSAGES/messages.po
U    tr/LC_MESSAGES/messages.po
U    ru/LC_MESSAGES/messages.po
U    ga/LC_MESSAGES/messages.po
U    id/LC_MESSAGES/messages.po
U    templates/LC_MESSAGES/messages.pot
U    el/LC_MESSAGES/messages.po
U    ar/LC_MESSAGES/messages.po
U    cs/LC_MESSAGES/messages.po
U    es/LC_MESSAGES/messages.po
U    zh-TW/LC_MESSAGES/messages.po
U    eu/LC_MESSAGES/messages.po
U    ko/LC_MESSAGES/messages.po
U    si/LC_MESSAGES/messages.po
U    it/LC_MESSAGES/messages.po
U    sl/LC_MESSAGES/messages.po
Updated to revision 86381.
[root@mradm02 locale]# ./compile-mo.sh .
[root@mradm02 locale]#

> 3) Run './bin/update_site.py -e prod -v' in webowonder
> This is the repro that is the Django app for https://demos.mozilla.org
> This command migrates the db, compresses assets, etc.

[root@mradm02 webowonder]# ./bin/update_site.py -e prod -v
cd /data/engagement/python/demos.mozilla.org/webowonder
git pull -q origin prod
Unpacking objects: 100% (75/75), done.
git submodule update --init
cd /data/engagement/python/demos.mozilla.org/webowonder/vendor
git pull -q origin master
Unpacking objects: 100% (3/3), done.
git submodule update --init
remote: Counting objects: 30, done.
remote: Compressing objects: 100% (22/22), done.
remote: Total 22 (delta 11), reused 0 (delta 0)
Unpacking objects: 100% (22/22), done.
From git://github.com/jsocol/jingo-minify
   95f24e9..cecbfb9  master     -> origin/master
 * [new tag]         0.3.2      -> 0.3.2
Submodule path 'src/jingo-minify': checked out 'cecbfb9dbb921894e1ffface687a1dc709beac5b'
cd /data/engagement/python/demos.mozilla.org/webowonder
python2.6 vendor/src/schematic/schematic migrations/
Error: Had trouble running this: CREATE TABLE schema_version (version INTEGER NOT NULL);
stdout: 
stderr: ERROR 2005 (HY000): Unknown MySQL server host 'db-engagement-rw-zeus' (1)

returncode: 1
python2.6 manage.py compress_assets

(need to add host pointers for migrations to work from mradm02..  also missed a tag so running it again)

[root@mradm02 webowonder]# /data/engagement/deploy 
Do you really want to push and reload apache? [y/n] y
[master e3bbacd] push
 122 files changed, 12147 insertions(+), 8429 deletions(-)
 delete mode 100644 python/demos.mozilla.org/webowonder/bin/.update_site.py.swp
 rewrite python/demos.mozilla.org/webowonder/locale/ar/LC_MESSAGES/messages.mo (86%)
 rewrite python/demos.mozilla.org/webowonder/locale/ca/LC_MESSAGES/messages.mo (87%)
 rewrite python/demos.mozilla.org/webowonder/locale/cs/LC_MESSAGES/messages.mo (88%)
 rewrite python/demos.mozilla.org/webowonder/locale/de/LC_MESSAGES/messages.mo (89%)
 rewrite python/demos.mozilla.org/webowonder/locale/el/LC_MESSAGES/messages.mo (90%)
 rewrite python/demos.mozilla.org/webowonder/locale/es/LC_MESSAGES/messages.mo (94%)
 create mode 100644 python/demos.mozilla.org/webowonder/locale/eu/LC_MESSAGES/messages.mo
 rewrite python/demos.mozilla.org/webowonder/locale/fr/LC_MESSAGES/messages.mo (87%)
 rewrite python/demos.mozilla.org/webowonder/locale/fy/LC_MESSAGES/messages.mo (84%)
 rewrite python/demos.mozilla.org/webowonder/locale/ga/LC_MESSAGES/messages.mo (88%)
 rewrite python/demos.mozilla.org/webowonder/locale/he/LC_MESSAGES/messages.mo (75%)
 rewrite python/demos.mozilla.org/webowonder/locale/hu/LC_MESSAGES/messages.mo (86%)
 rewrite python/demos.mozilla.org/webowonder/locale/id/LC_MESSAGES/messages.mo (96%)
 rewrite python/demos.mozilla.org/webowonder/locale/it/LC_MESSAGES/messages.mo (75%)
 rewrite python/demos.mozilla.org/webowonder/locale/ja/LC_MESSAGES/messages.mo (90%)
 rewrite python/demos.mozilla.org/webowonder/locale/ko/LC_MESSAGES/messages.mo (89%)
 rewrite python/demos.mozilla.org/webowonder/locale/nl/LC_MESSAGES/messages.mo (88%)
 rewrite python/demos.mozilla.org/webowonder/locale/pl/LC_MESSAGES/messages.mo (88%)
 rewrite python/demos.mozilla.org/webowonder/locale/pt/LC_MESSAGES/messages.mo (88%)
 rewrite python/demos.mozilla.org/webowonder/locale/rm/LC_MESSAGES/messages.mo (86%)
 rewrite python/demos.mozilla.org/webowonder/locale/ru/LC_MESSAGES/messages.mo (90%)
 rewrite python/demos.mozilla.org/webowonder/locale/si/LC_MESSAGES/messages.mo (91%)
 rewrite python/demos.mozilla.org/webowonder/locale/sl/LC_MESSAGES/messages.mo (88%)
 rewrite python/demos.mozilla.org/webowonder/locale/sq/LC_MESSAGES/messages.mo (87%)
 rewrite python/demos.mozilla.org/webowonder/locale/th/LC_MESSAGES/messages.mo (87%)
 rewrite python/demos.mozilla.org/webowonder/locale/tr/LC_MESSAGES/messages.mo (89%)
 create mode 100644 python/demos.mozilla.org/webowonder/locale/uk/LC_MESSAGES/messages.mo
 rewrite python/demos.mozilla.org/webowonder/locale/vi/LC_MESSAGES/messages.mo (61%)
 rewrite python/demos.mozilla.org/webowonder/locale/zh-CN/LC_MESSAGES/messages.mo (60%)
 rewrite python/demos.mozilla.org/webowonder/locale/zh-TW/LC_MESSAGES/messages.mo (89%)
 copy python/demos.mozilla.org/webowonder/media/css/{wow.css => desktop-common.css} (70%)
 copy python/demos.mozilla.org/webowonder/media/css/{wow.css => desktop-ie.css} (70%)
 create mode 100644 python/demos.mozilla.org/webowonder/media/css/desktop-ie.css.m4
 copy python/demos.mozilla.org/webowonder/media/css/{wow.css => desktop.css} (72%)
 create mode 100644 python/demos.mozilla.org/webowonder/media/css/desktop.css.m4
 create mode 100644 python/demos.mozilla.org/webowonder/media/css/mobile.css
 create mode 100644 python/demos.mozilla.org/webowonder/media/css/video-all.css
 create mode 100644 python/demos.mozilla.org/webowonder/media/css/video-min.css
 create mode 100644 python/demos.mozilla.org/webowonder/media/css/video.css
 rewrite python/demos.mozilla.org/webowonder/media/css/wow-min.css (98%)
 rename python/demos.mozilla.org/webowonder/media/css/{wow.css => wow_ie-all.css} (68%)
 create mode 100644 python/demos.mozilla.org/webowonder/media/css/wow_ie-min.css
 create mode 100644 python/demos.mozilla.org/webowonder/media/img/bg-rope-vertical.gif
 create mode 100644 python/demos.mozilla.org/webowonder/media/img/drop-shadows.png
 create mode 100644 python/demos.mozilla.org/webowonder/media/img/logo-web-o-wonder-mobile.png
 create mode 100644 python/demos.mozilla.org/webowonder/media/img/warning-flag.png
 create mode 100644 python/demos.mozilla.org/webowonder/migrations/27-mobile-demos-initial-data.sql
 create mode 100644 python/demos.mozilla.org/webowonder/migrations/28-platform-fixup.sql
 create mode 100644 python/demos.mozilla.org/webowonder/migrations/29-phase-IV.sql
 create mode 100644 python/demos.mozilla.org/webowonder/migrations/30-phase-IV-metadata.sql
 create mode 100644 python/demos.mozilla.org/webowonder/migrations/31-holo-mobile.sql
 create mode 100644 python/demos.mozilla.org/webowonder/migrations/32-doubleui-mobile-hide.sql
 create mode 100644 python/demos.mozilla.org/webowonder/migrations/33-github-links.sql
 create mode 100644 python/demos.mozilla.org/webowonder/migrations/34-nocompy-fotn-repo.sql
 rename python/demos.mozilla.org/webowonder/vendor/src/jingo-minify/jingo_minify/bin/{yuicompressor-2.4.2.jar => yuicompressor-2.4.4.jar} (90%)
 mode change 100755 => 100644
 rewrite python/mozillademos.org/demos/dashboard-mobile/demos/audiodataapi.html (95%)
 create mode 100644 python/mozillademos.org/demos/dashboard-mobile/screenshot.jpg
 create mode 100644 python/mozillademos.org/demos/doubleui-mobile/screenshot.jpg
 create mode 100644 python/mozillademos.org/demos/holo-mobile/screenshot.jpg
 create mode 100644 python/mozillademos.org/demos/runfield-mobile/screenshot.jpg
+ cd /data/sync/engagement
+ /usr/bin/git fetch -q
+ /usr/bin/git reset -q --hard origin
+ /data/bin/issue-multi-command.py engagement /data/bin/update-www.sh
[engagement3.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement1.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement2.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement6.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement4.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement8.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement5.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement7.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement9.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement12.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement10.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement13.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement11.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement14.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement16.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement15.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement17.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement20.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement18.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
[engagement19.seamicro.phx1.mozilla.com] run: /data/bin/update-www.sh
+ /data/bin/issue-multi-command.py engagement apachectl graceful
[engagement6.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement1.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement2.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement8.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement5.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement7.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement3.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement4.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement12.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement9.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement10.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement11.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement13.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement16.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement14.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement15.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement19.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement17.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement18.seamicro.phx1.mozilla.com] run: apachectl graceful
[engagement20.seamicro.phx1.mozilla.com] run: apachectl graceful


[root@node11.seamicro.phx1 webowonder]# python2.6 vendor/src/schematic/schematic migrations/
Running migration 27:

INSERT INTO demos_submission (title, slug, summary, description, featured, hidden, tags, screenshot_1, screenshot_2, screenshot_3, screenshot_4, screenshot_5, video_url, demo_package, source_code_url, license_name, creator_id, created, modified) 
VALUES ("Mobile HTML5 Poster", "dashboard-mobile", "", "Explore a beautiful CSS3 version of our universe.", b'1', b'0', "HTML5, Mobile", "/particles/screenshot.jpg", "", "", "", "", "", "", "https://github.com/paulrouget/html5dashboard_mobile", "", 3, NOW(), NOW());

UPDATE demos_submission SET slug = "doubleui-mobile", hidden = b'0' WHERE slug = 'double_ui';

UPDATE demos_submission SET slug = "holo-mobile", hidden = b'0' WHERE slug = 'hologram';

INSERT INTO demos_submission (title, slug, summary, description, featured, hidden, tags, screenshot_1, screenshot_2, screenshot_3, screenshot_4, screenshot_5, video_url, demo_package, source_code_url, license_name, creator_id, created, modified) 
VALUES ("Mobile Runfield", "runfield-mobile", "", "Build awesome games without plugins! How fast can your fox run?", b'1', b'0', "Canvas, Mobile", "/particles/screenshot.jpg", "", "", "", "", "", "", "https://github.com/kig/runfield", "", 4, NOW(), NOW());

ALTER TABLE wow_demodetails ADD COLUMN platform char DEFAULT 'D';

UPDATE wow_demodetails SET platform = 'M' WHERE demo_id IN (SELECT id FROM demos_submission WHERE slug IN ('dashboard-mobile', 'doubleui-mobile', 'holo-mobile', 'runfield-mobile'));
That took 0.24 seconds
################################################## 

Running migration 28:
-- Pre-populate wow_demodetails
INSERT INTO wow_demodetails (demo_id, documentary_description, rank) 
(select id, '', 1 from demos_submission WHERE slug IN ('dashboard-mobile', 'runfield-mobile'));

UPDATE wow_demodetails SET platform = 'M' WHERE demo_id IN (SELECT id FROM demos_submission WHERE slug IN ('dashboard-mobile', 'runfield-mobile'));


That took 0.05 seconds
################################################## 

Running migration 29:
UPDATE demos_submission SET hidden = b'0' WHERE slug IN ('flight-of-the-navigator', 'nocomply', 'globetweeter');

-- Sort desktop demos
UPDATE wow_demodetails SET rank=1 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug = 'flight-of-the-navigator');
UPDATE wow_demodetails SET rank=2 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug = 'nocomply');
UPDATE wow_demodetails SET rank=3 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug = 'globetweeter');
UPDATE wow_demodetails SET rank=4 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug = 'planetarium');
UPDATE wow_demodetails SET rank=5 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug = 'runfield');
UPDATE wow_demodetails SET rank=6 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug = 'shadows');
UPDATE wow_demodetails SET rank=7 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug = 'immersivevideo');

UPDATE wow_demodetails SET rank=8 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug = 'motivational');
UPDATE wow_demodetails SET rank=9 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug ='remixingreality');
UPDATE wow_demodetails SET rank=10 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug = 'londonproject');
UPDATE wow_demodetails SET rank=11 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug = 'dashboard');

-- Sort mobile demos
UPDATE wow_demodetails SET rank=12 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug = 'holo-mobile');
UPDATE wow_demodetails SET rank=13 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug = 'doubleui-mobile');
UPDATE wow_demodetails SET rank=14 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug = 'dashboard-mobile');
UPDATE wow_demodetails SET rank=15 WHERE demo_id = (SELECT id FROM demos_submission WHERE slug = 'runfield-mobile');
That took 0.07 seconds
################################################## 

Running migration 30:

INSERT INTO wow_collaborator (demo_id, details_id, rank)
SELECT (SELECT id FROM demos_submission WHERE slug = 'holo-mobile'),
       (SELECT id FROM auth_user WHERE username = 'unknown1'),
       1;

UPDATE demos_submission SET description = 'An in-depth tutorial on Web technologies featured in Firefox 4 Mobile.' WHERE slug = 'dashboard-mobile';

UPDATE demos_submission SET description = 'Explore a beautiful CSS3 version of our universe.' WHERE slug = 'holo-mobile';

UPDATE wow_demodetails SET documentary_description = 'Yes' WHERE demo_id IN   (SELECT id FROM demos_submission WHERE slug = 'doubleui-mobile');

UPDATE wow_demodetails SET documentary_description = 'Yes' WHERE demo_id IN   (SELECT id FROM demos_submission WHERE slug = 'planetarium');

UPDATE wow_demodetails SET documentary_description = 'Yes' WHERE demo_id IN   (SELECT id FROM demos_submission WHERE slug = 'holo-mobile');


That took 0.05 seconds
################################################## 

Running migration 31:

UPDATE demos_submission SET description = 'Simulate a 3D experience with a CSS parallax effect' WHERE slug = 'holo-mobile';

That took 0.05 seconds
################################################## 

Running migration 32:

UPDATE demos_submission SET hidden = b'1' WHERE slug = 'doubleui-mobile';
That took 0.05 seconds
################################################## 

Running migration 33:
UPDATE demos_submission SET source_code_url = 'https://github.com/humphd/nocomply' WHERE slug = 'nocomply';

UPDATE demos_submission SET source_code_url = 'https://github.com/humphd/fotn' WHERE slug = 'flight-of-the-navigator';

That took 0.04 seconds
################################################## 

Running migration 34:
UPDATE demos_submission SET source_code_url = 'https://github.com/cjcliffe/NoComply' WHERE slug = 'nocomply';

UPDATE demos_submission SET source_code_url = 'https://github.com/cjcliffe/FOTN' WHERE slug = 'flight-of-the-navigator';

That took 0.05 seconds
##################################################
(Assignee)

Comment 5

7 years ago
(In reply to comment #2)
> 4) Add Zeus traffic script as created for stage in Bug#640034

done.  with ipad added  (different than the mobile-detect script used in amo which has no ipad detection)
(Assignee)

Comment 6

7 years ago
pushed out and done from IT's perspective.
Assignee: server-ops → cshields
Status: NEW → RESOLVED
Last Resolved: 7 years ago
Resolution: --- → FIXED
verified fixed https://demos.mozilla.org/en-US/
Status: RESOLVED → VERIFIED
Component: Server Operations: Web Operations → WebOps: Other
Product: mozilla.org → Infrastructure & Operations
You need to log in before you can comment on or make changes to this bug.