Closed Bug 656209 Opened 13 years ago Closed 13 years ago

Update builder.addons.mozilla.org on 5/11 @ 1600 (0.9.4)

Categories

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Product:
Infrastructure & Operations Graveyard
Component:
WebOps: Other
Platform:
All
Other
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
VERIFIED FIXED

People

(Reporter: clouserw, Assigned: nmaul)

Details

Please update builder on 5/11 at 4pm.  Details emerging at http://etherpad.mozilla.org:9000/bamo-0-9-4-push
adding stephen to the loop.  His team will start assisting with Builder deployments going forward.
The etherpad is up to date.  Let's meet in #flightdeck.  Who is doing this bug?
After some assistance from jabba and oremj, this is completed. Waiting on QA verification...

Etherpad+output.


In settings_local:
        Add ES_* variable for production hardware.  See bug 651932
) Update code to tag: 0.9.4
[root@mradm02 flightdeck]# git fetch
remote: Counting objects: 592, done.
remote: Compressing objects: 100% (466/466), done.
remote: Total 476 (delta 331), reused 0 (delta 0)
Receiving objects: 100% (476/476), 549.51 KiB, done.
Resolving deltas: 100% (331/331), completed with 49 local objects.
From git://github.com/mozilla/FlightDeck
   32604dd..f66ef91  master     -> origin/master
   7b0a411..f493cef  staging    -> origin/staging
 * [new tag]         0.9.4      -> 0.9.4
 
[root@mradm02 flightdeck]# git checkout 0.9.4
M    lib/addon-sdk-0.9
M    lib/addon-sdk-1.0b2
M    lib/addon-sdk-1.0b3
M    lib/addon-sdk-1.0b4
M    vendor
Previous HEAD position was 7b0a411... limited dragging to list items that represent a 'file', not a 'directory'.
HEAD is now at f493cef... increase max size of search results to 50
) `git submodule update --init --recursive`
[root@mradm02 flightdeck]# git submodule update --init --recursive
remote: Counting objects: 59, done.
remote: Compressing objects: 100% (53/53), done.
remote: Total 55 (delta 5), reused 0 (delta 0)
Unpacking objects: 100% (55/55), done.
From git://github.com/mozilla/FlightDeck-lib
   36092c2..70c5d6d  master     -> origin/master
 * [new branch]      test       -> origin/test
Submodule path 'vendor': checked out 'f9bc29d8475f92bf04049f7d53817e141ed89fba'
) Run schematic? [y/n]: y
[root@mradm02 flightdeck]# python26 vendor/src/schematic/schematic migrations/
Running migration 7:
ALTER TABLE api_docpage ENGINE=InnoDB;
ALTER TABLE auth_group ENGINE=InnoDB;
ALTER TABLE auth_group_permissions ENGINE=InnoDB;
ALTER TABLE auth_message ENGINE=InnoDB;
ALTER TABLE auth_permission ENGINE=InnoDB;
ALTER TABLE auth_user ENGINE=InnoDB;
ALTER TABLE auth_user_groups ENGINE=InnoDB;
ALTER TABLE auth_user_user_permissions ENGINE=InnoDB;
ALTER TABLE base_celeryresponse ENGINE=InnoDB;
ALTER TABLE django_admin_log ENGINE=InnoDB;
ALTER TABLE django_content_type ENGINE=InnoDB;
ALTER TABLE django_session ENGINE=InnoDB;
ALTER TABLE django_site ENGINE=InnoDB;
ALTER TABLE jetpack_attachment ENGINE=InnoDB;
ALTER TABLE jetpack_attachment_revisions ENGINE=InnoDB;
ALTER TABLE jetpack_emptydir ENGINE=InnoDB;
ALTER TABLE jetpack_emptydir_revisions ENGINE=InnoDB;
ALTER TABLE jetpack_module ENGINE=InnoDB;
ALTER TABLE jetpack_module_revisions ENGINE=InnoDB;
ALTER TABLE jetpack_package ENGINE=InnoDB;
ALTER TABLE jetpack_packagerevision ENGINE=InnoDB;
ALTER TABLE jetpack_packagerevision_dependencies ENGINE=InnoDB;
ALTER TABLE jetpack_sdk ENGINE=InnoDB;
ALTER TABLE person_limit ENGINE=InnoDB;
ALTER TABLE person_profile ENGINE=InnoDB;
ALTER TABLE jetpack_attachment ADD FOREIGN KEY (author_id) REFERENCES auth_user(id);
ALTER TABLE jetpack_attachment_revisions ADD FOREIGN KEY (attachment_id) REFERENCES jetpack_attachment(id);
ALTER TABLE jetpack_attachment_revisions ADD FOREIGN KEY (packagerevision_id) REFERENCES jetpack_packagerevision(id);
ALTER TABLE jetpack_packagerevision ADD FOREIGN KEY (package_id) REFERENCES jetpack_package(id);
ALTER TABLE jetpack_packagerevision ADD FOREIGN KEY (author_id) REFERENCES auth_user (id);
ALTER TABLE jetpack_packagerevision ADD FOREIGN KEY (origin_id) REFERENCES jetpack_packagerevision (id);
ALTER TABLE jetpack_packagerevision ADD FOREIGN KEY (sdk_id) REFERENCES jetpack_sdk(id);
ALTER TABLE jetpack_packagerevision_dependencies ADD FOREIGN KEY (from_packagerevision_id) REFERENCES jetpack_packagerevision (id);
ALTER TABLE jetpack_packagerevision_dependencies ADD FOREIGN KEY (to_packagerevision_id) REFERENCES jetpack_packagerevision (id);
ALTER TABLE jetpack_package ADD FOREIGN KEY (author_id) REFERENCES auth_user(id);
ALTER TABLE jetpack_package ADD FOREIGN KEY (latest_id) REFERENCES jetpack_packagerevision(id);
ALTER TABLE jetpack_package ADD FOREIGN KEY (version_id) REFERENCES jetpack_packagerevision(id);
ALTER TABLE jetpack_module_revisions ADD FOREIGN KEY (module_id) REFERENCES jetpack_module(id);
ALTER TABLE jetpack_module_revisions ADD FOREIGN KEY (packagerevision_id) REFERENCES jetpack_packagerevision(id);
ALTER TABLE jetpack_module ADD FOREIGN KEY (author_id) REFERENCES auth_user(id);
ALTER TABLE jetpack_emptydir ADD FOREIGN KEY (author_id) REFERENCES auth_user(id);
ALTER TABLE jetpack_emptydir_revisions ADD FOREIGN KEY (emptydir_id) REFERENCES jetpack_emptydir(id);
ALTER TABLE jetpack_emptydir_revisions ADD FOREIGN KEY (packagerevision_id) REFERENCES jetpack_packagerevision(id);
ALTER TABLE jetpack_sdk ADD FOREIGN KEY (core_lib_id) REFERENCES jetpack_packagerevision(id);
ALTER TABLE jetpack_sdk ADD FOREIGN KEY (kit_lib_id) REFERENCES jetpack_packagerevision(id);
ALTER TABLE person_profile ADD FOREIGN KEY (user_id) REFERENCES auth_user(id);
ALTER TABLE auth_permission ADD FOREIGN KEY (content_type_id) REFERENCES django_content_type (id);
ALTER TABLE auth_group_permissions ADD FOREIGN KEY (permission_id) REFERENCES auth_permission (id);
ALTER TABLE auth_group_permissions ADD FOREIGN KEY (group_id) REFERENCES auth_group (id);
ALTER TABLE auth_user_user_permissions ADD FOREIGN KEY (permission_id) REFERENCES auth_permission (id);
ALTER TABLE auth_user_groups ADD FOREIGN KEY (group_id) REFERENCES auth_group (id);
ALTER TABLE auth_user_user_permissions ADD FOREIGN KEY (user_id) REFERENCES auth_user (id);
ALTER TABLE auth_user_groups ADD FOREIGN KEY (user_id) REFERENCES auth_user (id);
ALTER TABLE auth_message ADD FOREIGN KEY (user_id) REFERENCES auth_user (id);
That took 36.84 seconds
################################################## 
Running migration 8:
-- Just some cleanup; bug 653227
-- I don't think we need this, we discard all our celery
-- responses (CELERY_IGNORE_RESULT=True)
DROP TABLE IF EXISTS `base_celeryresponse`;
-- These tables exist on stage but not production.  They
-- are just old and empty, should clean them up
DROP TABLE IF EXISTS `djcelery_crontabschedule`;
DROP TABLE IF EXISTS `djcelery_intervalschedule`;
DROP TABLE IF EXISTS `djcelery_periodictask`;
DROP TABLE IF EXISTS `djcelery_periodictasks`;
DROP TABLE IF EXISTS `djcelery_taskstate`;
DROP TABLE IF EXISTS `djcelery_workerstate`;
That took 0.11 seconds
################################################## 
) Push all code out
[root@mradm02 flightdeck]# /root/bin/flightdeck_justpush.sh 
[pm-app-amo26] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo26] out: Not removing prod/zamboni/apps/nick/
[pm-app-amodev01] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amodev01] out: Not removing preview/zamboni/apps/cronjobs/
[pm-app-amodev01] out: Not removing preview/zamboni/apps/nick/
[pm-app-amodev01] out: Not removing prod/zamboni/apps/nick/
[pm-app-amo10] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo07] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo21] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo19] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo15] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo16] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo20] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo18] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo17] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo24] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo24] out: Not removing preview/zamboni/apps/cronjobs/
[pm-app-amo04] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo12] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo05] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo27] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo25] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo13] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo03] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo02] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo14] run: /data/bin/libget/get-php5-www-git.sh
[pm-app-amo11] run: /data/bin/libget/get-php5-www-git.sh
[pm-gearman-amo02] run: /data/bin/libget/get-php5-www-git.sh
[pm-gearman-amo02] out: Not removing addons.mozilla.org-preview/site/app/locale/sr-Latn/
[pm-gearman-amo02] out: Not removing addons.mozilla.org-remora/site/app/locale/sr-Latn/
[pm-gearman-amo02] out: Not removing services.addons.mozilla.org/site/app/locale/sr-Latn/
[pm-gearman-amo02] out: Not removing preview/zamboni/__MACOSX/
[pm-gearman-amo02] out: Not removing preview/zamboni/apps/cronjobs/
[pm-gearman-amo02] out: Not removing preview/zamboni/chrome/
[pm-gearman-amo02] out: Not removing preview/zamboni/defaults/
[pm-gearman-amo01] run: /data/bin/libget/get-php5-www-git.sh
[pm-gearman-amo01] out: Not removing addons.mozilla.org-preview/site/app/locale/sr-Latn/
[pm-gearman-amo01] out: Not removing addons.mozilla.org-remora/site/app/locale/sr-Latn/
[pm-gearman-amo01] out: Not removing services.addons.mozilla.org/site/app/locale/sr-Latn/
[pm-app-amo02] run: apachectl graceful; sleep 2
[pm-app-amo03] run: apachectl graceful; sleep 2
[pm-app-amo04] run: apachectl graceful; sleep 2
[pm-app-amo05] run: apachectl graceful; sleep 2
[pm-app-amo07] run: apachectl graceful; sleep 2
[pm-app-amo10] run: apachectl graceful; sleep 2
[pm-app-amo11] run: apachectl graceful; sleep 2
[pm-app-amo12] run: apachectl graceful; sleep 2
[pm-app-amo13] run: apachectl graceful; sleep 2
[pm-app-amo14] run: apachectl graceful; sleep 2
[pm-app-amo15] run: apachectl graceful; sleep 2
[pm-app-amo16] run: apachectl graceful; sleep 2
[pm-app-amo17] run: apachectl graceful; sleep 2
[pm-app-amo18] run: apachectl graceful; sleep 2
[pm-app-amo19] run: apachectl graceful; sleep 2
[pm-app-amo20] run: apachectl graceful; sleep 2
[pm-app-amo21] run: apachectl graceful; sleep 2
[pm-app-amo24] run: apachectl graceful; sleep 2
[pm-app-amo25] run: apachectl graceful; sleep 2
[pm-app-amo26] run: apachectl graceful; sleep 2
[pm-app-amo27] run: apachectl graceful; sleep 2
[pm-app-amodev01] run: apachectl graceful; sleep 2
) restart celeryd
(continuing from previous command)
Restart celery? [y/n] y
[pm-gearman-amo02] run: service celeryd-builder_prod restart
[pm-gearman-amo02] out: Restarting celery-builder_prod: celery-builder_prod: stopped
[pm-gearman-amo02] out: celery-builder_prod: started
[pm-gearman-amo02] out: [  OK  ]
[pm-gearman-amo01] run: service celeryd-builder_prod restart
[pm-gearman-amo01] out: Restarting celery-builder_prod: celery-builder_prod: stopped
[pm-gearman-amo01] out: celery-builder_prod: started
[pm-gearman-amo01] out: [  OK  ]
) import scripts/crontab/prod to crontab
diff with current crontab shows no change, skipping...
) run `./manage.py cron index_all`
[root@mradm02 flightdeck]# python26 manage.py cron index_all
[root@mradm02 flightdeck]#
Assignee: server-ops → nmaul
Status: NEW → ASSIGNED
Status: ASSIGNED → RESOLVED
Closed: 13 years ago
Resolution: --- → FIXED
Verified FIXED, as best I can tell by poking around and talking to the team.  We'll get the next one better-coordinated with an available QA contact.
Status: RESOLVED → VERIFIED
Sorry guys, I let this one slip..  In the habit of making sure pushes are assigned for Tuesdays and Thursdays, wasn't expecting anything today.
(In reply to comment #5)
> Sorry guys, I let this one slip..  In the habit of making sure pushes are
> assigned for Tuesdays and Thursdays, wasn't expecting anything today.

I filed the bug pretty late too.  Fwiw, we're aiming builder pushes for every other wednesday right now.
Component: Server Operations: Web Operations → WebOps: Other
Product: mozilla.org → Infrastructure & Operations
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.