713961 - QA and deploy BrowserID train-2011.12.28 to production

Status: VERIFIED FIXED

(Cloud Services :: Operations: Deployment Requests - DEPRECATED, task)

Description

[Lloyd Hilaiel [:lloyd]]

ChangeLog including issues resolved: 
https://github.com/mozilla/browserid/blob/train-2011.12.28/ChangeLog#L1-28

[QA] Suggested areas of focus for QA:
  * all platforms, verify correct opening of browserid dialog.  verify dialog can be opened multiple times in the same session.
  * regress any bugs that manifested as errors with the "relay frame": https://github.com/mozilla/browserid/issues/search?q=Relay%20frame
  * Ensure "keep me signed in" checkbox is visible when it should be.  try all possible paths to get to the email picker.  like "this is not me" then back.  That option should always be visible in the email picker when you open the dialog via beta.myfavoritebooze.org
  * allz the stuffs from ye changelog!  isn't that enough?

Comment 1

[James Bonacci [:jbonacci]]

QA accepts this train for testing in Stage.

Comment 2

[James Bonacci [:jbonacci]]

Initial Dev/OPs load test was completed yesterday.
QA load testing will begin on Tuesday, 01-03-2012, PST.

Comment 3

[James Bonacci [:jbonacci]]

Dev Set 1 (12/28) - on client4:
node bin/load_gen -s https://stage-browserid.services.mozilla.com -o -m 750000 -u 1/750
node bin/load_gen -s https://stage-browserid.services.mozilla.com -o -m 750000 -u 751/1500
node bin/load_gen -s https://stage-browserid.services.mozilla.com -o -m 750000 -u 1501/2250
node bin/load_gen -s https://stage-browserid.services.mozilla.com -o -m 750000 -u 3000/3750
node bin/load_gen -s https://stage-browserid.services.mozilla.com -o -m 750000 -u 5000/5750

Comment 4

[James Bonacci [:jbonacci]]

Code and Deployment Verification:
webheads:
node bin/browserid
node bin/verifier
/usr/bin/node /opt/browserid/lib/verifier/verifier-compute.js
/usr/bin/node /opt/browserid/lib/bcrypt-compute.js
secure webheads:
node bin/dbwriter
/usr/bin/node /opt/browserid/lib/bcrypt-compute.js
keysigners:
node bin/keysigner
/usr/bin/node /opt/browserid/lib/keysigner/keysigner-compute.js
databases:
/bin/sh /usr/bin/mysqld_safe --datadir=/data/mysql --pid-file=/var/run/mysqld/mysqld.pid
/usr/sbin/mysqld --basedir=/usr --datadir=/data/mysql --user=mysql --log-error=/data/mysql/db1.iddb.scl2.stage.svc.mozilla.com.err --open-files-limit=8192 --pid-file=/var/run/mysqld/mysqld.pid --socket=/var/run/mysqld/mysqld.sock --port=3306
perl /usr/bin/pt-heartbeat --create-table -D browserid -u root --update
zeus:
various zeus processes



Versions:
Old Dev:
https://dev.diresworb.org/ver.txt
98ab87c Adding vepbundle.js to the main site js.

Dev:
https://dev-browserid.services.mozilla.com/ver.txt
f8c2efd merge hotfix for issue #754 into beta: train-2011.12.08

Stage:
https://diresworb.org/ver.txt
08b727e ChangeLog update for issue #800

Prod:
https://browserid.org/ver.txt
f8c2efd merge hotfix for issue #754 into beta: train-2011.12.08



Server heartbeats:
old Dev: https://dev.diresworb.org/__heartbeat__
ok

Dev: https://dev-browserid.services.mozilla.com/__heartbeat__
ok

Stage: https://diresworb.org/__heartbeat__
ok

Prod: https://browserid.org/__heartbeat__
ok



Logs: Stage:
webheads: /var/log/browserid/
browserid.log
browserid-metrics.json
verifier.log
verifier-metrics.json
verifier-compute.log

secure webheads: /var/log/browserid/
dbwriter.log

keysigners have /var/log/browserid/
keysigner.log
keysigner-compute.log

dbs: various db logs

external/internal zeus has various access logs under /var/log/zeus

Log rotation and archiving is still not in place.

Comment 5

[James Bonacci [:jbonacci]]

Sanity testing is done.
Unit testing on Stage is done.
Unit testing on a local install is done.
Load testing on a local install is in progress...
Bug verification is in progress...

Comment 6

[James Bonacci [:jbonacci]]

Bug verification, new feature testing, and load testing are all in progress.
QA hopes to have this all completed by 11pm PST today for sign off.

Comment 7

[James Bonacci [:jbonacci]]

QA signs off on this train.
No current issues appear to be significant regressions.
Issues found during heavy load testing are being addressed.

Comment 8

[Pete Fritchman [:petef]]

shipped to prod

Comment 9

[James Bonacci [:jbonacci]]

Verified on Prod yesterday (12-05-2012)