754877 - QA and deploy BrowserID train-2012.05.14 to production

Status: VERIFIED INCOMPLETE

(Cloud Services :: Operations: Deployment Requests - DEPRECATED, task)

Description

[Lloyd Hilaiel [:lloyd]]

+++ This bug was initially created as a clone of Bug #749756 +++

Version: 8d9fc6d (0.2012.05.14.1) branch train-2012.05.14

Tests pass: http://travis-ci.org/#!/mozilla/browserid/builds/1328209

ChangeLog including issues resolved: 
https://github.com/mozilla/browserid/blob/train-2012.05.14/ChangeLog#L1-11

[QA] Suggested additional areas of focus for QA:
  * focus on first time sign-in with verification in the same and different browsers.
  * normal regression of closed issues mentioned in ChangeLog
  * test 123done.org

[ops] deployment issues:
  * SCHEMA CHANGES:  passwd CHAR(64) added to staged table - this field may be added before deployment, it will not break current code
  * REQUIRED NEW CONFIGURATION: we need a new json configuration value, kpi_backend_sample_rate set to 0.0 (number).

IMPORTANT NOTE: There is an outstanding issue that could derail this train related to expected user impact during deployment of this train: https://github.com/mozilla/browserid/issues/1592

Comment 1

[James Bonacci [:jbonacci]]

For #1592, QA should start the process of creating accounts with the current code in Stage. We should not verify those through email.
We should also attempt some password changes, but hold off on verifying those as well.
Then, we can have petef roll the code to 2012.04.14 and then attempt to click through those new account and password change links to see what happens.

Comment 2

[James Bonacci [:jbonacci]]

Some possible tests to try:
1. brand new account
2. adding secondary to acct with only primary
(3. adding primary to account with only secondary)
(4. adding primary to primary)
5. adding secondary to acct w/ secondary
6. resetting a forgotten password

Comment 3

[Pete Fritchman [:petef]]

DB change note: since browserid.staged is so small, not bothering with pt-online-schema-change, so just running "alter table staged add column passwd char(64);" on the master and letting the DDL replicate to slaves.

Comment 4

[Pete Fritchman [:petef]]

ok, pushed to stage (db change, config change, and new RPM).

Comment 5

[James Bonacci [:jbonacci]]

QA accepts this train to Stage:
8d9fc6d merge hotfixes from train-2012.04.27
locale svn r105177

Comment 6

[James Bonacci [:jbonacci]]

:petef can you update the clientX boxes for QA?
Thanks!

Comment 7

[Pete Fritchman [:petef]]

(In reply to James Bonacci [:jbonacci] from comment #6)
> :petef can you update the clientX boxes for QA?
> Thanks!

updated those & l10n-preview

Comment 8

[James Bonacci [:jbonacci]]

:jrgm and :ioana.budnar - sorry for being remiss in my duties here....
Release wiki:
https://wiki.mozilla.org/QA/Browser_Technologies/Services/Releases/BrowserID_05142012

Test Plan spreadsheet:
https://docs.google.com/spreadsheet/ccc?key=0As8GUPwNNWMFdHJGMnpRMHVja1JHX250eXdIUEFsM0E#gid=0

Comment 9

[John Morrison [:jrgm]]

QA signs off on this (non-shipping) train. 
- verifications done
- load_gen stopped today @11:50, since we'll be pushing out a new train in a
  while.
  - web3.idweb.scl2.stage was rebooted during the test due to a hardware issue
  - still see occasions when the LB will have spurts of unavailability
    (returns Service Unavailable message). Also other ECONNREFUSED errors that
    can't be correlated to backend problems.
  - I've seen a few more cases where there are single errors that do appear to
    be real, but the logs don't leave any context about what happened. 
  - 7 errors on the backend that report "error forwarding request to
    keysigner: Error: getaddrinfo ENOENT" (or forwarding to dbwriter). They
    all happened at 3 specific times on 2012-05-22, so not seemingly code 
    related.

Comment 10

[Pete Fritchman [:petef]]

Since QA has signed off and we're not shipping this to prod, closing this for now.

Comment 11

[James Bonacci [:jbonacci]]

Final updates here:
https://wiki.mozilla.org/QA/Browser_Technologies/Services/Releases/BrowserID_05142012