Closed Bug 1287957 Opened 9 years ago Closed 9 years ago

Please deploy autopush 1.16.1 to STAGE

Categories

(Cloud Services :: Operations: Deployment Requests - DEPRECATED, task)

Product:
Cloud Services
Component:
Operations: Deployment Requests - DEPRECATED
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
VERIFIED FIXED

People

(Reporter: rpapa, Assigned: oremj)

References

Details

------------------ RELEASE NOTES ------------------ https://github.com/mozilla-services/autopush/releases COMPARISONS https://github.com/mozilla-services/autopush/compare/1.15.0...1.15.1 https://github.com/mozilla-services/autopush/compare/1.15.1...1.16.0 https://github.com/mozilla-services/autopush/compare/1.16.0...1.16.1 TAGS https://github.com/mozilla-services/autopush/releases/tag/1.16.1 https://github.com/mozilla-services/autopush/commit/0c81d6934b0a95e129554cd3186bb0074ffb56a7 CHANGELOG ## 1.16.1 (2016-07-19) #### Bug Fixes * catch InvalidToken exceptions from fernet ([b00ae57c](https://github.com/mozilla-services/autopush/commit/b00ae57c2b6f6613ce81c0567815c7336cd30783), closes [#530](https://github.com/mozilla-services/autopush/issues/530)) * overwrite existing messages instead of throwing an error ([aa738816](https://github.com/mozilla-services/autopush/commit/aa738816ca3dd7c5ed803cffaa14c7ef8abc9f5f), closes [#535](https://github.com/mozilla-services/autopush/issues/535)) * fix up AWS conditional binding and assoc. conditions ([9e3fedbe](https://github.com/mozilla-services/autopush/commit/9e3fedbefcfc3b35863020281f4eaadb2453fee2)) * remove use of buggy moto from websocket/db tests ([07fd0caf](https://github.com/mozilla-services/autopush/commit/07fd0cafe5fd1087173f7894030788d3a41b4e90), closes [#531](https://github.com/mozilla-services/autopush/issues/531)) * ensure router_type is present in all records ([aeeea3ab](https://github.com/mozilla-services/autopush/commit/aeeea3abf4cd697e6400bbe8dd61c5eb2b3131f9), closes [#526](https://github.com/mozilla-services/autopush/issues/526)) ## 1.16.0 (2016-07-15) #### Bug Fixes * refactor register uaid lookup to verify proper records ([a01dabd7](https://github.com/mozilla-services/autopush/commit/a01dabd7808f4a050595fe25e274e7808eba2291), closes [#523](https://github.com/mozilla-services/autopush/issues/523)) * restore pragma line for full coverage ([677e72dd](https://github.com/mozilla-services/autopush/commit/677e72dda1cc6c8c4ee0a0d0103e1011a46e58d4)) * Invalidate UAIDs that are not lowercase or contain dashes ([265d7689](https://github.com/mozilla-services/autopush/commit/265d7689412afcd90bcf04b805abaea419bea4a7), closes [#519](https://github.com/mozilla-services/autopush/issues/519)) * log message errors as info instead of debug ([ccc2d685](https://github.com/mozilla-services/autopush/commit/ccc2d6858b27a0f3e542785293fcc57578bf5998), closes [#518](https://github.com/mozilla-services/autopush/issues/518)) * remove shared file inclusion for tests ([465bcb34](https://github.com/mozilla-services/autopush/commit/465bcb349c301a0f7048c5941042b9716eb0070e), closes [#515](https://github.com/mozilla-services/autopush/issues/515)) * include webpush handler in endpoint config ([b4493acb](https://github.com/mozilla-services/autopush/commit/b4493acbc58b6c23d4d2ec94ac6d63bf4d0b6911)) * Elevate GCM reported error states ([04080539](https://github.com/mozilla-services/autopush/commit/040805397c49842cc9b580aa05cd6368790e9319)) * handle different behavior in rotating table tests at month-end ([19973721](https://github.com/mozilla-services/autopush/commit/199737218444aaf50e9bbacd78e262967fccc734), closes [#502](https://github.com/mozilla-services/autopush/issues/502)) * remove failing key check from sentry logging ([6c90f8dc](https://github.com/mozilla-services/autopush/commit/6c90f8dcb5641e8f13199bbfaa20edfa66975279)) * add integration testing and verification of sentry reporting ([ee4e3398](https://github.com/mozilla-services/autopush/commit/ee4e3398eb3d525a54c0199ba93b76358c7fd1ef), closes [#493](https://github.com/mozilla-services/autopush/issues/493)) * Elevate GCM reported error states ([fb5ae0b3](https://github.com/mozilla-services/autopush/commit/fb5ae0b324678ce2f8ed0a2bc1fac5ac6b588c9e)) * handle different behavior in rotating table tests at month-end ([bd60b39e](https://github.com/mozilla-services/autopush/commit/bd60b39e3f99cd960f48d5cdb6cad2b58b24241f), closes [#502](https://github.com/mozilla-services/autopush/issues/502)) * remove failing key check from sentry logging ([3782024b](https://github.com/mozilla-services/autopush/commit/3782024b9de099df6650a776ba8dae6d9dc6379d)) * add integration testing and verification of sentry reporting ([9c70b88f](https://github.com/mozilla-services/autopush/commit/9c70b88f6c8515ac8f5bfdcc099075e0701123b7), closes [#493](https://github.com/mozilla-services/autopush/issues/493)) #### Test * lower time-outs for failed notification checks ([ed7a69f4](https://github.com/mozilla-services/autopush/commit/ed7a69f4e2a87451be52862425a0c5a45e24d0a9)) * fix/add remaining tests for 100% test coverage ([c505edf7](https://github.com/mozilla-services/autopush/commit/c505edf71d294ea7ed42212503a282fe78b241a9)) #### Breaking Changes * add AMI instance ID to the logged information ([058c601b](https://github.com/mozilla-services/autopush/commit/058c601b423e70ec191da35a5251e147aa1c26a8), closes [#483](https://github.com/mozilla-services/autopush/issues/483), breaks [#](https://github.com/mozilla-services/autopush/issues/)) * add AMI instance ID to the logged information ([663eec02](https://github.com/mozilla-services/autopush/commit/663eec021b41482ea6171582fa35951b92cfdeb6), closes [#483](https://github.com/mozilla-services/autopush/issues/483), breaks [#](https://github.com/mozilla-services/autopush/issues/)) #### Features * wait for tables to be active in pre-flight check ([fb143a9b](https://github.com/mozilla-services/autopush/commit/fb143a9b9068a1130607a5894c7e87ade1fbe8bc), closes [#433](https://github.com/mozilla-services/autopush/issues/433)) * add diagnostic CLI tool for endpoints ([a17679f3](https://github.com/mozilla-services/autopush/commit/a17679f3c9fede9833f451fd910781c924557ad6), closes [#509](https://github.com/mozilla-services/autopush/issues/509)) * change how bad bridge tokens are handled ([0c73fd0b](https://github.com/mozilla-services/autopush/commit/0c73fd0b39c93af0276df9d215dea2ed2b2d17dd)) * add metrics to bridge protocols ([e45b82dd](https://github.com/mozilla-services/autopush/commit/e45b82dd995f4dbe28e0b6888bc25404bdf8efc1)) * add AMI instance ID to the logged information ([058c601b](https://github.com/mozilla-services/autopush/commit/058c601b423e70ec191da35a5251e147aa1c26a8), closes [#483](https://github.com/mozilla-services/autopush/issues/483), breaks [#](https://github.com/mozilla-services/autopush/issues/)) * refactor webpush endpoint for validation schemas ([c1923e1c](https://github.com/mozilla-services/autopush/commit/c1923e1ca827d919932e48c94d71b3d1ac15899a), closes [#379](https://github.com/mozilla-services/autopush/issues/379)) * refactor simplepush endpoint for validation schemas ([050d7038](https://github.com/mozilla-services/autopush/commit/050d7038c2ffb3c76dbf25872fc507071ae6e845)) * Add endpoint to test logging ([824d102d](https://github.com/mozilla-services/autopush/commit/824d102d53dce066a2c6ff49c5b730a2f684840e), closes [#478](https://github.com/mozilla-services/autopush/issues/478)) * change how bad bridge tokens are handled ([0eb471b6](https://github.com/mozilla-services/autopush/commit/0eb471b69f5af596cf020dd2c52e0657ff5b5f9e)) * add metrics to bridge protocols ([126203bb](https://github.com/mozilla-services/autopush/commit/126203bb7bd4a161191dc10202249822de404752)) * add AMI instance ID to the logged information ([663eec02](https://github.com/mozilla-services/autopush/commit/663eec021b41482ea6171582fa35951b92cfdeb6), closes [#483](https://github.com/mozilla-services/autopush/issues/483), breaks [#](https://github.com/mozilla-services/autopush/issues/)) * refactor webpush endpoint for validation schemas ([f5f366fc](https://github.com/mozilla-services/autopush/commit/f5f366fc95c6bcb4eddb084c3c4eff8a7c5a1612), closes [#379](https://github.com/mozilla-services/autopush/issues/379)) * refactor simplepush endpoint for validation schemas ([d66102b7](https://github.com/mozilla-services/autopush/commit/d66102b74c22f442ce49ef35c6b2be15a81b5471)) * Add endpoint to test logging ([0684d898](https://github.com/mozilla-services/autopush/commit/0684d898b0ebdfcf75d10823ea999ee921f141f2), closes [#478](https://github.com/mozilla-services/autopush/issues/478)) #### Chore * add python27 dockerfile (#495) ([bfc4f16a](https://github.com/mozilla-services/autopush/commit/bfc4f16a79771c07f42de297d5036b7aa992fb26)) * add requirements - gnureadline for pypy (#477) ([58f9919d](https://github.com/mozilla-services/autopush/commit/58f9919d032cd94006c0b6b6b06d561d86089589)) * add default.nix for nix/nixos users ([62454d65](https://github.com/mozilla-services/autopush/commit/62454d65a85466553d76ab6f4ef3e6bdf9671c40)) * add python27 dockerfile (#495) ([183d2984](https://github.com/mozilla-services/autopush/commit/183d2984c1c45d3ffbb45369395196acf2c991fd)) * add requirements - gnureadline for pypy (#477) ([d2baf047](https://github.com/mozilla-services/autopush/commit/d2baf04793bdaa62945458ce4c26ae9e7b574cdd)) * add default.nix for nix/nixos users ([19e939b6](https://github.com/mozilla-services/autopush/commit/19e939b64415c3c0a705d62412ff1c4eac5a0615)) * **Dockerfile:** * die quickly if build command fails (#476) ([1cb329fa](https://github.com/mozilla-services/autopush/commit/1cb329fa99f663b80189ff4eef745faeafdcc9a1))
Assignee: nobody → oremj
Status: NEW → ASSIGNED
QA Contact: rpappalardo
1.16.1 has been deployed to stage.
Status: ASSIGNED → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
---------------------------- URL CHECKS (STAGE) ---------------------------- https://updates-autopush.stage.mozaws.net/health: { "status": "OK", "stage.autopush.routerv2": { "status": "OK" }, "stage.autopush.storage": { "status": "OK" }, "version": "1.16.1", "clients": 0 } Response time: 0.369032 https://updates-autopush.stage.mozaws.net/status: { "status": "OK", "version": "1.16.1" } Response time: 0.355972
---------------------------- E2E-TESTS ---------------------------- HELLO FIREFOX unable to do Hello verification as Hello STAGE is down. Will follow-up w/ Hello team tomorrow, but this won't be a blocker for this release. DESKTOP E2E PUSH TEST setup: start browser with new profile open: about:config set: dom.push.loglevel=debug (instead of 'off') open: Tools > WebDeveloper > BrowserConsole open: https://people.mozilla.org/~ewong2/push-notification-test/ choose: "service-worker.js" click: "register Service Worker" click: "subscribe to push" observe push registration in console click: "Always Receive Notifications" (in pop-up window) 1. registration test steps: click: "XHR to webpush app-server" observe: successful registration in console 2. message delivery test setup: set: Repeat = 2 set: Delay (seconds) = 15 steps: click: "XHR to webpush app-server" observe: 2 pop notifications 15 seconds apart 3. payload test setup: set: Title = PAYLOAD TEST set: Body = BODY TEXT HERE set: TTL = 120 set: Repeat = 4 set: Delay (seconds): 20 steps: click: "XHR to webpush app-server" observe: should see delayed pop notifications with Title, Body specified 4. storage test purpose: verify that a request is stored on autopush for delayed delivery setup: (same as 3 above) steps: click: "XHR to webpush app-server wait for pop notification, then immediately close browser wait 25 seconds re-open browser observe: should see 3 more delayed messages delivered on browser restart 5. storage test with message flood purpose: verify that a "flood" of requests are stored on autopush for delayed delivery setup: (same as 3 above) only set Flood Delay (this will trigger notification flood behavior) steps: click: "XHR to webpush app-server wait for pop notification, then immediately close browser wait 25 seconds re-open browser observe: should see 3 more delayed messages delivered on browser restart
---------------------------- SCENARIO TESTING see: https://github.com/mozilla-services/ap-loadtester/ ---------------------------- NOTE: * no scenario should throw Sentry errors * as of this release, notification_forever_bad_tokens scenario should no longer throw Sentry errors HAPPY PATH TESTS [1]. basic scenario - 3x runs of 10, 50, 200 instances - NO ERRORS [2]. connect_and_idle_forever scenario - 1x run of 20 instances - NO ERRORS [3]. reconnect_forever scenario [4]. register_forever scenario [5]. notification_forever scenario [6]. notification_forever_stored scenario - 20 instances (each) of the following scenarios simultaneously for 1 hour - NO ERRORS UNHAPPY PATH TESTS [7]. notification_forever_unsubscribed - 2x 3 instances every 5 seconds for 20 minutes - NO ERRORS [8]. notification_forever_bad_tokens - NO ERRORS - 1x 10 instances [9]. notification_forever_bad_endpoints - 2x 3 instances every 5 seconds for 20 minutes - NO ERRORS MULTI-SCENARIO [10]. api_test - 1x run of 20 instances - NO ERRORS [11]. loadtest - 1x run of 20 instances - NO ERRORS - NOTE: ap-loadtester throwing an intermittent traceback, but this is likely a framework issue - see: https://github.com/mozilla-services/ap-loadtester/issues/55
Status: RESOLVED → VERIFIED
---------------------------- TEST SUMMARY ---------------------------- ap-loadtester scenarios and end-to-end push tests passing. Verifying STAGE
:chartjes, :pjenvey ================================== ADDITIONAL NOTES FOR DEPLOY TESTING ================================== ---------------------- URL checks ---------------------- Do URL checks (see ticket above) ---------------------- E2E Tests ---------------------- Do E2E tests (see ticket above) NOTE: E2E tests will be the same for STAGE, PROD. User the following config settings for STAGE, PROD: STAGE dom.push.serverURL = autopush.stage.mozaws.net PROD dom.push.serverURL = push.services.mozilla.com ---------------------- API Tests ---------------------- Objective: run through the basic, api_test scenarios Use the following command format: aplt_testplan wss://autopush.stage.mozaws.net/ "aplt.scenarios:basic,5,1,0" see: https://github.com/mozilla-services/ap-loadtester scenarios listed here (and summarized below): https://github.com/mozilla-services/ap-loadtester/blob/master/aplt/scenarios.py NOTE: only run basic and api_test against PROD! It's OK to run the other tests on STAGE. Note that api_test and loadtest scenarios are "multi-scenario" wrappers for the other tests. STAGE basic connect_and_idle_forever reconnect_forever register_forever notification_forever notification_forever_stored notification_forever_unsubscribed notification_forever_bad_tokens notification_forever_bad_endpoints api_test loadtest PROD basic api_test
You need to log in before you can comment on or make changes to this bug.