Closed
Bug 1404905
Opened 7 years ago
Closed 7 years ago
Please deploy autopush 1.37.0 to PRODUCTION
Categories
(Cloud Services :: Operations: Deployment Requests - DEPRECATED, task)
Cloud Services
Operations: Deployment Requests - DEPRECATED
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: grumpy, Assigned: oremj)
References
Details
Please deploy autopush 1.37.0 to PRODUCTION starting at 9AM Pacific time on October 2nd, 2017
Features
remove Simplepush from codebase (61b57524, closes #799)
Bug Fixes
dump_rpy_heap before calling objgraph (ece7db1a, closes #1028)
Remove discussion comment and useless bool return (243b7d31, closes #1026)
Reporter | ||
Comment 1•7 years ago
|
||
-----------------------------------------------
URL CHECKS (PROD PRE-DEPLOY)
-----------------------------------------------
╰─$ py.test -v --env=production --api-version=1.36.0 tests/test_urls.py
===================================================== test session starts =====================================================
platform darwin -- Python 3.6.1, pytest-3.1.2, py-1.4.34, pluggy-0.4.0 -- /Users/chartjes/mozilla-services/autopush-deployment-tests/venv/bin/python3.6
cachedir: .cache
rootdir: /Users/chartjes/mozilla-services/autopush-deployment-tests, inifile:
collected 2 items
tests/test_urls.py::test_health PASSED
tests/test_urls.py::test_status PASSED
PASS on production pre-deploy
Reporter | ||
Comment 2•7 years ago
|
||
-----------------------------------------------
E2E-TESTS: VAPID (+Android PRE-DEPLOY)
-----------------------------------------------
Additional E2E-test which includes VAPID, encryption:
https://jrconlin.github.io/Webpush_QA/
FF Android (Nightly, Release) -- OK
Reporter | ||
Comment 3•7 years ago
|
||
-----------------------------------------------
TOPIC SERVER
-----------------------------------------------
Follow directions at https://github.com/jrconlin/topics using new profile in Firefox desktop release.
PASS on production pre-deployment
Reporter | ||
Comment 4•7 years ago
|
||
----------------------------
SCENARIO TESTING
see: https://github.com/mozilla-services/ap-loadtester/
----------------------------
MULTI-SCENARIO (SOAK) TESTS
[0]. basic
[1]. api_test
[2]. loadtest
All passed on production pre-deployment
Reporter | ||
Comment 5•7 years ago
|
||
----------------------------
E2E-TESTS
----------------------------
DESKTOP E2E PUSH TEST
Install Docker, grab the image firefoxtesteng/autopush-e2e-test and then start the container using the command:
docker run -p 8201:8201 firefoxtesteng/autopush-e2e-test
Using a fresh profile for Firefox, go to to http://localhost:8201
* go to about:config and set dom.push.serverURL = wss://push.services.mozilla.com/
Test #1
* with 'service-worker.js' selected click on 'Register Service Worker' and see the messages:
registering service worker
registered service worker. scope: http://localhost:8201/
* alter the 'Title' and 'Body' fields in the Notifications Property form to unique values
* click on 'pop Notification' and verify the notification contains your expected Title and Body
* click on 'close Notification' and verify the notification is closed
Test #2
* click on 'subscribe to push'
* change values for 'repeat' and 'delay' to have at least 2 messages with at least 5 seconds between them
* click on 'XHR to webpush app-server' and verify the number of messages sent and the delay between them is accurate
Passes on PROD prior to deployment
Reporter | ||
Comment 6•7 years ago
|
||
-------------------------------------
iOS: SYNC + FxA + PUSH TEST
-------------------------------------
SETUP
- Get account for buddybuild (from: njpark)
- Download “TestFlight” app
- Receive invite to use, enter code
- Get latest Beta Build (“click Update, if needed”)
- Create new FxA accounts (against PROD FxA server)
- Login to FxA account with a fresh Firefox profile
- Save some bookmarks and create some navigation history
TEST STEPS (STR)
- Go to settings in new download of Firefox iOS app
- Login to new FxA (PROD) account
- wait or force sync activity
- Observe bookmarks and history appear in Firefox browser
RESULTS
- bookmark sync - OK
- history sync - OK
Reporter | ||
Comment 7•7 years ago
|
||
-----------------------------------------------
SENTRY TEST -- PRE-DEPLOYMENT
-----------------------------------------------
My IP address: 108.160.90.26
╰─$ py.test -v --api-version=1.35.1 --env=production tests/test_sentry.py
==================================================================================== test session starts =====================================================================================
platform darwin -- Python 3.6.1, pytest-3.1.2, py-1.4.34, pluggy-0.4.0 -- /Users/chartjes/mozilla-services/autopush-deployment-tests/venv/bin/python3.6
cachedir: .cache
rootdir: /Users/chartjes/mozilla-services/autopush-deployment-tests, inifile:
collected 1 items
tests/test_sentry.py::test_generate_logcheck_error PASSED
{'ami_id': 'ami-e66a989e', 'authorization': [Filtered], 'message_ttl': None, 'python_version': '2.7.13 (c925e7381036, Jun 05 2017, 21:20:51)
[PyPy 5.8.0 with GCC 6.2.0 20160901]', 'remote_ip': '108.160.90.26, 172.31.1.137', 'request_id': '2098ef86-7795-4e15-9156-d65a29fe232b', 'uri': '/v1/err/crit', 'user_agent': 'python-requests/2.18.1'}
Successfully generated Sentry error, PASS but there is a large backlog of Sentry errors. It took approximately 45 minutes from generating the logcheck error to receiving notification that the error had been generated.
Reporter | ||
Comment 8•7 years ago
|
||
QA approves that pre-production is in an acceptable state, and gives the okay for deploying 1.37 to production starting at 9AM Pacific time.
Reporter | ||
Comment 9•7 years ago
|
||
-----------------------------------------------
URL CHECKS (PROD DEPLOY)
-----------------------------------------------
─$ py.test -v --env=production --api-version=1.37.0 tests/test_urls.py
===================================================== test session starts =====================================================
platform darwin -- Python 3.6.1, pytest-3.1.2, py-1.4.34, pluggy-0.4.0 -- /Users/chartjes/mozilla-services/autopush-deployment-tests/venv/bin/python3.6
cachedir: .cache
rootdir: /Users/chartjes/mozilla-services/autopush-deployment-tests, inifile:
collected 2 items
tests/test_urls.py::test_health PASSED
tests/test_urls.py::test_status PASSED
URL checks PASS
Reporter | ||
Comment 10•7 years ago
|
||
-----------------------------------------------
E2E-TESTS: VAPID (+Android POST-DEPLOY)
-----------------------------------------------
Additional E2E-test which includes VAPID, encryption:
https://jrconlin.github.io/Webpush_QA/
FF Android (Nightly, Release) using PROD -- PASS
Reporter | ||
Comment 11•7 years ago
|
||
-----------------------------------------------
TOPIC SERVER
-----------------------------------------------
Follow directions at https://github.com/jrconlin/topics using new profile in Firefox desktop release.
PASS on production post-deployment
Reporter | ||
Comment 12•7 years ago
|
||
----------------------------
SCENARIO TESTING -- POST DEPLOYMENT
see: https://github.com/mozilla-services/ap-loadtester/
----------------------------
MULTI-SCENARIO (SOAK) TESTS
[1]. basic
[2]. api_test
[3]. loadtest
All passed
Reporter | ||
Comment 13•7 years ago
|
||
----------------------------
E2E-TESTS
----------------------------
DESKTOP E2E PUSH TEST
Install Docker, grab the image firefoxtesteng/autopush-e2e-test and then start the container using the command:
docker run -p 8201:8201 firefoxtesteng/autopush-e2e-test
Using a fresh profile for Firefox, go to to http://localhost:8201
* go to about:config and makes sure to set dom.push.serverURL = wss://push.services.mozilla.com/
Test #1
* with 'service-worker.js' selected click on 'Register Service Worker' and see the messages:
registering service worker
registered service worker. scope: http://localhost:8201/
* alter the 'Title' and 'Body' fields in the Notifications Property form to unique values
* click on 'pop Notification' and verify the notification contains your expected Title and Body
* click on 'close Notification' and verify the notification is closed
Test #2
* click on 'subscribe to push'
* change values for 'repeat' and 'delay' to have at least 2 messages with at least 5 seconds between them
* click on 'XHR to webpush app-server' and verify the number of messages sent and the delay between them is accurate
Passes on PROD post-deployment
Reporter | ||
Comment 14•7 years ago
|
||
-------------------------------------
iOS: SYNC + FxA + PUSH TEST
-------------------------------------
SETUP
- Get account for buddybuild (from: njpark)
- Download “TestFlight” app
- Receive invite to use, enter code
- Get latest Beta Build (“click Update, if needed”)
- Create new FxA accounts (against PROD FxA server)
- Login to FxA account with a fresh Firefox profile
- Save some bookmarks and create some navigation history
TEST STEPS (STR)
- Go to settings in new download of Firefox iOS app
- Login to new FxA (PROD) account
- wait or force sync activity
- Observe bookmarks and history appear in Firefox browser
RESULTS
- bookmark sync - OK
- history sync - OK
Passes on PROD post-deployment
Reporter | ||
Comment 15•7 years ago
|
||
-----------------------------------------------
SENTRY TEST -- POST-DEPLOYMENT
-----------------------------------------------
My IP address: 108.160.90.26
─$ py.test -v --env=production --api-version=1.37.0 tests/test_sentry.py
===================================================== test session starts =====================================================
platform darwin -- Python 3.6.1, pytest-3.1.2, py-1.4.34, pluggy-0.4.0 -- /Users/chartjes/mozilla-services/autopush-deployment-tests/venv/bin/python3.6
cachedir: .cache
rootdir: /Users/chartjes/mozilla-services/autopush-deployment-tests, inifile:
collected 1 items
tests/test_sentry.py::test_generate_logcheck_error PASSED
{'ami_id': 'ami-f8d62d80', 'authorization': [Filtered], 'message_ttl': None, 'python_version': '2.7.13 (c925e7381036, Jun 05 2017, 21:20:51)
[PyPy 5.8.0 with GCC 6.2.0 20160901]', 'remote_ip': '108.160.90.26, 172.31.33.33', 'request_id': '121a02e3-3249-45f8-ac68-20f57a1d5377', 'uri': '/v1/err/crit', 'user_agent': 'python-requests/2.18.1'}
PASS post-deploy but there was a 45 minute delay from generating the error to being notified by Sentry.
Reporter | ||
Comment 16•7 years ago
|
||
QA approves the deployment of autopush 1.37 to production
Assignee | ||
Updated•7 years ago
|
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
You need to log in
before you can comment on or make changes to this bug.
Description
•