Closed Bug 1404905 Opened 7 years ago Closed 7 years ago

Please deploy autopush 1.37.0 to PRODUCTION

Categories

(Cloud Services :: Operations: Deployment Requests - DEPRECATED, task)

Product:
Cloud Services
Component:
Operations: Deployment Requests - DEPRECATED
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: grumpy, Assigned: oremj)

References

Details

Please deploy autopush 1.37.0 to PRODUCTION starting at 9AM Pacific time on October 2nd, 2017 Features remove Simplepush from codebase (61b57524, closes #799) Bug Fixes dump_rpy_heap before calling objgraph (ece7db1a, closes #1028) Remove discussion comment and useless bool return (243b7d31, closes #1026)
----------------------------------------------- URL CHECKS (PROD PRE-DEPLOY) ----------------------------------------------- ╰─$ py.test -v --env=production --api-version=1.36.0 tests/test_urls.py ===================================================== test session starts ===================================================== platform darwin -- Python 3.6.1, pytest-3.1.2, py-1.4.34, pluggy-0.4.0 -- /Users/chartjes/mozilla-services/autopush-deployment-tests/venv/bin/python3.6 cachedir: .cache rootdir: /Users/chartjes/mozilla-services/autopush-deployment-tests, inifile: collected 2 items tests/test_urls.py::test_health PASSED tests/test_urls.py::test_status PASSED PASS on production pre-deploy
----------------------------------------------- E2E-TESTS: VAPID (+Android PRE-DEPLOY) ----------------------------------------------- Additional E2E-test which includes VAPID, encryption: https://jrconlin.github.io/Webpush_QA/ FF Android (Nightly, Release) -- OK
----------------------------------------------- TOPIC SERVER ----------------------------------------------- Follow directions at https://github.com/jrconlin/topics using new profile in Firefox desktop release. PASS on production pre-deployment
---------------------------- SCENARIO TESTING see: https://github.com/mozilla-services/ap-loadtester/ ---------------------------- MULTI-SCENARIO (SOAK) TESTS [0]. basic [1]. api_test [2]. loadtest All passed on production pre-deployment
---------------------------- E2E-TESTS ---------------------------- DESKTOP E2E PUSH TEST Install Docker, grab the image firefoxtesteng/autopush-e2e-test and then start the container using the command: docker run -p 8201:8201 firefoxtesteng/autopush-e2e-test Using a fresh profile for Firefox, go to to http://localhost:8201 * go to about:config and set dom.push.serverURL = wss://push.services.mozilla.com/ Test #1 * with 'service-worker.js' selected click on 'Register Service Worker' and see the messages: registering service worker registered service worker. scope: http://localhost:8201/ * alter the 'Title' and 'Body' fields in the Notifications Property form to unique values * click on 'pop Notification' and verify the notification contains your expected Title and Body * click on 'close Notification' and verify the notification is closed Test #2 * click on 'subscribe to push' * change values for 'repeat' and 'delay' to have at least 2 messages with at least 5 seconds between them * click on 'XHR to webpush app-server' and verify the number of messages sent and the delay between them is accurate Passes on PROD prior to deployment
------------------------------------- iOS: SYNC + FxA + PUSH TEST ------------------------------------- SETUP - Get account for buddybuild (from: njpark) - Download “TestFlight” app - Receive invite to use, enter code - Get latest Beta Build (“click Update, if needed”) - Create new FxA accounts (against PROD FxA server) - Login to FxA account with a fresh Firefox profile - Save some bookmarks and create some navigation history TEST STEPS (STR) - Go to settings in new download of Firefox iOS app - Login to new FxA (PROD) account - wait or force sync activity - Observe bookmarks and history appear in Firefox browser RESULTS - bookmark sync - OK - history sync - OK
----------------------------------------------- SENTRY TEST -- PRE-DEPLOYMENT ----------------------------------------------- My IP address: 108.160.90.26 ╰─$ py.test -v --api-version=1.35.1 --env=production tests/test_sentry.py ==================================================================================== test session starts ===================================================================================== platform darwin -- Python 3.6.1, pytest-3.1.2, py-1.4.34, pluggy-0.4.0 -- /Users/chartjes/mozilla-services/autopush-deployment-tests/venv/bin/python3.6 cachedir: .cache rootdir: /Users/chartjes/mozilla-services/autopush-deployment-tests, inifile: collected 1 items tests/test_sentry.py::test_generate_logcheck_error PASSED {'ami_id': 'ami-e66a989e', 'authorization': [Filtered], 'message_ttl': None, 'python_version': '2.7.13 (c925e7381036, Jun 05 2017, 21:20:51) [PyPy 5.8.0 with GCC 6.2.0 20160901]', 'remote_ip': '108.160.90.26, 172.31.1.137', 'request_id': '2098ef86-7795-4e15-9156-d65a29fe232b', 'uri': '/v1/err/crit', 'user_agent': 'python-requests/2.18.1'} Successfully generated Sentry error, PASS but there is a large backlog of Sentry errors. It took approximately 45 minutes from generating the logcheck error to receiving notification that the error had been generated.
QA approves that pre-production is in an acceptable state, and gives the okay for deploying 1.37 to production starting at 9AM Pacific time.
----------------------------------------------- URL CHECKS (PROD DEPLOY) ----------------------------------------------- ─$ py.test -v --env=production --api-version=1.37.0 tests/test_urls.py ===================================================== test session starts ===================================================== platform darwin -- Python 3.6.1, pytest-3.1.2, py-1.4.34, pluggy-0.4.0 -- /Users/chartjes/mozilla-services/autopush-deployment-tests/venv/bin/python3.6 cachedir: .cache rootdir: /Users/chartjes/mozilla-services/autopush-deployment-tests, inifile: collected 2 items tests/test_urls.py::test_health PASSED tests/test_urls.py::test_status PASSED URL checks PASS
----------------------------------------------- E2E-TESTS: VAPID (+Android POST-DEPLOY) ----------------------------------------------- Additional E2E-test which includes VAPID, encryption: https://jrconlin.github.io/Webpush_QA/ FF Android (Nightly, Release) using PROD -- PASS
----------------------------------------------- TOPIC SERVER ----------------------------------------------- Follow directions at https://github.com/jrconlin/topics using new profile in Firefox desktop release. PASS on production post-deployment
---------------------------- SCENARIO TESTING -- POST DEPLOYMENT see: https://github.com/mozilla-services/ap-loadtester/ ---------------------------- MULTI-SCENARIO (SOAK) TESTS [1]. basic [2]. api_test [3]. loadtest All passed
---------------------------- E2E-TESTS ---------------------------- DESKTOP E2E PUSH TEST Install Docker, grab the image firefoxtesteng/autopush-e2e-test and then start the container using the command: docker run -p 8201:8201 firefoxtesteng/autopush-e2e-test Using a fresh profile for Firefox, go to to http://localhost:8201 * go to about:config and makes sure to set dom.push.serverURL = wss://push.services.mozilla.com/ Test #1 * with 'service-worker.js' selected click on 'Register Service Worker' and see the messages: registering service worker registered service worker. scope: http://localhost:8201/ * alter the 'Title' and 'Body' fields in the Notifications Property form to unique values * click on 'pop Notification' and verify the notification contains your expected Title and Body * click on 'close Notification' and verify the notification is closed Test #2 * click on 'subscribe to push' * change values for 'repeat' and 'delay' to have at least 2 messages with at least 5 seconds between them * click on 'XHR to webpush app-server' and verify the number of messages sent and the delay between them is accurate Passes on PROD post-deployment
------------------------------------- iOS: SYNC + FxA + PUSH TEST ------------------------------------- SETUP - Get account for buddybuild (from: njpark) - Download “TestFlight” app - Receive invite to use, enter code - Get latest Beta Build (“click Update, if needed”) - Create new FxA accounts (against PROD FxA server) - Login to FxA account with a fresh Firefox profile - Save some bookmarks and create some navigation history TEST STEPS (STR) - Go to settings in new download of Firefox iOS app - Login to new FxA (PROD) account - wait or force sync activity - Observe bookmarks and history appear in Firefox browser RESULTS - bookmark sync - OK - history sync - OK Passes on PROD post-deployment
----------------------------------------------- SENTRY TEST -- POST-DEPLOYMENT ----------------------------------------------- My IP address: 108.160.90.26 ─$ py.test -v --env=production --api-version=1.37.0 tests/test_sentry.py ===================================================== test session starts ===================================================== platform darwin -- Python 3.6.1, pytest-3.1.2, py-1.4.34, pluggy-0.4.0 -- /Users/chartjes/mozilla-services/autopush-deployment-tests/venv/bin/python3.6 cachedir: .cache rootdir: /Users/chartjes/mozilla-services/autopush-deployment-tests, inifile: collected 1 items tests/test_sentry.py::test_generate_logcheck_error PASSED {'ami_id': 'ami-f8d62d80', 'authorization': [Filtered], 'message_ttl': None, 'python_version': '2.7.13 (c925e7381036, Jun 05 2017, 21:20:51) [PyPy 5.8.0 with GCC 6.2.0 20160901]', 'remote_ip': '108.160.90.26, 172.31.33.33', 'request_id': '121a02e3-3249-45f8-ac68-20f57a1d5377', 'uri': '/v1/err/crit', 'user_agent': 'python-requests/2.18.1'} PASS post-deploy but there was a 45 minute delay from generating the error to being notified by Sentry.
QA approves the deployment of autopush 1.37 to production
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.