1385906 - Please deploy autopush 1.34.0 to STAGE

Status: VERIFIED FIXED

(Cloud Services Graveyard :: Operations: Autopush, task)

Description

[Chris Hartjes [:grumpy][:chartjes]]

RELEASE NOTES


Breaking Changes

    make simplepush protocol optional (876c9593, breaks #)

Features

    make simplepush protocol optional (876c9593, breaks #)
    make cryptography lib optional (c96fea9b, closes #979)

Bug Fixes

    move metric increments to lowest callbacks (637e246f, closes #958)

Refactor

    give DatabaseManager some saner defaults (d5c9136a)

Chore

    upgrade to latest cryptography (e0ae4cb9)
    fix syntax (2d77393e)
    upgrade travis to trusty (abbf7afe)
    explicitly set update on requirements.txt (9c2d8434)
    add a pyup config file (8c634423)

Comment 1

[Chris Hartjes [:grumpy][:chartjes]]

Sentry, version, and health checks passed:

± % py.test -v --api-version=1.34.0 --env=stage tests                                                            
================================================= test session starts =================================================
platform darwin -- Python 3.6.1, pytest-3.1.2, py-1.4.34, pluggy-0.4.0 -- /Users/chartjes/mozilla-services/autopush-deployment-tests/venv/bin/python3.6
cachedir: .cache
rootdir: /Users/chartjes/mozilla-services/autopush-deployment-tests, inifile:
collected 4 items

tests/test_sentry.py::test_generate_logcheck_error PASSED
tests/test_service.py::test_hello PASSED
tests/test_urls.py::test_health PASSED
tests/test_urls.py::test_status PASSED

Comment 2

[Chris Hartjes [:grumpy][:chartjes]]

-------------------------------------
iOS: SYNC + FxA + PUSH TEST (STAGE)
-------------------------------------

SETUP 

- Get account for buddybuild (from: njpark)
- Download “TestFlight” app
- Receive invite to use, enter code
- Get latest Beta Build (“click Update, if needed”)

- Create new FxA account for STAGE(STAGE) https://accounts.stage.mozaws.net/
- Login to desktop STAGE FxA account with a fresh firefox profile
- Save some bookmarks and create some navigation history

TEST STEPS (STR)
- Go to settings in new download of Firefox iOS app
- Click on Version info 5x, to enable STAGE server toggle switch
- Flip toggle to point to STAGE server(s)
- Login to new FxA (STAGE) account
- wait or force sync activity
- Observe bookmarks and history appear in Firefox browser

RESULTS

Nightly and Release keep asking me to sign in to staging sync bookmarks, tried with several fresh profiles.

FAIL iOS test on STAGE

Comment 3

[Chris Hartjes [:grumpy][:chartjes]]

----------------------------
E2E-TESTS: VAPID (+Android)
----------------------------

Additional E2E-test which includes VAPID, encryption:
https://jrconlin.github.io/Webpush_QA/

Android (Nightly, Release) -- OK

NOTE:

This page can also be used to test Android, however, 
on STAGE / PROD gcm path + senderID must be appended (see below).
oremj> the sender ids are 965234145045 and 829133274407 (for both STAGE & PROD)

 
STAGE:
dom.push.serverURL = https://updates-autopush.stage.mozaws.net/v1/gcm/829133274407

PROD:
dom.push.serverURL = https://updates.push.services.mozilla.com/v1/gcm/829133274407


unlike paths for desktop (uses sockets):

STAGE:
dom.push.serverURL = wss://autopush.stage.mozaws.net/

PROD:
dom.push.serverURL = wss://push.services.mozilla.com/

STAGE E2E testing passed

Comment 4

[Chris Hartjes [:grumpy][:chartjes]]

----------------------------
E2E-TESTS
----------------------------

setting STAGE config to:
dom.push.serverURL = autopush.stage.mozaws.net

DESKTOP E2E PUSH TEST

setup:
start browser with new profile
open: about:config
set: dom.push.loglevel=debug (instead of 'off')
open: Tools > WebDeveloper > BrowserConsole
open: https://mozilla-services.github.io/autopush-e2e-test/
choose: "service-worker.js"
click: "register Service Worker"
click: "subscribe to push"
observe push registration in console
click: "Always Receive Notifications" (in pop-up window)

1. registration test

steps:
click: "XHR to webpush app-server"
observe: successful registration in console

2. message delivery test

setup:
set: Repeat = 2
set: Delay (seconds) = 15

steps:
click: "XHR to webpush app-server"
observe: 2 pop notifications 15 seconds apart
 
3. payload test

setup:
set: Title = PAYLOAD TEST
set: Body = BODY TEXT HERE
set: TTL = 360
set: Repeat = 4
set: Delay (seconds): 20

steps:
click: "XHR to webpush app-server"
observe:
should see delayed pop notifications with Title, Body specified

4. storage test

purpose: verify that a request is stored on autopush for delayed delivery

setup:
(same as 3 above)

steps:
click: "XHR to webpush app-server
wait for pop notification, then immediately close browser
wait 25 seconds
re-open browser
observe:
should see 3 more delayed messages delivered on browser restart


Passed

Comment 5

[Chris Hartjes [:grumpy][:chartjes]]

----------------------------
SCENARIO TESTING 
see: https://github.com/mozilla-services/ap-loadtester/
----------------------------

MULTI-SCENARIO (SOAK) TESTS

[0]. basic
[1]. api_test
[2]. loadtest

All appear to have passed.

Need verification that there is an issue with syncing to accounts logged into stage FxA

Comment 6

[Chris Hartjes [:grumpy][:chartjes]]

After help from vladikoff in #fxa, another Firefox dev tool was used an the iOS sync test passed.

QA approves stage deployment and gives the okay to deploy 1.34.0 to production=.