Closed Bug 1530830 Opened 6 years ago Closed 6 years ago

Test autopush 1.53.1 on PRODUCTION

Categories

(Cloud Services :: Operations: Deployment Requests - DEPRECATED, task)

task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: grumpy, Assigned: oremj)

Details

QA to test Autopush release 1.53.1 in PRODUCTION after deployment

Chore

update pytest req per latest pytest_cov (bb651f01)
upgrade dependencies (e978dc68, closes #1311)

Features

add gcm endpoint configuration argument (5fd37e24, closes #1315)
Use FCM HTTPv1 protocol with twisted async (e111ec10, closes #1291)
Remove unused secondary global index (1833f5aa)
Assignee: nobody → oremj
QA Contact: chartjes

URL AND SENTRY CHECKS

pytest -v --env=production --api-version=1.53.1 tests/

tests/test_sentry.py::test_generate_logcheck_error PASSED
tests/test_urls.py::test_status_endpoint PASSED

Sentry notification generated and manually resolved.

Sentry reported the following information:

{'ami_id': 'ami-07dd86398b2b87106', 'authorization': [Filtered], 'message_ttl': None, 'python_version': '2.7.13 (ab0b9caf307d, Apr 24 2018, 18:04:42)
[PyPy 6.0.0 with GCC 6.2.0 20160901]', 'remote_ip': '108.160.90.26, 172.31.15.36', 'request_id': 'd126e8de-7600-4f66-8f60-d8fa3668a8d8', 'uri': '/v1/err/crit', 'user_agent': 'python-requests/2.21.0'}

whatsmyip.com reports my IP address as 108.160.90.26

PASS

E2E-TESTS: VAPID (+Android)

Additional E2E-test which includes VAPID, encryption:
https://jrconlin.github.io/Webpush_QA/

Also includes tests of FCM functionality

FF Android (Nightly, Release) -- PASS

SCENARIO TESTING

https://github.com/mozilla-services/ap-loadtester/

MULTI-SCENARIO (SOAK) TESTS

[0]. aplt_scenario basic FAIL
[1]. aplt_scenario api_test FAIL
[2]. aplt_scenario loadtest (5 minute duration) FAIL

All three tests generating the same error:

exceptions.Exception: Unexpected event. Last Command: send_notification; Data: {'messageType': 'disconnect', 'was_c
lean': False, 'code': 1006, 'reason': u'connection was closed uncleanly (peer dropped the TCP connection without previous W
ebSocket closing handshake)'}

Flags: needinfo?(bbangert)
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → FIXED

Ran through all the other tests:

  • desktop e2e -> PASS
  • topic server -> PASS

Will investigate why the ap_loadtester tool detected problems for me but not for the development team, might have to do with differences between their environments and the WSL environment I was running things in.

Flags: needinfo?(bbangert)
You need to log in before you can comment on or make changes to this bug.