1677717 - Perma /_mozilla/webdriver/new_session/debugger_address.py | test_debugger_address_true - assert None is not None when Gecko 85 merges to Beta on 2020-12-14

Status: VERIFIED FIXED

(Testing :: geckodriver, defect, P1)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

central-as-beta simulation
Failure log

[task 2020-11-17T11:51:58.533Z] 11:51:58 INFO - STDOUT: =================================== FAILURES ===================================
[task 2020-11-17T11:51:58.533Z] 11:51:58 INFO - STDOUT: __________________________ test_debugger_address_true __________________________
[task 2020-11-17T11:51:58.533Z] 11:51:58 INFO - STDOUT: new_session = <function new_session at 0x7f646b066cd0>
[task 2020-11-17T11:51:58.533Z] 11:51:58 INFO - STDOUT: configuration = {'capabilities': {'moz:firefoxOptions': {'binary': '/builds/worker/workspace/build/application/firefox/firefox', 'pref...form.test', 'network.process.enabled': False, 'toolkit.asyncshutdown.log': True}}}, 'host': '127.0.0.1', 'port': 39236}
[task 2020-11-17T11:51:58.534Z] 11:51:58 INFO - STDOUT: def test_debugger_address_true(new_session, configuration):
[task 2020-11-17T11:51:58.534Z] 11:51:58 INFO - STDOUT: capabilities = dict(configuration["capabilities"])
[task 2020-11-17T11:51:58.534Z] 11:51:58 INFO - STDOUT: capabilities["moz:debuggerAddress"] = True
[task 2020-11-17T11:51:58.534Z] 11:51:58 INFO - STDOUT:
[task 2020-11-17T11:51:58.536Z] 11:51:58 INFO - STDOUT: response, _ = new_session({"capabilities": {"alwaysMatch": capabilities}})
[task 2020-11-17T11:51:58.536Z] 11:51:58 INFO - STDOUT: result = assert_success(response)
[task 2020-11-17T11:51:58.536Z] 11:51:58 INFO - STDOUT:
[task 2020-11-17T11:51:58.536Z] 11:51:58 INFO - STDOUT: debugger_address = result["capabilities"].get("moz:debuggerAddress")
[task 2020-11-17T11:51:58.536Z] 11:51:58 INFO - STDOUT: > assert debugger_address is not None
[task 2020-11-17T11:51:58.536Z] 11:51:58 INFO - STDOUT: E assert None is not None
[task 2020-11-17T11:51:58.538Z] 11:51:58 INFO - STDOUT: _ = {'capabilities': {'acceptInsecureCerts': False, 'browserName': 'firefox', 'browserVersion': '85.0', 'moz:accessibilityChecks': False, ...}, 'sessionId': 'fdb1ea6f-bff8-40bd-896b-35164ef96d9a'}
[task 2020-11-17T11:51:58.538Z] 11:51:58 INFO - STDOUT: capabilities = {'moz:debuggerAddress': True, 'moz:firefoxOptions': {'binary': '/builds/worker/workspace/build/application/firefox/fir...m.test,xn--lve-6lad.www2.not-web-platform.test', 'network.process.enabled': False, 'toolkit.asyncshutdown.log': True}}}
[task 2020-11-17T11:51:58.538Z] 11:51:58 INFO - STDOUT: configuration = {'capabilities': {'moz:firefoxOptions': {'binary': '/builds/worker/workspace/build/application/firefox/firefox', 'pref...form.test', 'network.process.enabled': False, 'toolkit.asyncshutdown.log': True}}}, 'host': '127.0.0.1', 'port': 39236}
[task 2020-11-17T11:51:58.539Z] 11:51:58 INFO - STDOUT: debugger_address = None
[task 2020-11-17T11:51:58.539Z] 11:51:58 INFO - STDOUT: new_session = <function new_session at 0x7f646b066cd0>
[task 2020-11-17T11:51:58.540Z] 11:51:58 INFO - STDOUT: response = <Responsetatus=200 body={"value": {"sessionId": "fdb1ea6f-bff8-40bd-896b-35164...Version": "4.4.0-1014-aws", "unhandledPromptBehavior": "dismiss and notify"}}}>
[task 2020-11-17T11:51:58.540Z] 11:51:58 INFO - STDOUT: result = {'capabilities': {'acceptInsecureCerts': False, 'browserName': 'firefox', 'browserVersion': '85.0', 'moz:accessibilityChecks': False, ...}, 'sessionId': 'fdb1ea6f-bff8-40bd-896b-35164ef96d9a'}
[task 2020-11-17T11:51:58.541Z] 11:51:58 INFO - STDOUT: tests/web-platform/mozilla/tests/webdriver/new_session/debugger_address.py
[task 2020-11-17T11:51:58.541Z] 11:51:58 INFO - STDOUT: :36: AssertionError
[task 2020-11-17T11:51:58.542Z] 11:51:58 INFO - STDOUT: ===================== 1 failed, 2 passed in 24.26 seconds ======================
[task 2020-11-17T11:51:58.544Z] 11:51:58 INFO -
[task 2020-11-17T11:51:58.544Z] 11:51:58 INFO - TEST-PASS | /_mozilla/webdriver/new_session/debugger_address.py | test_debugger_address_not_set
[task 2020-11-17T11:51:58.544Z] 11:51:58 INFO - TEST-PASS | /_mozilla/webdriver/new_session/debugger_address.py | test_debugger_address_false
[task 2020-11-17T11:51:58.544Z] 11:51:58 INFO - TEST-UNEXPECTED-FAIL | /_mozilla/webdriver/new_session/debugger_address.py | test_debugger_address_true - assert None is not None

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Sorry, those tests should only run for Nightly builds given that the Remote Agent is only available there.

Comment 2

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Attachment: Bug 1677717 - [wdspec] Mark enabled debuggerAddress test as expected to fail on release channels.

Comment 3

[Razvan Maries]

No occurrences on today's simulation: https://treeherder.mozilla.org/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception&revision=79d833833c7222c7f492842690a17c5c72fafd44

Comment 4

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

With the patch applied.

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/1a24c7916671
[wdspec] Mark enabled debuggerAddress test as expected to fail on release channels. r=webdriver-reviewers,jgraham

Comment 6

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/1a24c7916671

Comment 7

[Cristina Coroiu [:ccoroiu]]

Verified as fixed on today's central as beta simulation: https://treeherder.mozilla.org/jobs?repo=try&revision=ebf850620251b4c4625986cbd75dc3271be6bd04&searchStr=linux%2C18.04%2Cx64%2Cdebug%2Cweb%2Cplatform%2Ctests%2Ctest-linux1804-64%2Fdebug-web-platform-tests-wdspec-e10s%2Cwd1&selectedTaskRun=c5jM8PvlTEW3PnQcP3wzfg.0

Comment 8

[Intermittent Failures Robot]

2 failures in 3712 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2

Platform breakdown:

• windows10-64-devedition: 1
• windows7-32-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1677717&startday=2020-11-30&endday=2020-12-06&tree=all