Closed Bug 1722336 Opened 1 year ago Closed 1 year ago

Intermittent Linux webrender asan /webdriver/tests/bidi/new_session/connect.py | test_websocket_url_connect[capabilities0] - KeyError: 'webSocketUrl' - when Gecko 92 merges to Beta on 2021-08-09

Categories

(Testing :: Marionette, defect, P2)

Default
defect

Tracking

(firefox-esr78 unaffected, firefox90 unaffected, firefox91 unaffected, firefox92 affected)

RESOLVED DUPLICATE of bug 1629244
Tracking Status
firefox-esr78 --- unaffected
firefox90 --- unaffected
firefox91 --- unaffected
firefox92 --- affected

People

(Reporter: aryx, Unassigned)

References

Details

(Keywords: intermittent-failure, regression)

+++ This bug was initially created as a clone of Bug #1721012 +++

[task 2021-07-26T14:57:19.606Z] 14:57:19     INFO - STDOUT: :553: SessionNotCreatedException
[task 2021-07-26T14:57:19.607Z] 14:57:19     INFO - STDOUT: =================================== FAILURES ===================================
[task 2021-07-26T14:57:19.607Z] 14:57:19     INFO - STDOUT: __________________ test_websocket_url_connect[capabilities0] ___________________
[task 2021-07-26T14:57:19.608Z] 14:57:19     INFO - STDOUT: session = <Session 27f57b9a-3f14-44c3-95f9-b7a9e0fa492b>
[task 2021-07-26T14:57:19.608Z] 14:57:19     INFO - STDOUT:     @pytest.mark.asyncio
[task 2021-07-26T14:57:19.609Z] 14:57:19     INFO - STDOUT:     @pytest.mark.capabilities({"webSocketUrl": True})
[task 2021-07-26T14:57:19.609Z] 14:57:19     INFO - STDOUT:     async def test_websocket_url_connect(session):
[task 2021-07-26T14:57:19.610Z] 14:57:19     INFO - STDOUT: >       websocket_url = session.capabilities["webSocketUrl"]
[task 2021-07-26T14:57:19.610Z] 14:57:19     INFO - STDOUT: E       KeyError: 'webSocketUrl'
[task 2021-07-26T14:57:19.611Z] 14:57:19     INFO - STDOUT: session    = <Session 27f57b9a-3f14-44c3-95f9-b7a9e0fa492b>
[task 2021-07-26T14:57:19.611Z] 14:57:19     INFO - STDOUT: tests/web-platform/tests/webdriver/tests/bidi/new_session/connect.py
[task 2021-07-26T14:57:19.612Z] 14:57:19     INFO - STDOUT: :11: KeyError
[task 2021-07-26T14:57:19.612Z] 14:57:19     INFO - STDOUT: =========================== short test summary info ============================
[task 2021-07-26T14:57:19.624Z] 14:57:19     INFO - ....
[task 2021-07-26T14:57:19.624Z] 14:57:19     INFO - TEST-OK | /webdriver/tests/bidi/new_session/connect.py | took 43817ms
[task 2021-07-26T14:57:19.624Z] 14:57:19     INFO - Restarting browser for new test group
[task 2021-07-26T14:57:19.697Z] 14:57:19     INFO - STDOUT: FAILED tests/web-platform/tests/webdriver/tests/bidi/new_session/connect.py::test_websocket_url_connect[capabilities0]
[task 2021-07-26T14:57:19.697Z] 14:57:19     INFO - STDOUT: ERROR tests/web-platform/tests/webdriver/tests/bidi/new_session/connect.py::test_bidi_session_send
[task 2021-07-26T14:57:19.697Z] 14:57:19     INFO - STDOUT: ERROR tests/web-platform/tests/webdriver/tests/bidi/new_session/connect.py::test_bidi_session_with_different_capability[capabilities0]
[task 2021-07-26T14:57:19.697Z] 14:57:19     INFO - STDOUT: ==================== 1 failed, 1 passed, 2 errors in 43.60s ====================
[task 2021-07-26T14:57:19.698Z] 14:57:19     INFO - ERROR | LeakSanitizer | SUMMARY: AddressSanitizer: 32646 byte(s) leaked in 309 allocation(s).
Summary: Permanent /webdriver/tests/bidi/new_session/connect.py | test_websocket_url_connect[capabilities0] - KeyError: 'webSocketUrl' - when Gecko 92 merges to Beta on 2021-08-09 → Permanent Linux webrender asan /webdriver/tests/bidi/new_session/connect.py | test_websocket_url_connect[capabilities0] - KeyError: 'webSocketUrl' - when Gecko 92 merges to Beta on 2021-08-09
Whiteboard: [bidi-m1-mvp] → [webdriver:triage]

Aryx, isn't that failure just about the leak? It's expected that the webSocketUrl is not available on beta and the expectation data is set appropriately:

https://searchfox.org/mozilla-central/source/testing/web-platform/meta/webdriver/tests/bidi/new_session/connect.py.ini

Do we know when this has been started? Has there been ran a backfill yet?

Flags: needinfo?(aryx.bugmail)
Summary: Permanent Linux webrender asan /webdriver/tests/bidi/new_session/connect.py | test_websocket_url_connect[capabilities0] - KeyError: 'webSocketUrl' - when Gecko 92 merges to Beta on 2021-08-09 → Intermittent Linux webrender asan /webdriver/tests/bidi/new_session/connect.py | test_websocket_url_connect[capabilities0] - KeyError: 'webSocketUrl' - when Gecko 92 merges to Beta on 2021-08-09

I had a look at the Treeherder jobs for staging releases, and I cannot find the build jobs that are used to run the tests. Do you know where the builds are coming from? I would like to try with an ASAN build locally in how to get it reproduced.

Also why is it intermittent now? Do you have a query for Treeherder?

Flags: needinfo?(aryx.bugmail)

Failure log > Task > left side > See More > Dependencies > click on the build > either click on the Treeherder at the top or the artifacts list on the right.

For the log in comment 0, that's https://firefox-ci-tc.services.mozilla.com/tasks/K5_etDSMTFmr3ZktTcvsfA

Flags: needinfo?(aryx.bugmail)

Aryx, is this still a problem? If yes aren't these failures classified?

Flags: needinfo?(aryx.bugmail)

No such failure yesterday, but Wednesday's central-as-beta simulation has two. Is this bug a duplicate of bug 1629244?

When it's about the leak then probably yes. The KeyError is actually expected and as such marked in the manifest. Looks like that was an oversight when filing the bug.

Status: NEW → RESOLVED
Closed: 1 year ago
Resolution: --- → DUPLICATE
Duplicate of bug: 1629244
Whiteboard: [webdriver:triage]
You need to log in before you can comment on or make changes to this bug.