Closed Bug 1815082 Opened 2 years ago Closed 2 years ago

Intermittent /webdriver/tests/bidi/browsing_context/navigate/error.py | single tracking

Categories

(Remote Protocol :: WebDriver BiDi, defect, P5)

defect

Tracking

(Not tracked)

RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Filed by: nerli [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=404612325&repo=mozilla-beta
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/IEMYMuSNRDeR7lSLVPa_eA/runs/0/artifacts/public/logs/live_backing.log


[task 2023-02-04T20:55:30.027Z] 20:55:30     INFO - TEST-PASS | /webdriver/tests/bidi/browsing_context/navigate/error.py | test_invalid_address[protocol] 
[task 2023-02-04T20:55:30.027Z] 20:55:30     INFO - TEST-UNEXPECTED-FAIL | /webdriver/tests/bidi/browsing_context/navigate/error.py | test_invalid_address[host] - Failed: DID NOT RAISE <class 'webdriver.bidi.error.UnknownErrorException'>
[task 2023-02-04T20:55:30.027Z] 20:55:30     INFO - bidi_session = <webdriver.bidi.client.BidiSession object at 0x7fdfe7560d10>
[task 2023-02-04T20:55:30.027Z] 20:55:30     INFO - new_tab = {'context': 'd3f27f21-6b44-4efd-88ad-b3b615db1450'}
[task 2023-02-04T20:55:30.027Z] 20:55:30     INFO - url = 'http://doesnotexist.localhost/'
[task 2023-02-04T20:55:30.027Z] 20:55:30     INFO - 
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO -     @pytest.mark.parametrize(
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO -         "url",
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO -         [
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO -             "thisprotocoldoesnotexist://",
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO -             "http://doesnotexist.localhost/",
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO -             "http://localhost:0",
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO -         ],
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO -         ids=[
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO -             "protocol",
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO -             "host",
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO -             "port",
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO -         ]
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO -     )
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO -     async def test_invalid_address(bidi_session, new_tab, url):
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO - >       await navigate_and_assert(bidi_session, new_tab, url, expected_error=True)
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO - 
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO - bidi_session = <webdriver.bidi.client.BidiSession object at 0x7fdfe7560d10>
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO - new_tab    = {'context': 'd3f27f21-6b44-4efd-88ad-b3b615db1450'}
[task 2023-02-04T20:55:30.028Z] 20:55:30     INFO - url        = 'http://doesnotexist.localhost/'
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO - 
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO - tests/web-platform/tests/webdriver/tests/bidi/browsing_context/navigate/error.py:22: 
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO - _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO - 
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO - bidi_session = <webdriver.bidi.client.BidiSession object at 0x7fdfe7560d10>
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO - context = {'context': 'd3f27f21-6b44-4efd-88ad-b3b615db1450'}
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO - url = 'http://doesnotexist.localhost/', wait = 'complete', expected_error = True
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO - 
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO -     async def navigate_and_assert(bidi_session, context, url, wait="complete", expected_error=False):
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO -         if expected_error:
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO -             with pytest.raises(UnknownErrorException):
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO -                 await bidi_session.browsing_context.navigate(
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO - >                   context=context['context'], url=url, wait=wait
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO -                 )
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO - E               Failed: DID NOT RAISE <class 'webdriver.bidi.error.UnknownErrorException'>
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO - 
[task 2023-02-04T20:55:30.029Z] 20:55:30     INFO - bidi_session = <webdriver.bidi.client.BidiSession object at 0x7fdfe7560d10>
[task 2023-02-04T20:55:30.030Z] 20:55:30     INFO - context    = {'context': 'd3f27f21-6b44-4efd-88ad-b3b615db1450'}
[task 2023-02-04T20:55:30.030Z] 20:55:30     INFO - expected_error = True
[task 2023-02-04T20:55:30.030Z] 20:55:30     INFO - url        = 'http://doesnotexist.localhost/'
[task 2023-02-04T20:55:30.030Z] 20:55:30     INFO - wait       = 'complete'
[task 2023-02-04T20:55:30.030Z] 20:55:30     INFO - 
[task 2023-02-04T20:55:30.030Z] 20:55:30     INFO - tests/web-platform/tests/webdriver/tests/bidi/browsing_context/navigate/__init__.py:10: Failed
[task 2023-02-04T20:55:30.031Z] 20:55:30     INFO - .
[task 2023-02-04T20:55:30.031Z] 20:55:30     INFO - TEST-OK | /webdriver/tests/bidi/browsing_context/navigate/error.py | took 3532ms
[task 2023-02-04T20:55:30.032Z] 20:55:30     INFO - PID 23177 | 1675544130009	webdriver::server	DEBUG	-> GET /status
[task 2023-02-04T20:55:30.034Z] 20:55:30     INFO - PID 23177 | 1675544130009	webdriver::server	DEBUG	<- 200 OK {"value":{"message":"","ready":true}}
[task 2023-02-04T20:55:30.141Z] 20:55:30     INFO - Closing logging queue
[task 2023-02-04T20:55:30.141Z] 20:55:30     INFO - queue closed
[task 2023-02-04T20:55:30.769Z] 20:55:30     INFO - PID 23382 | 1675544130151	geckodriver	INFO	Listening on 127.0.0.1:56678
[task 2023-02-04T20:55:30.769Z] 20:55:30     INFO - Starting runner

That's an interesting case. The details can be found here:
https://treeherder.mozilla.org/logviewer?job_id=404612325&repo=mozilla-beta&lineNumber=14050-14055

[task 2023-02-04T20:55:28.509Z] 20:55:28     INFO - PID 23177 | 1675544128508	RemoteAgent	TRACE	[12] ProgressListener Check loading state: isStart=1 isStop=0
[task 2023-02-04T20:55:28.510Z] 20:55:28     INFO - PID 23177 | 1675544128509	RemoteAgent	TRACE	[12] ProgressListener state=start: http://doesnotexist.localhost/
[task 2023-02-04T20:55:28.635Z] 20:55:28     INFO - PID 23177 | 1675544128634	RemoteAgent	TRACE	[13] ProgressListener Check loading state: isStart=0 isStop=16
[task 2023-02-04T20:55:28.636Z] 20:55:28     INFO - PID 23177 | 1675544128634	RemoteAgent	TRACE	[13] ProgressListener state=stop: http://doesnotexist.localhost/
[task 2023-02-04T20:55:28.636Z] 20:55:28     INFO - PID 23177 | 1675544128634	RemoteAgent	TRACE	[13] ProgressListener Stop: has error=false
[task 2023-02-04T20:55:28.636Z] 20:55:28     INFO - PID 23177 | 1675544128635	RemoteAgent	TRACE	WebDriverBiDiConnection 300747fe-ece2-4572-b879-5e0918aa5376 <- {"id":5,"result":{"navigation":null,"url":"http://doesnotexist.localhost/"}}

Looks like the navigation to the not existent host didn't cause a navigation failure. Lets see how often this will fail over the next days.

Interesting as well is that this causes a follow-up test failure as well for TimeoutError: No applicable application window found after 4500 ms a couple of minutes later. But that might be unrelated.

Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

(In reply to Treeherder Bug Filer from comment #4)

New failure instance: https://treeherder.mozilla.org/logviewer?job_id=413923845&repo=autoland

This is bug bug 1571426.

Status: REOPENED → RESOLVED
Closed: 2 years ago2 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 2 years ago2 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.