1947927 - Intermittent /webdriver/tests/bidi/browsing_context/navigate/navigate.py | single tracking bug

Status: NEW

(Remote Protocol :: WebDriver BiDi, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=494704787&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/ad69HNtdR0qcGcPKd2WOjA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2025-02-13T00:46:37.498Z] 00:46:37     INFO - TEST-FAIL | /webdriver/tests/bidi/browsing_context/navigate/navigate.py | test_same_document_navigation_in_before_unload - AssertionError
[task 2025-02-13T00:46:37.498Z] 00:46:37     INFO - bidi_session = <webdriver.bidi.client.BidiSession object at 0x1031b3e90>
[task 2025-02-13T00:46:37.498Z] 00:46:37     INFO - new_tab = {'context': '78346d42-23bb-458a-a7d2-c63dcd092aa3'}
[task 2025-02-13T00:46:37.498Z] 00:46:37     INFO - url = <function url.<locals>.url at 0x1031b53a0>
[task 2025-02-13T00:46:37.498Z] 00:46:37     INFO - 
[task 2025-02-13T00:46:37.498Z] 00:46:37     INFO -     async def test_same_document_navigation_in_before_unload(bidi_session, new_tab, url):
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -         url_before = url(
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -             "/webdriver/tests/bidi/browsing_context/support/empty.html"
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -         )
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -     
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -         await navigate_and_assert(bidi_session, new_tab, url_before, "complete")
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -     
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -         await bidi_session.script.evaluate(
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -             expression="""window.addEventListener(
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -               'beforeunload',
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -               () => history.replaceState(null, 'initial', window.location.href),
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -               false
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -             );""",
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -             target=ContextTarget(new_tab["context"]),
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -             await_promise=False)
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -     
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -         url_after = url_before.replace("empty.html", "other.html")
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - >       await navigate_and_assert(bidi_session, new_tab, url_after, "complete")
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - 
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - bidi_session = <webdriver.bidi.client.BidiSession object at 0x1031b3e90>
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - new_tab    = {'context': '78346d42-23bb-458a-a7d2-c63dcd092aa3'}
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - url        = <function url.<locals>.url at 0x1031b53a0>
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - url_after  = 'https://web-platform.test:8443/webdriver/tests/bidi/browsing_context/support/other.html'
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - url_before = 'https://web-platform.test:8443/webdriver/tests/bidi/browsing_context/support/empty.html'
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - 
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - tests/web-platform/tests/webdriver/tests/bidi/browsing_context/navigate/navigate.py:110: 
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - 
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - bidi_session = <webdriver.bidi.client.BidiSession object at 0x1031b3e90>
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - context = {'context': '78346d42-23bb-458a-a7d2-c63dcd092aa3'}
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - url = 'https://web-platform.test:8443/webdriver/tests/bidi/browsing_context/support/other.html'
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - wait = 'complete', expected_error = False
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO - 
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -     async def navigate_and_assert(bidi_session, context, url, wait="complete", expected_error=False):
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -         if expected_error:
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -             with pytest.raises(UnknownErrorException):
[task 2025-02-13T00:46:37.499Z] 00:46:37     INFO -                 await bidi_session.browsing_context.navigate(
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO -                     context=context['context'], url=url, wait=wait
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO -                 )
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO -     
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO -         else:
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO -             result = await bidi_session.browsing_context.navigate(
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO -                 context=context['context'], url=url, wait=wait
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO -             )
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO - >           assert result["url"] == url
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO - E           AssertionError
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO - 
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO - bidi_session = <webdriver.bidi.client.BidiSession object at 0x1031b3e90>
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO - context    = {'context': '78346d42-23bb-458a-a7d2-c63dcd092aa3'}
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO - expected_error = False
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO - result     = {'navigation': '8f4f12de-4854-4066-8da9-ea2cafc07318',
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO -  'url': 'https://web-platform.test:8443/webdriver/tests/bidi/browsing_context/support/empty.html'}
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO - url        = 'https://web-platform.test:8443/webdriver/tests/bidi/browsing_context/support/other.html'
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO - wait       = 'complete'
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO - 
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO - tests/web-platform/tests/webdriver/tests/bidi/browsing_context/navigate/__init__.py:19: AssertionError
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO - TEST-UNEXPECTED-PASS | /webdriver/tests/bidi/browsing_context/navigate/navigate.py | test_navigate_with_beforeunload_prompt[capabilities0-True-none] - expected FAIL
[task 2025-02-13T00:46:37.500Z] 00:46:37     INFO - TEST-INFO | expected FAIL
[task 2025-02-13T00:46:37.667Z] 00:46:37     INFO - .................
[task 2025-02-13T00:46:37.667Z] 00:46:37     INFO - TEST-OK | /webdriver/tests/bidi/browsing_context/navigate/navigate.py | took 29032ms

Comment 1

[Atila Butkovits]

Started failing on t1 jobs: https://treeherder.mozilla.org/logviewer?job_id=494957639&repo=try&lineNumber=36699

Comment 2

[Intermittent Failures Robot]

Summary

17 failures in 888 pushes (0.019 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-beta: 1
• mozilla-central: 6
• autoland: 6
• try: 4

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 1
  • opt: 1
• linux1804-64-asan-qr: 1
  • opt: 1
• linux1804-64-qr: 3
  • debug: 2
  • opt: 1
• macosx1470-64: 3
  • debug: 2
  • opt: 1
• windows11-64-24h2: 5
  • debug: 4
  • opt: 1
• windows11-64-24h2-ccov: 4
  • opt: 4

Table

	headless	no_variant	nofis	nofis-ship
android-em-7-0-x86_64-qr--/opt				1
linux1804-64-asan-qr--/opt	1
linux1804-64-qr--/debug	2
linux1804-64-qr--/opt			1
macosx1470-64--/debug	1	1
macosx1470-64--/opt		1
windows11-64-24h2--/debug	1	3
windows11-64-24h2--/opt	1
windows11-64-24h2-ccov--/opt	3	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1947927&startday=2025-02-14&endday=2025-02-14&tree=all

Comment 3

[Intermittent Failures Robot]

Summary

42 failures in 5022 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #45 most frequent failure this week.

This failure happened more than 30 times this week! Resolving this bug is a high priority.

Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled.

Repository breakdown:

• mozilla-beta: 2
• autoland: 17
• mozilla-central: 18
• try: 5

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 2
  • opt: 2
• linux1804-64-asan-qr: 2
  • opt: 2
• linux1804-64-qr: 6
  • debug: 4
  • opt: 2
• linux2204-64-wayland: 2
  • opt: 2
• macosx1470-64: 10
  • debug: 6
  • opt: 4
• windows11-64-24h2: 10
  • debug: 8
  • opt: 2
• windows11-64-24h2-ccov: 10
  • opt: 10

Table

	headless	no_variant	nofis	nofis-ship
android-em-7-0-x86_64-qr--/opt		1		1
linux1804-64-asan-qr--/opt	2
linux1804-64-qr--/debug	4
linux1804-64-qr--/opt			2
linux2204-64-wayland--/opt		2
macosx1470-64--/debug	3	3
macosx1470-64--/opt	2	2
windows11-64-24h2--/debug	3	5
windows11-64-24h2--/opt	2
windows11-64-24h2-ccov--/opt	8	2

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1947927&startday=2025-02-10&endday=2025-02-16&tree=all

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Attachment: Bug 1947927 - [wdspec] Temporarily mark all tests in /webdriver/tests/bidi/browsing_context/navigate/navigate.py with multiple status.

Comment 5

[agoloman]

https://hg.mozilla.org/mozilla-central/rev/5053c6584d63

Comment 6

[Intermittent Failures Robot]

Summary

8 failures in 4340 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 2
• mozilla-beta: 3
• autoland: 1
• mozilla-central: 2

Platform and build breakdown:

• android-em-7-0-x86_64-qr: 4
  • opt: 4
• macosx1470-64: 1
  • debug: 1
• windows11-64-24h2: 1
  • debug: 1
• windows11-64-24h2-ccov: 1
  • opt: 1
• windows11-64-24h2-devedition: 1
  • opt: 1

Table

	headless	no_variant	nofis-ship
android-em-7-0-x86_64-qr--/opt		2	2
macosx1470-64--/debug	1
windows11-64-24h2--/debug		1
windows11-64-24h2-ccov--/opt	1
windows11-64-24h2-devedition--/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1947927&startday=2025-02-17&endday=2025-02-23&tree=all