1946426 - [wpt-sync] Sync PR 50527 - [wdspec] align navigation tests with spec

Status: RESOLVED FIXED

(Remote Protocol :: WebDriver BiDi, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 50527 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/50527
Details from upstream follow.

Maksim Sadym <[e-mail]> wrote:

[wdspec] align navigation tests with spec

Align WebDriver BiDi spec tests with the breaking change in navigation wait logic: https://github.com/w3c/webdriver-bidi/pull/855.

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=571ba09491d1ee5123dd8e99f6db0f55fdbb08ae

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

CI Results

Ran 10 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 5 tests and 14 subtests

Status Summary

Firefox

OK : 3[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] 5[Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-windows11-64-24h2-debug, Gecko-windows11-64-24h2-opt, GitHub]
PASS : 44[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] 71[Gecko-windows11-64-24h2-opt] 73[Gecko-linux1804-64-qr-opt, GitHub] 74[Gecko-linux1804-64-qr-debug, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-windows11-64-24h2-debug]
FAIL : 3[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] 12[Gecko-linux1804-64-qr-debug, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-windows11-64-24h2-debug] 13[Gecko-linux1804-64-qr-opt, GitHub] 15[Gecko-windows11-64-24h2-opt]
TIMEOUT: 2

Chrome

OK : 5
PASS : 76
FAIL : 10

Safari

OK : 5
ERROR : 86

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

• /webdriver/tests/bidi/browsing_context/navigate/navigate.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-windows11-64-24h2-debug, Gecko-windows11-64-24h2-opt, GitHub], TIMEOUT [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • test_relative_url: FAIL (Chrome: FAIL, Safari: ERROR)
  • test_same_document_navigation_in_before_unload: FAIL (Chrome: PASS, Safari: ERROR)
  • test_navigate_with_beforeunload_prompt[capabilities0-True-none]: FAIL [Gecko-windows11-64-24h2-opt], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-windows11-64-24h2-debug, GitHub] (Chrome: FAIL, Safari: ERROR)
  • test_navigate_with_beforeunload_prompt[capabilities0-False-none]: FAIL (Chrome: FAIL, Safari: ERROR)
  • test_navigate_with_beforeunload_prompt_in_iframe[capabilities0-True-none]: FAIL [Gecko-windows11-64-24h2-opt, GitHub], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-windows11-64-24h2-debug] (Chrome: FAIL, Safari: ERROR)
  • test_navigate_with_beforeunload_prompt_in_iframe[capabilities0-False-none]: FAIL (Chrome: FAIL, Safari: ERROR)
  • test_navigate_with_beforeunload_prompt_in_iframe[capabilities0-False-interactive]: FAIL (Chrome: PASS, Safari: ERROR)
  • test_navigate_with_beforeunload_prompt_in_iframe[capabilities0-False-complete]: FAIL (Chrome: PASS, Safari: ERROR)
  • test_navigate_with_beforeunload_prompt_in_iframe_navigate_in_top_context[capabilities0-True-none]: FAIL [Gecko-linux1804-64-qr-opt, Gecko-windows11-64-24h2-opt], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-windows11-64-24h2-debug, GitHub] (Chrome: FAIL, Safari: ERROR)
  • test_navigate_with_beforeunload_prompt_in_iframe_navigate_in_top_context[capabilities0-False-none]: FAIL (Chrome: FAIL, Safari: ERROR)
• /webdriver/tests/bidi/browsing_context/navigate/wait.py [wpt.fyi]
  • test_expected_url[none]: FAIL (Chrome: FAIL, Safari: ERROR)
  • test_slow_image_blocks_load[none-False]: FAIL (Chrome: FAIL, Safari: ERROR)
• /webdriver/tests/bidi/browsing_context/navigation_started/navigation_started.py [wpt.fyi]
  • test_redirect_http_equiv: FAIL (Chrome: PASS, Safari: ERROR)
  • test_with_beforeunload_prompt[capabilities0]: FAIL (Chrome: PASS, Safari: ERROR)
  • test_with_accepted_beforeunload_prompt[capabilities0]: FAIL (Chrome: PASS, Safari: ERROR)
• /webdriver/tests/bidi/browsing_context/reload/wait.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-windows11-64-24h2-debug, Gecko-windows11-64-24h2-opt, GitHub], TIMEOUT [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/65c7e5fa0a88
[wpt PR 50527] - [wdspec] align navigation tests with spec, a=testonly
https://hg.mozilla.org/integration/autoland/rev/b6d6dd4c2d53
[wpt PR 50527] - Update wpt metadata, a=testonly

Comment 4

[Norisz Fay [:noriszfay]]

https://hg.mozilla.org/mozilla-central/rev/65c7e5fa0a88
https://hg.mozilla.org/mozilla-central/rev/b6d6dd4c2d53