Closed Bug 2068953 Opened 2 months ago Closed 2 months ago

[wpt-sync] Sync PR 62383 - WebDriver BiDi: Await user-context file dialog assertions

Categories

(Remote Protocol :: WebDriver BiDi, task, P4)

task

Tracking

(firefox158 fixed)

RESOLVED FIXED
158 Branch
Tracking Status
firefox158 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

()

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 62383 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/62383
Details from upstream follow.

Júlio Piubello <julio@gitstart.com> wrote:

WebDriver BiDi: Await user-context file dialog assertions

Await the asynchronous file-dialog assertion helpers in the
browser.createUserContext unhandled prompt behavior WPT.

Previously, the test returned coroutine objects without executing their
bodies, so the accept, dismiss, and ignore cases could report success
without checking whether the picker was canceled. Running the assertions
also exposes existing host behavior for ignore; this CL does not change
product behavior or expectations.

Bug: 539194312
Change-Id: I0af5a6f080aea3bd27795391f5ce50f857722aaa
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/8152279
Reviewed-by: Alex Rudenko \<alexrudenko@chromium.org>
Commit-Queue: Julio Piubello \<julio@gitstart.com>
Reviewed-by: Maksim Sadym \<sadym@chromium.org>
Cr-Commit-Position: refs/heads/main@{#1690634}

Component: web-platform-tests → WebDriver BiDi
Product: Testing → Remote Protocol

CI Results

Ran 10 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 5 tests and 19 subtests

Status Summary

Firefox

OK : 4
PASS : 89[Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-debug-isolated-process-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview] 90[Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt]
FAIL : 66
TIMEOUT: 1

Chrome

OK : 1
PASS : 24

Safari

OK : 1
ERROR : 24

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

  • /webdriver/tests/bidi/browser/create_user_context/unhandled_prompt_behavior.py [wpt.fyi]: SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-debug-isolated-process-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt], TIMEOUT [GitHub]

New Tests That Don't Pass

  • /webdriver/tests/bidi/browser/create_user_context/unhandled_prompt_behavior.py [wpt.fyi]: SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-debug-isolated-process-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt], TIMEOUT [GitHub] (Chrome: OK, Safari: OK)
  • /webdriver/tests/bidi/browser/create_user_context/invalid.py [wpt.fyi]
    • test_unhandled_prompt_behavior_invalid_type[False]: FAIL
    • test_unhandled_prompt_behavior_invalid_type[42]: FAIL
    • test_unhandled_prompt_behavior_invalid_type[foo]: FAIL
    • test_unhandled_prompt_behavior_invalid_type[value3]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[42-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[42-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[42-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[42-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[42-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[42-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[True-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[True-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[True-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[True-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[True-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[True-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value2-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value2-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value2-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value2-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value2-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value2-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value3-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value3-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value3-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value3-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value3-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value3-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[None-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[None-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[None-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[None-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[None-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[None-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[42-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[42-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[42-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[42-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[42-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[42-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[True-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[True-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[True-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[True-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[True-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[True-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value2-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value2-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value2-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value2-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value2-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value2-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value3-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value3-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value3-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value3-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value3-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value3-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[None-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[None-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[None-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[None-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[None-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[None-prompt]: FAIL
  • /webdriver/tests/bidi/browser/create_user_context/proxy.py [wpt.fyi]
    • test_system: FAIL
    • test_autodetect: FAIL

Tests Disabled in Gecko Infrastructure

  • /webdriver/tests/bidi/browser/create_user_context/unhandled_prompt_behavior.py [wpt.fyi]: SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-debug-isolated-process-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt], TIMEOUT [GitHub] (Chrome: OK, Safari: OK)

CI Results

Ran 10 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 5 tests and 19 subtests

Status Summary

Firefox

OK : 4
PASS : 89[Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-debug-isolated-process-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview] 90[Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt]
FAIL : 66
TIMEOUT: 1

Chrome

OK : 1
PASS : 24

Safari

OK : 1
ERROR : 24

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

  • /webdriver/tests/bidi/browser/create_user_context/unhandled_prompt_behavior.py [wpt.fyi]: SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-debug-isolated-process-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt], TIMEOUT [GitHub] linked bug:Bug 1975279

New Tests That Don't Pass

  • /webdriver/tests/bidi/browser/create_user_context/unhandled_prompt_behavior.py [wpt.fyi]: SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-debug-isolated-process-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt], TIMEOUT [GitHub] (Chrome: OK, Safari: OK)
  • /webdriver/tests/bidi/browser/create_user_context/invalid.py [wpt.fyi]
    • test_unhandled_prompt_behavior_invalid_type[False]: FAIL
    • test_unhandled_prompt_behavior_invalid_type[42]: FAIL
    • test_unhandled_prompt_behavior_invalid_type[foo]: FAIL
    • test_unhandled_prompt_behavior_invalid_type[value3]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[42-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[42-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[42-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[42-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[42-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[42-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[True-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[True-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[True-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[True-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[True-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[True-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value2-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value2-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value2-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value2-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value2-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value2-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value3-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value3-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value3-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value3-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value3-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[value3-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[None-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[None-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[None-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[None-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[None-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_type[None-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[42-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[42-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[42-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[42-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[42-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[42-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[True-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[True-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[True-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[True-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[True-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[True-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value2-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value2-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value2-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value2-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value2-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value2-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value3-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value3-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value3-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value3-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value3-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[value3-prompt]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[None-alert]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[None-beforeUnload]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[None-confirm]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[None-default]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[None-file]: FAIL
    • test_unhandled_prompt_behavior_handler_invalid_value[None-prompt]: FAIL
  • /webdriver/tests/bidi/browser/create_user_context/proxy.py [wpt.fyi]
    • test_system: FAIL
    • test_autodetect: FAIL

Tests Disabled in Gecko Infrastructure

  • /webdriver/tests/bidi/browser/create_user_context/unhandled_prompt_behavior.py [wpt.fyi]: SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-debug-isolated-process-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt], TIMEOUT [GitHub] (Chrome: OK, Safari: OK) linked bug:Bug 1975279
Pushed by wptsync@mozilla.com: https://github.com/mozilla-firefox/firefox/commit/bb5229a1569b https://hg.mozilla.org/integration/autoland/rev/210aecdd1d8d [wpt PR 62383] - WebDriver BiDi: Await user-context file dialog assertions, a=testonly
Status: NEW → RESOLVED
Closed: 2 months ago
Resolution: --- → FIXED
Target Milestone: --- → 158 Branch
You need to log in before you can comment on or make changes to this bug.