Closed Bug 2082338 Opened 1 month ago Closed 4 days ago

[wpt-sync] Sync PR 63647 - [wdspec] Scale fixed BiDi WPT waits by the timeout multiplier

Categories

(Remote Protocol :: WebDriver BiDi, task, P4)

task

Tracking

(firefox162 fixed)

RESOLVED FIXED
162 Branch
Tracking Status
firefox162 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

()

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 63647 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/63647
Details from upstream follow.

Maksim Sadym <sadym@chromium.org> wrote:

[wdspec] Scale fixed BiDi WPT waits by the timeout multiplier

  • Make BiDi WebDriver WPTs with fixed 1-2 second waits stop timing out
    and flaking on slow (Debug) builds, and make Web Bluetooth tests fail
    fast with the real error instead of timing out when requestDevice is
    rejected without a prompt.
  • setup_blocked_request gave up after 2 seconds and never released
    requests blocked later, which kept navigations pending until the
    whole file timed out. The CSP, history traversal and navigation
    input tests had the same fixed waits, while other helpers already
    scale waits by timeout_multiplier.

Bug: 565712857
Cq-Include-Trybots: luci.chromium.try:linux-blink-rel
Include-Ci-Only-Tests: chromium.linux:Linux Tests|webdriver_wpt_tests
Change-Id: I11a9359458d05cb3093979efdef8daf19b95366a
Reviewed-on: https://chromium-review.googlesource.com/8575200
WPT-Export-Revision: 17bb61446a4ff49a73306bec3257afceaedbcedf

Component: web-platform-tests → WebDriver BiDi
Product: Testing → Remote Protocol
Whiteboard: [wptsync downstream] → [wptsync downstream error]
Whiteboard: [wptsync downstream error] → [wptsync downstream]

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 82 tests and 6 subtests

Status Summary

Firefox

OK : 27[GitHub] 61[Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt]
PASS : 46[GitHub] 1491[Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug] 1492[Gecko-linux2204-64-wayland-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt]
FAIL : 16[Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] 17[Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug] 107[GitHub]
ERROR: 188

Chrome

OK : 27
PASS : 310
FAIL : 8
ERROR: 23

Safari

OK : 27
ERROR: 341

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

  • /webdriver/tests/bidi/external/bluetooth/disable_simulation/context.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_contexts_are_isolated: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/disable_simulation/disable_simulation.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_disable_simulation: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_adapter/context.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_contexts_are_isolated: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_adapter/invalid.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_state_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_state_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_state_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_state_invalid_type[state3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_state_invalid_type[state4]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_state_invalid_value[]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_state_invalid_value[invalid]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context4]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_unknown_value: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_adapter/state.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_state[absent-False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_state[powered-off-True]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_state[powered-on-True]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_set_twice[absent-False-absent-False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_set_twice[absent-False-powered-off-True]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_set_twice[absent-False-powered-on-True]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_set_twice[powered-off-True-absent-False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_set_twice[powered-off-True-powered-off-True]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_set_twice[powered-off-True-powered-on-True]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_set_twice[powered-on-True-absent-False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_set_twice[powered-on-True-powered-off-True]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_set_twice[powered-on-True-powered-on-True]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_characteristic/invalid.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_context_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[service_uuid3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[service_uuid4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[characteristic_uuid3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[characteristic_uuid4]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_characteristic_uuid_add_already_exist: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_remove_nonexist: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_characteristic_properties_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_properties_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_properties_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_properties_invalid_type[properties]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_properties_invalid_type[characteristic_properties4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_properties_invalid_property_value[None]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_characteristic_properties_invalid_property_value[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_properties_invalid_property_value[True]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_properties_invalid_property_value[propertie_value3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_properties_absent_for_add: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_properties_present_for_remove: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[type3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[type4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_unknown_value: ERROR (Chrome: ERROR, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_characteristic/simulate_characteristic.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_simulate_characteristic[broadcast]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_simulate_characteristic[read]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_simulate_characteristic[writeWithoutResponse]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_simulate_characteristic[write]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_simulate_characteristic[notify]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_simulate_characteristic[indicate]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_simulate_characteristic[authenticatedSignedWrites]: ERROR (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_characteristic_response/invalid.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_context_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context4]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_context_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_unknown_value: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_service_uuid_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[service_uuid3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[service_uuid4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[characteristic_uuid3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[characteristic_uuid4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[type3]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_type_invalid_type[type4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_data_present_for_nonread: ERROR (Chrome: PASS, Safari: ERROR)
    • test_data_absent_for_read: ERROR (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_characteristic_response/simulate_characteristic_response.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_simulate_characteristic_write_event[write_type0]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_simulate_characteristic_write_event[write_type1]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_simulate_characteristic_read_event: ERROR (Chrome: PASS, Safari: ERROR)
    • test_simulate_characteristic_notification_event: ERROR (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_descriptor/invalid.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_context_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_unknown_value: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_address_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[service_uuid3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[service_uuid4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[characteristic_uuid3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[characteristic_uuid4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_unknown_value: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_descriptor_uuid_invalid_type[None]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_descriptor_uuid_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_descriptor_uuid_invalid_type[42]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_descriptor_uuid_invalid_type[descriptor_uuid3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_descriptor_uuid_invalid_type[descriptor_uuid4]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_descriptor_uuid_add_already_exist: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_descriptor_uuid_remove_nonexist: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[type3]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_type_invalid_type[type4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_descriptor/simulate_descriptor.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_simulate_descriptor: ERROR (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_descriptor_response/invalid.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_context_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[service_uuid3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_invalid_type[service_uuid4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_service_uuid_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[False]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[characteristic_uuid3]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_characteristic_uuid_invalid_type[characteristic_uuid4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_characteristic_uuid_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_descriptor_uuid_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_descriptor_uuid_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_descriptor_uuid_invalid_type[42]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_descriptor_uuid_invalid_type[descriptor_uuid3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_descriptor_uuid_invalid_type[descriptor_uuid4]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_descriptor_uuid_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[type3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[type4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_data_present_for_nonread: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_data_absent_for_read: ERROR (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_descriptor_response/simulate_descriptor_response.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_simulate_descriptor_write_event: ERROR (Chrome: PASS, Safari: ERROR)
    • test_simulate_characteristic_read_event: ERROR (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_gatt_connection_response/invalid.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_context_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context4]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_unknown_value: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address4]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_code_invalid_type[0]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_code_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_code_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_code_invalid_type[code3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_code_invalid_type[code4]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_gatt_connection_response/simulate_gatt_connection_response.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_simulate_gatt_connection_response[0]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_simulate_gatt_connection_response[1]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_simulate_gatt_connection_response[2]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_gatt_disconnection/invalid.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_context_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context4]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_unknown_value: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address4]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_gatt_disconnection/simulate_gatt_disconnection.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_simulate_gatt_disconnection: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_preconnected_peripheral/invalid.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_context_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context4]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_context_unknown_value: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address4]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_name_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_name_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_name_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_name_invalid_type[name3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_name_invalid_type[name4]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_type[manufacturer_data3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_type[]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_key_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_key_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_key_type[key2]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_key_type[key3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_key_type[]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_key_value: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_data_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_data_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_data_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_data_type[data3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_manufacturer_data_invalid_data_type[data4]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_known_service_uuids_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_known_service_uuids_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_known_service_uuids_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_known_service_uuids_invalid_type[known_service_uuids3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_known_service_uuids_invalid_uuid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_known_service_uuids_invalid_uuid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_known_service_uuids_invalid_uuid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_known_service_uuids_invalid_uuid_type[uuid3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_known_service_uuids_invalid_uuid_type[uuid4]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_preconnected_peripheral/simulate_preconnected_peripheral.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_simulate_preconnected_peripheral: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_service/invalid.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_context_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_context_invalid_type[context4]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_context_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[None]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_address_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_invalid_type[address4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_address_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
    • test_uuid_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_uuid_invalid_type[False]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_uuid_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_uuid_invalid_type[uuid3]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_uuid_invalid_type[uuid4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_uuid_add_already_exist: ERROR (Chrome: PASS, Safari: ERROR)
    • test_uuid_remove_nonexist: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[None]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[False]: ERROR (Chrome: ERROR, Safari: ERROR)
    • test_type_invalid_type[42]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[type3]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_invalid_type[type4]: ERROR (Chrome: PASS, Safari: ERROR)
    • test_type_unknown_value: ERROR (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/bluetooth/simulate_service/simulate_service.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt] (Chrome: OK, Safari: OK)
    • test_simulate_service: ERROR (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/input/perform_actions/navigation.py [wpt.fyi]
    • test_pointer: FAIL [Gecko-linux2204-64-wayland-opt, Gecko-linux2404-64-debug], PASS [Gecko-android-em-14-x86_64-debug-geckoview, Gecko-android-em-14-x86_64-lite-opt-geckoview, Gecko-android-em-14-x86_64-opt-geckoview, Gecko-linux2204-64-wayland-debug, Gecko-linux2404-64-opt, Gecko-windows11-64-25h2-debug, Gecko-windows11-64-25h2-opt, GitHub] (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/input/perform_actions/pointer_mouse_drag.py [wpt.fyi]
    • test_drag_and_drop_with_draggable_element[0]: FAIL
    • test_drag_and_drop_with_draggable_element[300]: FAIL
    • test_drag_and_drop_with_draggable_element[800]: FAIL
  • /webdriver/tests/bidi/input/perform_actions/pointer_pen.py [wpt.fyi]
    • test_pointer_down_closes_browsing_context: FAIL
    • test_pen_pointer_in_shadow_tree[outer-open]: FAIL
    • test_pen_pointer_in_shadow_tree[outer-closed]: FAIL
    • test_pen_pointer_in_shadow_tree[inner-open]: FAIL
    • test_pen_pointer_in_shadow_tree[inner-closed]: FAIL
    • test_pen_pointer_properties: FAIL
  • /webdriver/tests/bidi/input/perform_actions/wheel_events.py [wpt.fyi]
    • test_scroll_emits_scrollend_event: FAIL
  • /webdriver/tests/bidi/script/call_function/csp_tentative.py [wpt.fyi]
    • test_default_src_unsafe_inline[promise eval]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_default_src_unsafe_inline[async eval]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_default_src_unsafe_inline[async eval from preload script]: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/csp_tentative.py [wpt.fyi]
    • test_default_src_unsafe_inline[promise eval]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_default_src_unsafe_inline[async eval]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_default_src_unsafe_inline[async eval from preload script]: FAIL (Chrome: FAIL, Safari: ERROR)

Tests Disabled in Gecko Infrastructure

Pushed by wptsync@mozilla.com: https://github.com/mozilla-firefox/firefox/commit/b994911ebae4 https://hg.mozilla.org/integration/autoland/rev/8aae1f980e84 [wpt PR 63647] - [wdspec] Scale fixed BiDi WPT waits by the timeout multiplier, a=testonly
Status: NEW → RESOLVED
Closed: 4 days ago
Resolution: --- → FIXED
Target Milestone: --- → 162 Branch
You need to log in before you can comment on or make changes to this bug.