Closed Bug 1703227 Opened 3 years ago Closed 3 years ago

[wpt-sync] Sync PR 28381 - Start creating a proper client for WebDriver BiDi

Categories

(Testing :: web-platform-tests, task, P4)

Product:
Testing
Component:
web-platform-tests
Type:
task

Tracking

(firefox91 fixed)

Status:
RESOLVED FIXED
Milestone:
91 Branch
Tracking Flags:
Tracking Status
firefox91 --- fixed

People

(Reporter: mozilla.org, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 28381 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/28381
Details from upstream follow.

b'James Graham <james@hoppipolla.co.uk>' wrote:

Start creating a proper client for WebDriver BiDi

Add a webdriver.bidi.client module with a BidiSession class that
implements only the BiDi part of the protocol. An ordinary Session may
have an associated BidiSession if the session was created through
HTTP. To make this easier, an enable_bidi flag is added to the
top-level session which automatically sets the capabilities required
to enable BiDi.

The session allows sending commands, and registering handlers for
events.

In addition to the session class, this adds some intial work on
creating a structure for commands, with a BidiModule abstract class
that can be used as the basis for command implementations and an
@command decorator that handles actually sending the command and
waiting for the result.

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 171 tests and 18 subtests

Status Summary

Firefox

OK : 166[GitHub] 168[Gecko-windows10-32-qr-debug, Gecko-windows10-32-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug] 169[Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt]
PASS : 2131[Gecko-windows10-32-qr-debug, Gecko-windows10-32-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug] 2136[Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-opt, GitHub] 2137[Gecko-linux1804-64-debug, Gecko-linux1804-64-qr-debug]
FAIL : 130[GitHub] 198[Gecko-linux1804-64-debug, Gecko-linux1804-64-qr-debug, Gecko-windows10-32-qr-debug, Gecko-windows10-32-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug] 199[Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-opt]
ERROR : 61[Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-qr-debug, Gecko-windows10-32-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug] 64[GitHub]

Chrome

OK : 166
PASS : 2136
FAIL : 133
ERROR : 61

Safari

OK : 164
PASS : 1723
FAIL : 474
TIMEOUT: 2
ERROR : 97

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

/webdriver/tests/element_send_keys/events.py
test_file_upload: FAIL
/webdriver/tests/execute_async_script/promise.py
test_await_promise_resolve: FAIL
/webdriver/tests/execute_script/promise.py
test_await_promise_resolve: FAIL
/webdriver/tests/get_element_property/get.py
test_primitives["foobar"-foobar]: FAIL
test_primitives[42-42]: FAIL
test_primitives[js_primitive2-py_primitive2]: FAIL
test_primitives[js_primitive3-py_primitive3]: FAIL
test_primitives_set_by_execute_script["foobar"-foobar]: FAIL
test_primitives_set_by_execute_script[42-42]: FAIL
test_primitives_set_by_execute_script[js_primitive2-py_primitive2]: FAIL
test_primitives_set_by_execute_script[js_primitive3-py_primitive3]: FAIL
/webdriver/tests/perform_actions/key_events.py
test_modifier_key_sends_correct_events[\ue03d-META]: FAIL
test_special_key_sends_keydown[ADD-expected0]: FAIL
test_special_key_sends_keydown[META-expected30]: FAIL
test_special_key_sends_keydown[NUMPAD4-expected37]: FAIL
test_special_key_sends_keydown[NUMPAD5-expected38]: FAIL
test_special_key_sends_keydown[PAGE_DOWN-expected43]: FAIL
test_special_key_sends_keydown[PAGE_UP-expected44]: FAIL
test_special_key_sends_keydown[SUBTRACT-expected66]: FAIL
/webdriver/tests/perform_actions/validity.py
test_pause_positive_integer[none]: FAIL
test_pause_positive_integer[key]: FAIL
test_pause_positive_integer[pointer]: FAIL
/webdriver/tests/perform_actions/wheel.py
test_no_top_browsing_context: FAIL
test_no_browsing_context: FAIL

New Tests That Don't Pass

/webdriver/tests/bidi/new_session/connect.py
test_websocket_url_connect[capabilities0]: ERROR (Chrome: PASS, Safari: ERROR)
test_bidi_session_send: ERROR (Chrome: PASS, Safari: ERROR)
test_bidi_session_with_different_capability[capabilities0]: ERROR (Chrome: PASS, Safari: ERROR)
/webdriver/tests/element_clear/clear.py
test_input_file: ERROR (Chrome: ERROR, Safari: ERROR)
test_input_file_multiple: ERROR (Chrome: ERROR, Safari: ERROR)
test_select: ERROR (Chrome: ERROR, Safari: ERROR)
test_button: ERROR (Chrome: ERROR, Safari: ERROR)
test_button_with_subtree: ERROR (Chrome: ERROR, Safari: ERROR)
test_contenteditable: ERROR (Chrome: ERROR, Safari: ERROR)
test_designmode: ERROR (Chrome: ERROR, Safari: ERROR)
test_resettable_element_focus_when_empty: ERROR (Chrome: ERROR, Safari: ERROR)
test_resettable_element_does_not_satisfy_validation_constraints[number-foo]: ERROR (Chrome: ERROR, Safari: ERROR)
test_resettable_element_does_not_satisfy_validation_constraints[range-foo]: ERROR (Chrome: ERROR, Safari: ERROR)
test_resettable_element_does_not_satisfy_validation_constraints[email-foo]: ERROR (Chrome: ERROR, Safari: ERROR)
test_resettable_element_does_not_satisfy_validation_constraints[url-foo]: ERROR (Chrome: ERROR, Safari: ERROR)
test_resettable_element_does_not_satisfy_validation_constraints[color-foo]: ERROR (Chrome: ERROR, Safari: ERROR)
test_resettable_element_does_not_satisfy_validation_constraints[date-foo]: ERROR (Chrome: ERROR, Safari: ERROR)
test_resettable_element_does_not_satisfy_validation_constraints[datetime-foo]: ERROR (Chrome: ERROR, Safari: ERROR)
test_resettable_element_does_not_satisfy_validation_constraints[datetime-local-foo]: ERROR (Chrome: ERROR, Safari: ERROR)
test_resettable_element_does_not_satisfy_validation_constraints[time-foo]: ERROR (Chrome: ERROR, Safari: ERROR)
test_resettable_element_does_not_satisfy_validation_constraints[month-foo]: ERROR (Chrome: ERROR, Safari: ERROR)
test_resettable_element_does_not_satisfy_validation_constraints[week-foo]: ERROR (Chrome: ERROR, Safari: ERROR)
test_non_editable_inputs[checkbox]: ERROR (Chrome: ERROR, Safari: ERROR)
test_non_editable_inputs[radio]: ERROR (Chrome: ERROR, Safari: ERROR)
test_non_editable_inputs[hidden]: ERROR (Chrome: ERROR, Safari: ERROR)
test_non_editable_inputs[submit]: ERROR (Chrome: ERROR, Safari: ERROR)
test_non_editable_inputs[button]: ERROR (Chrome: ERROR, Safari: ERROR)
test_non_editable_inputs[image]: ERROR (Chrome: ERROR, Safari: ERROR)
test_scroll_into_view: ERROR (Chrome: ERROR, Safari: ERROR)
/webdriver/tests/element_click/interactability.py
test_element_not_visible_overflow_hidden: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/element_send_keys/events.py
test_file_upload: FAIL (Chrome: PASS, Safari: PASS)
test_form_control_send_text[input]: ERROR (Chrome: ERROR, Safari: ERROR)
test_form_control_send_text[textarea]: ERROR (Chrome: ERROR, Safari: ERROR)
test_not_blurred[input]: ERROR (Chrome: ERROR, Safari: ERROR)
test_not_blurred[textarea]: ERROR (Chrome: ERROR, Safari: ERROR)
/webdriver/tests/element_send_keys/file_upload.py
test_multiple_files_last_path_not_found: ERROR (Chrome: ERROR, Safari: ERROR)
test_multiple_files_without_multiple_attribute: ERROR (Chrome: ERROR, Safari: ERROR)
test_multiple_files_send_twice: ERROR (Chrome: ERROR, Safari: ERROR)
test_multiple_files_reset_with_element_clear: ERROR (Chrome: ERROR, Safari: ERROR)
test_single_file: ERROR (Chrome: ERROR, Safari: ERROR)
test_single_file_replaces_without_multiple_attribute: ERROR (Chrome: ERROR, Safari: ERROR)
test_single_file_appends_with_multiple_attribute: ERROR (Chrome: ERROR, Safari: ERROR)
test_transparent: ERROR (Chrome: ERROR, Safari: ERROR)
test_obscured: ERROR (Chrome: ERROR, Safari: ERROR)
test_outside_viewport: ERROR (Chrome: ERROR, Safari: ERROR)
test_hidden: ERROR (Chrome: ERROR, Safari: ERROR)
test_display_none: ERROR (Chrome: ERROR, Safari: ERROR)
test_strict_hidden[capabilities0]: ERROR (Chrome: ERROR, Safari: ERROR)
test_strict_display_none[capabilities0]: ERROR (Chrome: ERROR, Safari: ERROR)
/webdriver/tests/execute_async_script/collections.py
test_file_list: ERROR (Chrome: ERROR, Safari: ERROR)
test_html_all_collection: ERROR (Chrome: ERROR, Safari: ERROR)
test_html_collection: ERROR (Chrome: ERROR, Safari: ERROR)
test_html_form_controls_collection: ERROR (Chrome: ERROR, Safari: ERROR)
test_html_options_collection: ERROR (Chrome: ERROR, Safari: ERROR)
test_node_list: ERROR (Chrome: ERROR, Safari: ERROR)
/webdriver/tests/execute_async_script/promise.py
test_await_promise_resolve: FAIL (Chrome: PASS, Safari: PASS)
/webdriver/tests/execute_script/collections.py
test_file_list: ERROR (Chrome: ERROR, Safari: ERROR)
test_html_all_collection: ERROR (Chrome: ERROR, Safari: ERROR)
test_html_collection: ERROR (Chrome: ERROR, Safari: ERROR)
test_html_form_controls_collection: ERROR (Chrome: ERROR, Safari: ERROR)
test_html_options_collection: ERROR (Chrome: ERROR, Safari: ERROR)
test_node_list: ERROR (Chrome: ERROR, Safari: ERROR)
/webdriver/tests/execute_script/json_serialize_windowproxy.py
test_initial_window: FAIL (Chrome: FAIL, Safari: FAIL)
test_window_open: FAIL (Chrome: FAIL, Safari: FAIL)
test_frame: FAIL (Chrome: FAIL, Safari: FAIL)
/webdriver/tests/execute_script/promise.py
test_await_promise_resolve: FAIL (Chrome: PASS, Safari: PASS)
/webdriver/tests/find_element_from_element/find.py
test_parent_of_document_node_errors: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/find_element_from_shadow_root/find.py
test_null_parameter_value: FAIL (Chrome: FAIL, Safari: FAIL)
test_no_top_browsing_context: FAIL (Chrome: FAIL, Safari: FAIL)
test_no_browsing_context: FAIL (Chrome: FAIL, Safari: FAIL)
test_invalid_using_argument[a]: FAIL (Chrome: FAIL, Safari: FAIL)
test_invalid_using_argument[True]: FAIL (Chrome: FAIL, Safari: FAIL)
test_invalid_using_argument[None]: FAIL (Chrome: FAIL, Safari: FAIL)
test_invalid_using_argument[1]: FAIL (Chrome: FAIL, Safari: FAIL)
test_invalid_using_argument[using4]: FAIL (Chrome: FAIL, Safari: FAIL)
test_invalid_using_argument[using5]: FAIL (Chrome: FAIL, Safari: FAIL)
test_invalid_selector_argument[None]: FAIL (Chrome: FAIL, Safari: FAIL)
test_invalid_selector_argument[value1]: FAIL (Chrome: FAIL, Safari: FAIL)
test_invalid_selector_argument[value2]: FAIL (Chrome: FAIL, Safari: FAIL)
test_detached_shadow_root: FAIL (Chrome: FAIL, Safari: FAIL)
test_found_element_equivalence: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element[css selector-#linkText]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element[link text-full link text]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element[partial link text-link text]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element[tag name-a]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element[xpath-//a]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element_link_text[<a href=#>link text</a>-link text]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element_link_text[<a href=#> link text </a>-link text]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element_link_text[<a href=#>link<br>text</a>-link\ntext]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element_link_text[<a href=#>link&text</a>-link&text]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element_link_text[<a href=#>LINK TEXT</a>-LINK TEXT]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element_link_text[<a href=# style='text-transform: uppercase'>link text</a>-LINK TEXT]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element_partial_link_text[<a href=#>partial link text</a>-link]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element_partial_link_text[<a href=#> partial link text </a>-link]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element_partial_link_text[<a href=#>partial link text</a>-k t]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element_partial_link_text[<a href=#>partial link<br>text</a>-k\nt]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element_partial_link_text[<a href=#>partial link&text</a>-k&t]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element_partial_link_text[<a href=#>PARTIAL LINK TEXT</a>-LINK]: FAIL (Chrome: FAIL, Safari: FAIL)
test_find_element_partial_link_text[<a href=# style='text-transform: uppercase'>partial link text</a>-LINK]: FAIL (Chrome: FAIL, Safari: FAIL)
test_no_element[css selector-#wontExist]: FAIL (Chrome: FAIL, Safari: FAIL)
/webdriver/tests/find_element_from_shadow_root/user_prompts.py
test_accept[capabilities0-alert-None]: FAIL (Chrome: FAIL, Safari: FAIL)
test_accept[capabilities0-confirm-True]: FAIL (Chrome: FAIL, Safari: FAIL)
test_accept[capabilities0-prompt-]: FAIL (Chrome: FAIL, Safari: FAIL)
test_accept_and_notify[capabilities0-alert-None]: FAIL (Chrome: FAIL, Safari: FAIL)
test_accept_and_notify[capabilities0-confirm-True]: FAIL (Chrome: FAIL, Safari: FAIL)
test_accept_and_notify[capabilities0-prompt-]: FAIL (Chrome: FAIL, Safari: FAIL)
test_dismiss[capabilities0-alert-None]: FAIL (Chrome: FAIL, Safari: FAIL)
test_dismiss[capabilities0-confirm-False]: FAIL (Chrome: FAIL, Safari: FAIL)
test_dismiss[capabilities0-prompt-None]: FAIL (Chrome: FAIL, Safari: FAIL)
test_dismiss_and_notify[capabilities0-alert-None]: FAIL (Chrome: FAIL, Safari: FAIL)
test_dismiss_and_notify[capabilities0-confirm-False]: FAIL (Chrome: FAIL, Safari: FAIL)
test_dismiss_and_notify[capabilities0-prompt-None]: FAIL (Chrome: FAIL, Safari: FAIL)
test_ignore[capabilities0-alert]: FAIL (Chrome: FAIL, Safari: FAIL)
test_ignore[capabilities0-confirm]: FAIL (Chrome: FAIL, Safari: FAIL)
test_ignore[capabilities0-prompt]: FAIL (Chrome: FAIL, Safari: FAIL)
test_default[alert-None]: FAIL (Chrome: FAIL, Safari: FAIL)
test_default[confirm-False]: FAIL (Chrome: FAIL, Safari: FAIL)
test_default[prompt-None]: FAIL (Chrome: FAIL, Safari: FAIL)
/webdriver/tests/find_elements_from_element/find.py
test_parent_of_document_node_errors: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/find_elements_from_shadow_root/find.py: ERROR [GitHub], OK [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-qr-debug, Gecko-windows10-32-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug] (Chrome: ERROR, Safari: ERROR)
test_null_parameter_value: FAIL
test_no_top_browsing_context: FAIL
test_no_browsing_context: FAIL
test_invalid_using_argument[a]: FAIL
test_invalid_using_argument[True]: FAIL
test_invalid_using_argument[None]: FAIL
test_invalid_using_argument[1]: FAIL
test_invalid_using_argument[using4]: FAIL
test_invalid_using_argument[using5]: FAIL
test_invalid_selector_argument[None]: FAIL
test_invalid_selector_argument[value1]: FAIL
test_invalid_selector_argument[value2]: FAIL
test_detached_shadow_root: FAIL
test_find_elements_equivalence: FAIL
test_find_elements[css selector-#linkText]: FAIL
test_find_elements[link text-full link text]: FAIL
test_find_elements[partial link text-link text]: FAIL
test_find_elements[tag name-a]: FAIL
test_find_elements[xpath-//a]: FAIL
test_find_elements_link_text[<a href=#>link text</a>-link text]: FAIL
test_find_elements_link_text[<a href=#> link text </a>-link text]: FAIL
test_find_elements_link_text[<a href=#>link<br>text</a>-link\ntext]: FAIL
test_find_elements_link_text[<a href=#>link&text</a>-link&text]: FAIL
test_find_elements_link_text[<a href=#>LINK TEXT</a>-LINK TEXT]: FAIL
test_find_elements_link_text[<a href=# style='text-transform: uppercase'>link text</a>-LINK TEXT]: FAIL
test_find_elements_partial_link_text[<a href=#>partial link text</a>-link]: FAIL
test_find_elements_partial_link_text[<a href=#> partial link text </a>-link]: FAIL
test_find_elements_partial_link_text[<a href=#>partial link text</a>-k t]: FAIL
test_find_elements_partial_link_text[<a href=#>partial link<br>text</a>-k\nt]: FAIL
test_find_elements_partial_link_text[<a href=#>partial link&text</a>-k&t]: FAIL
test_find_elements_partial_link_text[<a href=#>PARTIAL LINK TEXT</a>-LINK]: FAIL
test_find_elements_partial_link_text[<a href=# style='text-transform: uppercase'>partial link text</a>-LINK]: FAIL
test_no_element[css selector-#wontExist]: FAIL
/webdriver/tests/find_elements_from_shadow_root/user_prompts.py: ERROR [GitHub], OK [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-qr-debug, Gecko-windows10-32-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug] (Chrome: ERROR, Safari: ERROR)
test_accept[capabilities0-alert-None]: FAIL
test_accept[capabilities0-confirm-True]: FAIL
test_accept[capabilities0-prompt-]: FAIL
test_accept_and_notify[capabilities0-alert-None]: FAIL
test_accept_and_notify[capabilities0-confirm-True]: FAIL
test_accept_and_notify[capabilities0-prompt-]: FAIL
test_dismiss[capabilities0-alert-None]: FAIL
test_dismiss[capabilities0-confirm-False]: FAIL
test_dismiss[capabilities0-prompt-None]: FAIL
test_dismiss_and_notify[capabilities0-alert-None]: FAIL
test_dismiss_and_notify[capabilities0-confirm-False]: FAIL
test_dismiss_and_notify[capabilities0-prompt-None]: FAIL
test_ignore[capabilities0-alert]: FAIL
test_ignore[capabilities0-confirm]: FAIL
test_ignore[capabilities0-prompt]: FAIL
test_default[alert-None]: FAIL
test_default[confirm-False]: FAIL
test_default[prompt-None]: FAIL
/webdriver/tests/get_computed_label/get.py: ERROR (Chrome: ERROR, Safari: ERROR)
/webdriver/tests/get_computed_role/get.py: ERROR (Chrome: ERROR, Safari: ERROR)
/webdriver/tests/get_element_property/get.py
test_primitives["foobar"-foobar]: FAIL (Chrome: PASS, Safari: PASS)
test_primitives[42-42]: FAIL (Chrome: PASS, Safari: PASS)
test_primitives[js_primitive2-py_primitive2]: FAIL (Chrome: PASS, Safari: PASS)
test_primitives[js_primitive3-py_primitive3]: FAIL (Chrome: PASS, Safari: PASS)
test_primitives_set_by_execute_script["foobar"-foobar]: FAIL (Chrome: PASS, Safari: PASS)
test_primitives_set_by_execute_script[42-42]: FAIL (Chrome: PASS, Safari: PASS)
test_primitives_set_by_execute_script[js_primitive2-py_primitive2]: FAIL (Chrome: PASS, Safari: PASS)
test_primitives_set_by_execute_script[js_primitive3-py_primitive3]: FAIL (Chrome: PASS, Safari: PASS)
/webdriver/tests/get_element_shadow_root/get.py
test_no_top_browsing_context: FAIL (Chrome: FAIL, Safari: FAIL)
test_no_browsing_context: FAIL (Chrome: FAIL, Safari: FAIL)
test_element_not_found: FAIL (Chrome: FAIL, Safari: FAIL)
test_element_stale: FAIL (Chrome: FAIL, Safari: FAIL)
test_get_shadow_root: FAIL (Chrome: FAIL, Safari: FAIL)
test_no_shadow_root: FAIL (Chrome: FAIL, Safari: FAIL)
/webdriver/tests/get_element_shadow_root/user_prompts.py: ERROR [GitHub], OK [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-qr-debug, Gecko-windows10-32-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug] (Chrome: ERROR, Safari: ERROR)
test_accept[capabilities0-alert-None]: FAIL
test_accept[capabilities0-confirm-True]: FAIL
test_accept[capabilities0-prompt-]: FAIL
test_accept_and_notify[capabilities0-alert-None]: FAIL
test_accept_and_notify[capabilities0-confirm-True]: FAIL
test_accept_and_notify[capabilities0-prompt-]: FAIL
test_dismiss[capabilities0-alert-None]: FAIL
test_dismiss[capabilities0-confirm-False]: FAIL
test_dismiss[capabilities0-prompt-None]: FAIL
test_dismiss_and_notify[capabilities0-alert-None]: FAIL
test_dismiss_and_notify[capabilities0-confirm-False]: FAIL
test_dismiss_and_notify[capabilities0-prompt-None]: FAIL
test_ignore[capabilities0-alert]: FAIL
test_ignore[capabilities0-confirm]: FAIL
test_ignore[capabilities0-prompt]: FAIL
test_default[alert-None]: FAIL
test_default[confirm-False]: FAIL
test_default[prompt-None]: FAIL
/webdriver/tests/get_window_rect/get.py
test_payload: FAIL [Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-opt], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-qr-debug, Gecko-windows10-32-qr-debug, Gecko-windows10-32-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, GitHub] (Chrome: PASS, Safari: PASS)
/webdriver/tests/maximize_window/maximize.py
test_maximize_when_resized_to_max_size: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-32-qr-debug, Gecko-windows10-32-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug] (Chrome: PASS, Safari: PASS)
/webdriver/tests/new_session/default_values.py
test_no_capabilites: FAIL (Chrome: PASS, Safari: FAIL)
test_desired: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/new_session/websocket_url.py
test_websocket_url: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/perform_actions/key_events.py
test_modifier_key_sends_correct_events[\ue03d-META]: FAIL (Chrome: PASS, Safari: PASS)
test_modifier_key_sends_correct_events[\ue053-R_META]: FAIL (Chrome: PASS, Safari: FAIL)
test_special_key_sends_keydown[ADD-expected0]: FAIL (Chrome: PASS, Safari: PASS)
test_special_key_sends_keydown[META-expected30]: FAIL (Chrome: PASS, Safari: PASS)
test_special_key_sends_keydown[NUMPAD4-expected37]: FAIL (Chrome: PASS, Safari: PASS)
test_special_key_sends_keydown[NUMPAD5-expected38]: FAIL (Chrome: PASS, Safari: PASS)
test_special_key_sends_keydown[PAGE_DOWN-expected43]: FAIL (Chrome: PASS, Safari: PASS)
test_special_key_sends_keydown[PAGE_UP-expected44]: FAIL (Chrome: PASS, Safari: PASS)
test_special_key_sends_keydown[R_META-expected58]: FAIL (Chrome: PASS, Safari: FAIL)
test_special_key_sends_keydown[SEPARATOR-expected63]: FAIL (Chrome: PASS, Safari: FAIL)
test_special_key_sends_keydown[SUBTRACT-expected66]: FAIL (Chrome: PASS, Safari: PASS)
/webdriver/tests/perform_actions/pointer.py
test_pen_pointer_properties: FAIL (Chrome: FAIL, Safari: FAIL)
test_touch_pointer_properties: FAIL (Chrome: PASS, Safari: FAIL)
test_drag_and_drop_with_draggable_element[0]: FAIL (Chrome: FAIL, Safari: FAIL)
test_drag_and_drop_with_draggable_element[300]: FAIL (Chrome: FAIL, Safari: FAIL)
test_drag_and_drop_with_draggable_element[800]: FAIL (Chrome: FAIL, Safari: FAIL)
/webdriver/tests/perform_actions/pointer_tripleclick.py
test_tripleclick_at_coordinates: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/perform_actions/validity.py
test_pause_positive_integer[none]: FAIL (Chrome: PASS, Safari: PASS)
test_pause_positive_integer[key]: FAIL (Chrome: PASS, Safari: PASS)
test_pause_positive_integer[pointer]: FAIL (Chrome: PASS, Safari: PASS)
/webdriver/tests/perform_actions/wheel.py
test_null_response_value: FAIL (Chrome: PASS, Safari: FAIL)
test_no_top_browsing_context: FAIL (Chrome: PASS, Safari: PASS)
test_no_browsing_context: FAIL (Chrome: PASS, Safari: PASS)
test_wheel_scroll: FAIL (Chrome: PASS, Safari: FAIL)
test_wheel_scroll_overflow: FAIL (Chrome: PASS, Safari: FAIL)
test_wheel_scroll_iframe: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/permissions/set.py
test_invalid_parameters[capabilities0-parameters0]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters1]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters2]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters3]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters4]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters5]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters6]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters7]: FAIL (Chrome: PASS, Safari: ERROR)
test_non_secure_context[granted]: FAIL (Chrome: PASS, Safari: FAIL)
test_non_secure_context[denied]: FAIL (Chrome: PASS, Safari: FAIL)
test_non_secure_context[prompt]: FAIL (Chrome: PASS, Safari: FAIL)
test_set_to_state[capabilities0-realmSetting0-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting0-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting0-prompt]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting1-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting1-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting1-prompt]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting2-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting2-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting2-prompt]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting0-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting0-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting0-prompt]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting1-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting1-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting1-prompt]: FAIL (Chrome: PASS, Safari: ERROR)

Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/afd9ed99cc50
[wpt PR 28381] - Start creating a proper client for WebDriver BiDi, a=testonly
https://hg.mozilla.org/integration/autoland/rev/a3084b3cef0a
[wpt PR 28381] - Update wpt metadata, a=testonly

https://hg.mozilla.org/mozilla-central/rev/afd9ed99cc50
https://hg.mozilla.org/mozilla-central/rev/a3084b3cef0a

Status: NEW → RESOLVED
Closed: 3 years ago
status-firefox91: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 91 Branch
You need to log in before you can comment on or make changes to this bug.