1717840 - New wpt failures in /webdriver/tests/ [bidi/new_session/connect.py, element_click/interactability.py, element_send_keys/events.py, and 13 others]

Status: RESOLVED WORKSFORME

(Testing :: geckodriver, defect)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Syncing wpt PR 28381 found new untriaged test failures in CI

Tests Affected

Firefox-only failures

/webdriver/tests/element_send_keys/events.py
test_file_upload: FAIL
/webdriver/tests/execute_async_script/promise.py
test_await_promise_resolve: FAIL
/webdriver/tests/execute_script/promise.py
test_await_promise_resolve: FAIL
/webdriver/tests/get_element_property/get.py
test_primitives["foobar"-foobar]: FAIL
test_primitives[42-42]: FAIL
test_primitives[js_primitive2-py_primitive2]: FAIL
test_primitives[js_primitive3-py_primitive3]: FAIL
test_primitives_set_by_execute_script["foobar"-foobar]: FAIL
test_primitives_set_by_execute_script[42-42]: FAIL
test_primitives_set_by_execute_script[js_primitive2-py_primitive2]: FAIL
test_primitives_set_by_execute_script[js_primitive3-py_primitive3]: FAIL
/webdriver/tests/perform_actions/key_events.py
test_modifier_key_sends_correct_events[\ue03d-META]: FAIL
test_special_key_sends_keydown[ADD-expected0]: FAIL
test_special_key_sends_keydown[META-expected30]: FAIL
test_special_key_sends_keydown[NUMPAD4-expected37]: FAIL
test_special_key_sends_keydown[NUMPAD5-expected38]: FAIL
test_special_key_sends_keydown[PAGE_DOWN-expected43]: FAIL
test_special_key_sends_keydown[PAGE_UP-expected44]: FAIL
test_special_key_sends_keydown[SUBTRACT-expected66]: FAIL
/webdriver/tests/perform_actions/validity.py
test_pause_positive_integer[none]: FAIL
test_pause_positive_integer[key]: FAIL
test_pause_positive_integer[pointer]: FAIL
/webdriver/tests/perform_actions/wheel.py
test_no_top_browsing_context: FAIL
test_no_browsing_context: FAIL

New Tests That Don't Pass

/webdriver/tests/bidi/new_session/connect.py
test_websocket_url_connect[capabilities0]: ERROR (Chrome: PASS, Safari: ERROR)
test_bidi_session_send: ERROR (Chrome: PASS, Safari: ERROR)
test_bidi_session_with_different_capability[capabilities0]: ERROR (Chrome: PASS, Safari: ERROR)
/webdriver/tests/element_click/interactability.py
test_element_not_visible_overflow_hidden: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/find_element_from_element/find.py
test_parent_of_document_node_errors: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/find_elements_from_element/find.py
test_parent_of_document_node_errors: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/new_session/default_values.py
test_no_capabilites: FAIL (Chrome: PASS, Safari: FAIL)
test_desired: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/new_session/websocket_url.py
test_websocket_url: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/perform_actions/key_events.py
test_modifier_key_sends_correct_events[\ue053-R_META]: FAIL (Chrome: PASS, Safari: FAIL)
test_special_key_sends_keydown[R_META-expected58]: FAIL (Chrome: PASS, Safari: FAIL)
test_special_key_sends_keydown[SEPARATOR-expected63]: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/perform_actions/pointer.py
test_touch_pointer_properties: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/perform_actions/pointer_tripleclick.py
test_tripleclick_at_coordinates: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/perform_actions/wheel.py
test_null_response_value: FAIL (Chrome: PASS, Safari: FAIL)
test_wheel_scroll: FAIL (Chrome: PASS, Safari: FAIL)
test_wheel_scroll_overflow: FAIL (Chrome: PASS, Safari: FAIL)
test_wheel_scroll_iframe: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/permissions/set.py
test_invalid_parameters[capabilities0-parameters0]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters1]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters2]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters3]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters4]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters5]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters6]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters7]: FAIL (Chrome: PASS, Safari: ERROR)
test_non_secure_context[granted]: FAIL (Chrome: PASS, Safari: FAIL)
test_non_secure_context[denied]: FAIL (Chrome: PASS, Safari: FAIL)
test_non_secure_context[prompt]: FAIL (Chrome: PASS, Safari: FAIL)
test_set_to_state[capabilities0-realmSetting0-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting0-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting0-prompt]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting1-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting1-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting1-prompt]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting2-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting2-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting2-prompt]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting0-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting0-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting0-prompt]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting1-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting1-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting1-prompt]: FAIL (Chrome: PASS, Safari: ERROR)

CI Results

Gecko CI (Treeherder)
GitHub PR Head

Notes

These updates will be on mozilla-central once bug 1703227 lands.

Note: this bug is for tracking fixing the issues and is not
owned by the wpt sync bot.

This bug is linked to the relevant tests by an annotation in
https://github.com/web-platform-tests/wpt-metadata. These annotations
can be edited using the wpt interop dashboard
https://jgraham.github.io/wptdash/

If this bug is split into multiple bugs, please also update the
annotations, otherwise we are unable to track which wpt issues are
already triaged. Resolving as duplicate or closing this issue should
be cause the bot to automatically update or remove the annotation.

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+1]]

The appropriate wpt sync landing for the meta updates (https://hg.mozilla.org/integration/autoland/rev/a3084b3cef0a) doesn't change anything related to the issues as originally referenced when the bug got filed. So there is nothing we have to do here.