Closed
Bug 1940936
Opened 1 month ago
Closed 1 month ago
[wpt-sync] Sync PR 50019 - [wdspec] check that subscription IDs are returned
Categories
(Remote Protocol :: WebDriver BiDi, task, P4)
Remote Protocol
WebDriver BiDi
Tracking
(firefox136 fixed)
RESOLVED
FIXED
136 Branch
| Tracking | Status | |
|---|---|---|
| firefox136 | --- | fixed |
People
(Reporter: wpt-sync, Unassigned)
References
(Blocks 1 open bug, )
Details
(Whiteboard: [wptsync downstream])
Sync web-platform-tests PR 50019 into mozilla-central (this bug is closed when the sync is complete).
PR: https://github.com/web-platform-tests/wpt/pull/50019
Details from upstream follow.
Alex Rudenko <alexrudenko@chromium.org> wrote:
[wdspec] check that subscription IDs are returned
|
Assignee | |
Updated•1 month ago
|
Component: web-platform-tests → Marionette
Product: Testing → Remote Protocol
|
|
Assignee | |
Comment 1•1 month ago
|
||
Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=418f86e66a1fef3cf8aa60da3cbfe8ea61bcc58c
|
|
Assignee | |
Comment 2•1 month ago
|
||
CI Results
Ran 4 Firefox configurations based on mozilla-central, and Safari on GitHub CI
Total 443 tests and 5 subtests
Status Summary
Firefox
OK : 442
PASS : 7507
FAIL : 133
Safari
OK : 443
PASS : 2513
FAIL : 859
ERROR: 4272
Links
Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base
Details
New Tests That Don't Pass
- /webdriver/tests/classic/new_session/no_capabilities.py [wpt.fyi]:
SKIP(Safari:OK) - /webdriver/tests/bidi/browsing_context/context_created/context_created.py [wpt.fyi]
- test_existing_context[tab]:
FAIL(Safari:ERROR) - test_existing_context[window]:
FAIL(Safari:ERROR)
- test_existing_context[tab]:
- /webdriver/tests/bidi/browsing_context/context_destroyed/context_destroyed.py [wpt.fyi]
- test_delete_nested_iframes:
FAIL(Safari:ERROR)
- test_delete_nested_iframes:
- /webdriver/tests/bidi/browsing_context/dom_content_loaded/dom_content_loaded.py [wpt.fyi]
- test_new_context_not_emitted[tab]:
FAIL(Safari:ERROR) - test_new_context_not_emitted[window]:
FAIL(Safari:ERROR)
- test_new_context_not_emitted[tab]:
- /webdriver/tests/bidi/browsing_context/history_updated/history_updated.py [wpt.fyi]
- test_history_url_update[-#foo-pushState]:
FAIL(Safari:ERROR) - test_history_url_update[#foo-#bar-pushState]:
FAIL(Safari:ERROR) - test_history_url_update[#foo-#foo-pushState]:
FAIL(Safari:ERROR) - test_history_url_update[#bar--pushState]:
FAIL(Safari:ERROR) - test_history_url_update[-#foo-replaceState]:
FAIL(Safari:ERROR) - test_history_url_update[#foo-#bar-replaceState]:
FAIL(Safari:ERROR) - test_history_url_update[#foo-#foo-replaceState]:
FAIL(Safari:ERROR) - test_history_url_update[#bar--replaceState]:
FAIL(Safari:ERROR) - test_history_state_update[pushState]:
FAIL(Safari:ERROR) - test_history_state_update[replaceState]:
FAIL(Safari:ERROR) - test_history_document_open:
FAIL(Safari:ERROR)
- test_history_url_update[-#foo-pushState]:
- /webdriver/tests/bidi/browsing_context/load/load.py [wpt.fyi]
- test_new_context_not_emitted[tab]:
FAIL(Safari:ERROR) - test_new_context_not_emitted[window]:
FAIL(Safari:ERROR)
- test_new_context_not_emitted[tab]:
- /webdriver/tests/bidi/browsing_context/locate_nodes/invalid.py [wpt.fyi]
- test_params_locator_value_invalid_value[innerText-]:
FAIL(Safari:ERROR)
- test_params_locator_value_invalid_value[innerText-]:
- /webdriver/tests/bidi/browsing_context/locate_nodes/locator.py [wpt.fyi]
- test_find_by_locator[innerText-foobarBARbaz]:
FAIL(Safari:ERROR) - test_find_by_inner_text[ignore_case_true_full_match_no_max_depth]:
FAIL(Safari:ERROR) - test_find_by_inner_text[ignore_case_false_full_match_no_max_depth]:
FAIL(Safari:ERROR) - test_find_by_inner_text[ignore_case_true_partial_match_no_max_depth]:
FAIL(Safari:ERROR) - test_find_by_inner_text[ignore_case_false_partial_match_no_max_depth]:
FAIL(Safari:ERROR) - test_find_by_inner_text[ignore_case_true_full_match_max_depth_zero]:
FAIL(Safari:ERROR) - test_find_by_inner_text[ignore_case_false_full_match_max_depth_zero]:
FAIL(Safari:ERROR) - test_find_by_inner_text[ignore_case_true_partial_match_max_depth_zero]:
FAIL(Safari:ERROR) - test_find_by_inner_text[ignore_case_false_partial_match_max_depth_zero]:
FAIL(Safari:ERROR) - test_find_by_inner_text[ignore_case_true_full_match_max_depth_two]:
FAIL(Safari:ERROR) - test_find_by_inner_text[ignore_case_false_full_match_max_depth_two]:
FAIL(Safari:ERROR) - test_find_by_inner_text[ignore_case_true_partial_match_max_depth_two]:
FAIL(Safari:ERROR) - test_find_by_inner_text[ignore_case_false_partial_match_max_depth_two]:
FAIL(Safari:ERROR)
- test_find_by_locator[innerText-foobarBARbaz]:
- /webdriver/tests/bidi/browsing_context/locate_nodes/max_node_count.py [wpt.fyi]
- test_find_by_locator_limit_return_count[inner_text_single]:
FAIL(Safari:ERROR) - test_find_by_locator_limit_return_count[inner_text_multiple]:
FAIL(Safari:ERROR)
- test_find_by_locator_limit_return_count[inner_text_single]:
- /webdriver/tests/bidi/browsing_context/locate_nodes/start_nodes.py [wpt.fyi]
- test_locate_with_context_nodes[innerText-foo-expected4]:
FAIL(Safari:ERROR) - test_locate_with_multiple_context_nodes[innerText-foo]:
FAIL(Safari:ERROR) - test_locate_with_document_context_node[innerText-foo]:
FAIL(Safari:ERROR)
- test_locate_with_context_nodes[innerText-foo-expected4]:
- /webdriver/tests/bidi/browsing_context/navigate/navigate.py [wpt.fyi]
- test_same_document_navigation_in_before_unload:
FAIL(Safari:ERROR)
- test_same_document_navigation_in_before_unload:
- /webdriver/tests/bidi/browsing_context/navigation_failed/navigation_failed.py [wpt.fyi]
- test_with_beforeunload_prompt[capabilities0]:
FAIL(Safari:ERROR)
- test_with_beforeunload_prompt[capabilities0]:
- /webdriver/tests/bidi/browsing_context/navigation_started/navigation_started.py [wpt.fyi]
- test_redirect_http_equiv:
FAIL(Safari:ERROR) - test_with_beforeunload_prompt[capabilities0]:
FAIL(Safari:ERROR) - test_with_accepted_beforeunload_prompt[capabilities0]:
FAIL(Safari:ERROR)
- test_redirect_http_equiv:
- /webdriver/tests/bidi/browsing_context/print/margin.py [wpt.fyi]
- test_margin_same_as_page_dimension[top]:
FAIL(Safari:ERROR) - test_margin_same_as_page_dimension[left]:
FAIL(Safari:ERROR) - test_margin_same_as_page_dimension[right]:
FAIL(Safari:ERROR) - test_margin_same_as_page_dimension[bottom]:
FAIL(Safari:ERROR) - test_margin_same_as_page_dimension[all]:
FAIL(Safari:ERROR)
- test_margin_same_as_page_dimension[top]:
- /webdriver/tests/bidi/browsing_context/reload/invalid.py [wpt.fyi]
- test_params_ignore_cache_invalid_type[]:
FAIL(Safari:ERROR) - test_params_ignore_cache_invalid_type[42]:
FAIL(Safari:ERROR) - test_params_ignore_cache_invalid_type[value2]:
FAIL(Safari:ERROR) - test_params_ignore_cache_invalid_type[value3]:
FAIL(Safari:ERROR)
- test_params_ignore_cache_invalid_type[]:
- /webdriver/tests/bidi/external/bluetooth/simulate_adapter/context.py [wpt.fyi]
- test_contexts_are_isolated:
FAIL(Safari:ERROR)
- test_contexts_are_isolated:
- /webdriver/tests/bidi/external/bluetooth/simulate_adapter/invalid.py [wpt.fyi]
- test_state_invalid_type[None]:
FAIL(Safari:ERROR) - test_state_invalid_type[False]:
FAIL(Safari:ERROR) - test_state_invalid_type[42]:
FAIL(Safari:ERROR) - test_state_invalid_type[state3]:
FAIL(Safari:ERROR) - test_state_invalid_type[state4]:
FAIL(Safari:ERROR) - test_state_invalid_value[]:
FAIL(Safari:ERROR) - test_state_invalid_value[invalid]:
FAIL(Safari:ERROR) - test_context_invalid_type[None]:
FAIL(Safari:ERROR) - test_context_invalid_type[False]:
FAIL(Safari:ERROR) - test_context_invalid_type[42]:
FAIL(Safari:ERROR) - test_context_invalid_type[context3]:
FAIL(Safari:ERROR) - test_context_invalid_type[context4]:
FAIL(Safari:ERROR) - test_context_unknown_value:
FAIL(Safari:ERROR)
- test_state_invalid_type[None]:
- /webdriver/tests/bidi/external/bluetooth/simulate_adapter/state.py [wpt.fyi]
- test_state[absent-False]:
FAIL(Safari:ERROR) - test_state[powered-off-True]:
FAIL(Safari:ERROR) - test_state[powered-on-True]:
FAIL(Safari:ERROR) - test_set_twice[absent-False-absent-False]:
FAIL(Safari:ERROR) - test_set_twice[absent-False-powered-off-True]:
FAIL(Safari:ERROR) - test_set_twice[absent-False-powered-on-True]:
FAIL(Safari:ERROR) - test_set_twice[powered-off-True-absent-False]:
FAIL(Safari:ERROR) - test_set_twice[powered-off-True-powered-off-True]:
FAIL(Safari:ERROR) - test_set_twice[powered-off-True-powered-on-True]:
FAIL(Safari:ERROR) - test_set_twice[powered-on-True-absent-False]:
FAIL(Safari:ERROR) - test_set_twice[powered-on-True-powered-off-True]:
FAIL(Safari:ERROR) - test_set_twice[powered-on-True-powered-on-True]:
FAIL(Safari:ERROR)
- test_state[absent-False]:
- /webdriver/tests/bidi/external/permissions/set_permission/set_permission.py [wpt.fyi]
- test_set_permission_origin_unknown[UNKNOWN]:
FAIL(Safari:ERROR) - test_set_permission_origin_unknown[]:
FAIL(Safari:ERROR)
- test_set_permission_origin_unknown[UNKNOWN]:
- /webdriver/tests/bidi/input/perform_actions/pointer_mouse_drag.py [wpt.fyi]
- test_drag_and_drop_with_draggable_element[0]:
FAIL(Safari:ERROR) - test_drag_and_drop_with_draggable_element[300]:
FAIL(Safari:ERROR) - test_drag_and_drop_with_draggable_element[800]:
FAIL(Safari:ERROR)
- test_drag_and_drop_with_draggable_element[0]:
- /webdriver/tests/bidi/input/perform_actions/pointer_pen.py [wpt.fyi]
- test_pointer_down_closes_browsing_context:
FAIL(Safari:ERROR) - test_pen_pointer_in_shadow_tree[outer-open]:
FAIL(Safari:ERROR) - test_pen_pointer_in_shadow_tree[outer-closed]:
FAIL(Safari:ERROR) - test_pen_pointer_in_shadow_tree[inner-open]:
FAIL(Safari:ERROR) - test_pen_pointer_in_shadow_tree[inner-closed]:
FAIL(Safari:ERROR) - test_pen_pointer_properties:
FAIL(Safari:ERROR)
- test_pointer_down_closes_browsing_context:
- /webdriver/tests/bidi/input/perform_actions/pointer_touch.py [wpt.fyi]
- test_touch_pointer_properties_angle_twist:
FAIL(Safari:ERROR)
- test_touch_pointer_properties_angle_twist:
- /webdriver/tests/bidi/input/set_files/files.py [wpt.fyi]
- test_set_files_twice_same_in_different_folders:
FAIL(Safari:ERROR)
- test_set_files_twice_same_in_different_folders:
- /webdriver/tests/bidi/integration/navigation.py [wpt.fyi]
- test_navigate_history_replacestate_beforeunload:
FAIL(Safari:ERROR)
- test_navigate_history_replacestate_beforeunload:
- /webdriver/tests/bidi/log/entry_added/console.py [wpt.fyi]
- test_method_timeEnd:
FAIL(Safari:ERROR)
- test_method_timeEnd:
- /webdriver/tests/bidi/log/entry_added/event_buffer.py [wpt.fyi]
- test_console_log_cached_message_after_refresh[console_api_log]:
FAIL(Safari:ERROR) - test_console_log_cached_message_after_refresh[javascript_error]:
FAIL(Safari:ERROR)
- test_console_log_cached_message_after_refresh[console_api_log]:
- /webdriver/tests/bidi/log/entry_added/realm.py [wpt.fyi]
- test_realm[sandbox]:
FAIL(Safari:ERROR)
- test_realm[sandbox]:
- /webdriver/tests/bidi/log/entry_added/stacktrace.py [wpt.fyi]
- test_console_entry_sync_callstack[warn-True]:
FAIL(Safari:ERROR)
- test_console_entry_sync_callstack[warn-True]:
- /webdriver/tests/bidi/log/entry_added/subscription.py [wpt.fyi]
- test_subscribe_unsubscribe[console_api_log]:
FAIL(Safari:ERROR) - test_subscribe_unsubscribe[javascript_error]:
FAIL(Safari:ERROR)
- test_subscribe_unsubscribe[console_api_log]:
- /webdriver/tests/bidi/network/combined/network_events.py [wpt.fyi]
- test_cors_preflight_request:
FAIL(Safari:ERROR)
- test_cors_preflight_request:
- /webdriver/tests/bidi/script/realm_created/realm_created.py [wpt.fyi]
- test_dedicated_worker:
FAIL(Safari:ERROR) - test_shared_worker:
FAIL(Safari:ERROR) - test_service_worker:
FAIL(Safari:ERROR) - test_existing_realm[tab]:
FAIL(Safari:ERROR) - test_existing_realm[window]:
FAIL(Safari:ERROR)
- test_dedicated_worker:
- /webdriver/tests/bidi/script/realm_destroyed/realm_destroyed.py [wpt.fyi]
- test_dedicated_worker:
FAIL(Safari:ERROR) - test_shared_worker:
FAIL(Safari:ERROR)
- test_dedicated_worker:
- /webdriver/tests/bidi/session/subscribe/subscription_id.py [wpt.fyi]
- test_subscribe_subscription_id:
FAIL(Safari:ERROR)
- test_subscribe_subscription_id:
- /webdriver/tests/classic/element_click/interactability.py [wpt.fyi]
- test_element_not_visible_overflow_hidden:
FAIL(Safari:FAIL)
- test_element_not_visible_overflow_hidden:
- /webdriver/tests/classic/execute_async_script/objects.py [wpt.fyi]
- test_object_to_json:
FAIL(Safari:PASS) - test_object_to_json_exception:
FAIL(Safari:PASS)
- test_object_to_json:
- /webdriver/tests/classic/execute_async_script/promise.py [wpt.fyi]
- test_await_promise_resolve:
FAIL(Safari:PASS)
- test_await_promise_resolve:
- /webdriver/tests/classic/execute_script/promise.py [wpt.fyi]
- test_await_promise_resolve:
FAIL(Safari:PASS)
- test_await_promise_resolve:
- /webdriver/tests/classic/find_element_from_element/find.py [wpt.fyi]
- test_parent_of_document_node_errors:
FAIL(Safari:FAIL)
- test_parent_of_document_node_errors:
- /webdriver/tests/classic/find_element_from_shadow_root/find.py [wpt.fyi]
- test_find_element[open-tag name-a]:
FAIL(Safari:FAIL) - test_find_element[open-xpath-//a]:
FAIL(Safari:FAIL) - test_find_element[closed-tag name-a]:
FAIL(Safari:FAIL) - test_find_element[closed-xpath-//a]:
FAIL(Safari:FAIL)
- test_find_element[open-tag name-a]:
- /webdriver/tests/classic/find_elements_from_element/find.py [wpt.fyi]
- test_parent_of_document_node_errors:
FAIL(Safari:FAIL)
- test_parent_of_document_node_errors:
- /webdriver/tests/classic/find_elements_from_shadow_root/find.py [wpt.fyi]
- test_find_elements[open-tag name-a]:
FAIL(Safari:FAIL) - test_find_elements[open-xpath-//a]:
FAIL(Safari:FAIL) - test_find_elements[closed-tag name-a]:
FAIL(Safari:FAIL) - test_find_elements[closed-xpath-//a]:
FAIL(Safari:FAIL)
- test_find_elements[open-tag name-a]:
- /webdriver/tests/classic/perform_actions/pointer_mouse_drag.py [wpt.fyi]
- test_drag_and_drop_with_draggable_element[0]:
FAIL(Safari:FAIL) - test_drag_and_drop_with_draggable_element[300]:
FAIL(Safari:FAIL) - test_drag_and_drop_with_draggable_element[800]:
FAIL(Safari:FAIL)
- test_drag_and_drop_with_draggable_element[0]:
- /webdriver/tests/classic/perform_actions/pointer_pen.py [wpt.fyi]
- test_null_response_value:
FAIL(Safari:PASS) - test_pointer_down_closes_browsing_context:
FAIL(Safari:ERROR) - test_pen_pointer_in_shadow_tree[outer-open]:
FAIL(Safari:FAIL) - test_pen_pointer_in_shadow_tree[outer-closed]:
FAIL(Safari:FAIL) - test_pen_pointer_in_shadow_tree[inner-open]:
FAIL(Safari:FAIL) - test_pen_pointer_in_shadow_tree[inner-closed]:
FAIL(Safari:FAIL) - test_pen_pointer_properties:
FAIL(Safari:FAIL)
- test_null_response_value:
- /webdriver/tests/classic/perform_actions/pointer_touch.py [wpt.fyi]
- test_touch_pointer_properties_angle_twist:
FAIL(Safari:FAIL)
- test_touch_pointer_properties_angle_twist:
Tests Disabled in Gecko Infrastructure
- /webdriver/tests/classic/new_session/no_capabilities.py [wpt.fyi]:
SKIP(Safari:OK)
Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/6cc75d5fbb9d
[wpt PR 50019] - [wdspec] check that subscription IDs are returned, a=testonly
https://hg.mozilla.org/integration/autoland/rev/6ffb61fedd3e
[wpt PR 50019] - Update wpt metadata, a=testonly
|
||
Updated•1 month ago
|
Component: Marionette → WebDriver BiDi
|
||
Comment 4•1 month ago
|
||
| bugherder | ||
https://hg.mozilla.org/mozilla-central/rev/6cc75d5fbb9d
https://hg.mozilla.org/mozilla-central/rev/6ffb61fedd3e
Status: NEW → RESOLVED
Closed: 1 month ago
status-firefox136:
--- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 136 Branch
You need to log in
before you can comment on or make changes to this bug.
Description
•