Closed Bug 1884253 Opened 2 years ago Closed 2 years ago

[wpt-sync] Sync PR 44986 - [WebDriverBiDi] Update test for Subscribe/Unsubscribe

Categories

(Remote Protocol :: WebDriver BiDi, task, P4)

Product:
Remote Protocol
Component:
WebDriver BiDi
Type:
task

Tracking

(firefox125 fixed)

Status:
RESOLVED FIXED
Milestone:
125 Branch
Tracking Flags:
Tracking Status
firefox125 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 44986 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/44986
Details from upstream follow.

Nikolay Vitkov <nvitkov@chromium.org> wrote:

[WebDriverBiDi] Update test for Subscribe/Unsubscribe

Component: web-platform-tests → WebDriver BiDi
Product: Testing → Remote Protocol
Whiteboard: [wptsync downstream] → [wptsync downstream error]
Whiteboard: [wptsync downstream error] → [wptsync downstream]

CI Results

Ran 3 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 397 tests and 18 subtests

Status Summary

Firefox

OK : 376[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] 396[Gecko-linux1804-64-qr-opt, GitHub]
PASS : 6409[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] 6719[GitHub] 6733[Gecko-linux1804-64-qr-opt]
FAIL : 212[Gecko-linux1804-64-qr-opt] 215[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, GitHub]
ERROR : 1[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-opt] 2[GitHub]

Chrome

OK : 387
PASS : 5897
FAIL : 702
TIMEOUT: 10
ERROR : 2

Safari

OK : 395
PASS : 2294
FAIL : 535
TIMEOUT: 2
ERROR : 3284

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

New Tests That Don't Pass

  • /webdriver/tests/bidi/browsing_context/create/user_context.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/bidi/browsing_context/set_viewport/invalid.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
    • test_params_devicePixelRatio_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_devicePixelRatio_invalid_type[]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_devicePixelRatio_invalid_type[device_pixel_ratio2]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_devicePixelRatio_invalid_type[device_pixel_ratio3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_devicePixelRatio_invalid_value[0]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_devicePixelRatio_invalid_value[-1]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/set_viewport/viewport.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/bidi/browsing_context/traverse_history/context.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/bidi/browsing_context/traverse_history/delta.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/bidi/browsing_context/traverse_history/invalid.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/classic/element_send_keys/file_upload.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/classic/fullscreen_window/fullscreen.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
    • test_fullscreen_from_maximized_window: FAIL [GitHub], PASS [Gecko-linux1804-64-qr-opt] (Chrome: PASS, Safari: PASS)
  • /webdriver/tests/classic/fullscreen_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/classic/fullscreen_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/classic/get_current_url/file.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/classic/maximize_window/maximize.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
    • test_response_payload: FAIL [GitHub], PASS [Gecko-linux1804-64-qr-opt] (Chrome: PASS, Safari: PASS)
    • test_fully_exit_fullscreen: FAIL [GitHub], PASS [Gecko-linux1804-64-qr-opt] (Chrome: PASS, Safari: PASS)
    • test_restore_from_minimized: FAIL [GitHub], PASS [Gecko-linux1804-64-qr-opt] (Chrome: PASS, Safari: PASS)
    • test_maximize_from_normal_window: FAIL [GitHub], PASS [Gecko-linux1804-64-qr-opt] (Chrome: PASS, Safari: PASS)
    • test_maximize_with_window_already_at_maximum_size: FAIL [GitHub], PASS [Gecko-linux1804-64-qr-opt] (Chrome: PASS, Safari: PASS)
    • test_maximize_twice_is_idempotent: FAIL [GitHub], PASS [Gecko-linux1804-64-qr-opt] (Chrome: PASS, Safari: PASS)
  • /webdriver/tests/classic/maximize_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/classic/maximize_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/classic/minimize_window/minimize.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
    • test_restore_from_maximized: FAIL [GitHub], PASS [Gecko-linux1804-64-qr-opt] (Chrome: PASS, Safari: FAIL)
  • /webdriver/tests/classic/minimize_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/classic/minimize_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/classic/navigate_to/file.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/classic/new_session/no_capabilities.py [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-opt] (Chrome: OK, Safari: OK)
    • test_no_capabilites: FAIL (Chrome: PASS, Safari: FAIL)
  • /webdriver/tests/classic/set_window_rect/set.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
    • test_restore_from_maximized: FAIL [GitHub], PASS [Gecko-linux1804-64-qr-opt] (Chrome: PASS, Safari: PASS)
  • /webdriver/tests/classic/set_window_rect/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Chrome: OK, Safari: OK)
  • /webdriver/tests/bidi/browsing_context/capture_screenshot/format.py [wpt.fyi]
    • test_format_type: FAIL (Chrome: PASS, Safari: ERROR)
    • test_format_quality: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/capture_screenshot/invalid.py [wpt.fyi]
    • test_closed_frame: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_format_invalid_value: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/context_created/context_created.py [wpt.fyi]
    • test_existing_context[tab]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_existing_context[window]: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/context_destroyed/context_destroyed.py [wpt.fyi]
    • test_delete_nested_iframes: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/fragment_navigated/fragment_navigated.py [wpt.fyi]
    • test_document_write: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/locate_nodes/invalid.py [wpt.fyi]
    • test_params_locator_value_invalid_value[innerText-]: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/locate_nodes/locator.py [wpt.fyi]
    • test_find_by_locator[innerText-foobarBARbaz]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_find_by_inner_text[ignore_case_true_full_match_no_max_depth]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_find_by_inner_text[ignore_case_false_full_match_no_max_depth]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_find_by_inner_text[ignore_case_true_partial_match_no_max_depth]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_find_by_inner_text[ignore_case_false_partial_match_no_max_depth]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_find_by_inner_text[ignore_case_true_full_match_max_depth_zero]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_find_by_inner_text[ignore_case_false_full_match_max_depth_zero]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_find_by_inner_text[ignore_case_true_partial_match_max_depth_zero]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_find_by_inner_text[ignore_case_false_partial_match_max_depth_zero]: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/locate_nodes/max_node_count.py [wpt.fyi]
    • test_find_by_locator_limit_return_count[inner_text_single]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_find_by_locator_limit_return_count[inner_text_multiple]: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/locate_nodes/start_nodes.py [wpt.fyi]
    • test_locate_with_context_nodes[innerText-foo-expected4]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_locate_with_multiple_context_nodes[innerText-foo]: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/navigation_started/navigation_started.py [wpt.fyi]
    • test_redirect_http_equiv: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/print/invalid.py [wpt.fyi]
    • test_params_page_invalid_value[page2]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_page_invalid_value[page3]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/print/margin.py [wpt.fyi]
    • test_margin_same_as_page_dimension[top]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_margin_same_as_page_dimension[left]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_margin_same_as_page_dimension[right]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_margin_same_as_page_dimension[bottom]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_margin_same_as_page_dimension[all]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/reload/invalid.py [wpt.fyi]
    • test_params_ignore_cache_invalid_type[]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_ignore_cache_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_ignore_cache_invalid_type[value2]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_ignore_cache_invalid_type[value3]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/set_viewport/device_pixel_ratio.py [wpt.fyi]
    • test_device_pixel_ratio_only[0.5]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_device_pixel_ratio_only[2]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_device_pixel_ratio_with_viewport[0.5]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_device_pixel_ratio_with_viewport[2]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_reset_device_pixel_ratio: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/user_prompt_opened/user_prompt_opened.py [wpt.fyi]
    • test_prompt_default_value[null]: FAIL (Safari: ERROR)
    • test_prompt_default_value[empty string]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/external/permissions/set_permission/invalid.py [wpt.fyi]
    • test_params_descriptor_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_descriptor_invalid_type[SOME_STRING]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_descriptor_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_descriptor_invalid_type[descriptor3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_descriptor_invalid_type[descriptor4]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_descriptor_invalid_type[descriptor5]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_descriptor_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_descriptor_invalid_type[descriptor7]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_descriptor_invalid_value[descriptor0]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_state_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_state_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_state_invalid_type[state2]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_state_invalid_type[state3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_state_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_state_invalid_type[state5]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_state_invalid_value[UNKNOWN]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_state_invalid_value[Granted]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_origin_invalid_type[False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_origin_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_origin_invalid_type[origin2]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_origin_invalid_type[origin3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_origin_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_origin_invalid_type[origin5]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/external/permissions/set_permission/set_permission.py [wpt.fyi]
    • test_set_permission: FAIL (Chrome: PASS, Safari: ERROR)
    • test_set_permission_insecure_context: FAIL (Chrome: PASS, Safari: ERROR)
    • test_set_permission_new_context: FAIL (Chrome: PASS, Safari: ERROR)
    • test_set_permission_origin_unknown[UNKNOWN]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_set_permission_origin_unknown[]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/input/perform_actions/invalid.py [wpt.fyi]
    • test_params_key_action_value_invalid_multiple_codepoints[fa]: FAIL (Chrome: PASS)
    • test_params_key_action_value_invalid_multiple_codepoints[\u0ba8\u0bbfb]: FAIL (Chrome: PASS)
    • test_params_key_action_value_invalid_multiple_codepoints[\u0ba8\u0bbf\u0ba8]: FAIL (Chrome: PASS)
    • test_params_key_action_value_invalid_multiple_codepoints[\u1100\u1161\u11a8c]: FAIL (Chrome: PASS)
  • /webdriver/tests/bidi/input/perform_actions/key_events.py [wpt.fyi]
    • test_non_printable_key_sends_events[\ue00c-ESCAPE]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_non_printable_key_sends_events[\ue014-RIGHT]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_key_printable_sequence[True]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_key_printable_sequence[False]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_key_space: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_keyup_only_sends_no_events: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/input/perform_actions/pointer_mouse_drag.py [wpt.fyi]
    • test_drag_and_drop[10-15-0]: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-opt, GitHub] (Chrome: PASS, Safari: ERROR)
    • test_drag_and_drop[10-15-300]: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-opt, GitHub] (Chrome: PASS, Safari: ERROR)
    • test_drag_and_drop[10-15-800]: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-opt, GitHub] (Chrome: PASS, Safari: ERROR)
    • test_drag_and_drop[10--15-0]: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-opt, GitHub] (Chrome: PASS, Safari: ERROR)
    • test_drag_and_drop[10--15-300]: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-opt, GitHub] (Chrome: PASS, Safari: ERROR)
    • test_drag_and_drop[10--15-800]: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-opt, GitHub] (Chrome: PASS, Safari: ERROR)
    • test_drag_and_drop_with_draggable_element[0]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_drag_and_drop_with_draggable_element[300]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_drag_and_drop_with_draggable_element[800]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/input/perform_actions/pointer_pen.py [wpt.fyi]
    • test_pen_pointer_in_shadow_tree[outer-open]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_pen_pointer_in_shadow_tree[outer-closed]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_pen_pointer_in_shadow_tree[inner-open]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_pen_pointer_in_shadow_tree[inner-closed]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_pen_pointer_properties: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/input/perform_actions/pointer_touch.py [wpt.fyi]
    • test_touch_pointer_properties_angle_twist: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/input/set_files/invalid.py [wpt.fyi]
    • test_params_context_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_context_invalid_type[True]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_context_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_context_invalid_type[value3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_context_invalid_type[value4]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_context_invalid_value: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_element_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_element_invalid_type[True]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_element_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_element_invalid_type[value3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_files_invalid_type[None]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_files_invalid_type[True]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_files_invalid_type[42]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_files_invalid_type[value3]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_element_invalid_value[files0]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_element_invalid_value[files1]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_element_disabled[files0]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_element_disabled[files1]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_element_non_file_input[files0]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_element_non_file_input[files1]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_element_not_multiple: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/input/set_files/set_files.py [wpt.fyi]
    • test_set_files: FAIL (Safari: ERROR)
    • test_set_files_empty: FAIL (Safari: ERROR)
    • test_set_files_multiple: FAIL (Safari: ERROR)
    • test_set_files_something_then_empty: FAIL (Safari: ERROR)
    • test_set_files_twice: FAIL (Safari: ERROR)
    • test_set_files_twice_same: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/integration/navigation.py [wpt.fyi]
    • test_navigate_history_replacestate_beforeunload: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/log/entry_added/console.py [wpt.fyi]
    • test_method_timeEnd: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/log/entry_added/event_buffer.py [wpt.fyi]
    • test_console_log_cached_message_after_refresh[console_api_log]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_console_log_cached_message_after_refresh[javascript_error]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/log/entry_added/realm.py [wpt.fyi]
    • test_realm[sandbox]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/log/entry_added/stacktrace.py [wpt.fyi]
    • test_console_entry_sync_callstack[warn-True]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/log/entry_added/subscription.py [wpt.fyi]
    • test_subscribe_unsubscribe[console_api_log]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_subscribe_unsubscribe[javascript_error]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/network/add_intercept/contexts.py [wpt.fyi]
    • test_other_context_with_event_subscription: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_two_contexts_global_intercept: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/network/add_intercept/invalid.py [wpt.fyi]
    • test_params_contexts_invalid_type[False]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-opt] (Safari: ERROR)
    • test_params_contexts_invalid_type[42]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-opt] (Safari: ERROR)
    • test_params_contexts_invalid_type[value2]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-opt] (Safari: ERROR)
    • test_params_contexts_invalid_type[]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-opt] (Safari: ERROR)
    • test_params_contexts_invalid_value[value0]: FAIL
    • test_params_contexts_invalid_value[value1]: FAIL
    • test_params_contexts_context_non_top_level: FAIL (Safari: ERROR)
    • test_params_contexts_empty_list: FAIL (Safari: ERROR)
    • test_params_contexts_context_invalid_value: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/network/before_request_sent/before_request_sent_cached.py [wpt.fyi]
    • test_page_with_cached_resource: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/network/continue_request/invalid.py [wpt.fyi]
    • test_params_url_invalid_value[:invalid-http]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_url_invalid_value[:invalid-https]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_url_invalid_value[#invalid-http]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_url_invalid_value[#invalid-https]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/network/response_completed/response_completed_cached.py [wpt.fyi]
    • test_page_with_cached_resource: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/network/response_started/response_started_cached.py [wpt.fyi]
    • test_page_with_cached_resource: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/exception_details.py [wpt.fyi]
    • test_exception_details[[1, 2]Symbol.iterator-expected28]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_exception_details['mystring'Symbol.iterator-expected29]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_exception_details[(new Set([1,2]))Symbol.iterator-expected30]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_exception_details[(new Map([[1,2]]))Symbol.iterator-expected31]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/exception_details_await_promise.py [wpt.fyi]
    • test_exception_details[[1, 2]Symbol.iterator-expected28]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_exception_details['mystring'Symbol.iterator-expected29]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_exception_details[(new Set([1,2]))Symbol.iterator-expected30]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_exception_details[(new Map([[1,2]]))Symbol.iterator-expected31]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/remote_values.py [wpt.fyi]
    • test_remote_values[[1, 2]Symbol.iterator-expected15-True]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_remote_values[[1, 2]Symbol.iterator-expected15-False]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_remote_values['mystring'Symbol.iterator-expected16-True]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_remote_values['mystring'Symbol.iterator-expected16-False]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_remote_values[(new Set([1,2]))Symbol.iterator-expected17-True]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_remote_values[(new Set([1,2]))Symbol.iterator-expected17-False]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_remote_values[(new Map([[1,2]]))Symbol.iterator-expected18-True]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_remote_values[(new Map([[1,2]]))Symbol.iterator-expected18-False]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/exception_details.py [wpt.fyi]
    • test_exception_details[[1, 2]Symbol.iterator-expected28]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_exception_details['mystring'Symbol.iterator-expected29]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_exception_details[(new Set([1,2]))Symbol.iterator-expected30]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_exception_details[(new Map([[1,2]]))Symbol.iterator-expected31]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/exception_details_await_promise.py [wpt.fyi]
    • test_exception_details_await_promise[[1, 2]Symbol.iterator-expected28]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_exception_details_await_promise['mystring'Symbol.iterator-expected29]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_exception_details_await_promise[(new Set([1,2]))Symbol.iterator-expected30]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_exception_details_await_promise[(new Map([[1,2]]))Symbol.iterator-expected31]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/remote_values.py [wpt.fyi]
    • test_remote_values[[1, 2]Symbol.iterator-expected15]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_remote_values['mystring'Symbol.iterator-expected16]: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_remote_values[(new Set([1,2]))Symbol.iterator-expected17]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_remote_values[(new Map([[1,2]]))Symbol.iterator-expected18]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/script/realm_created/realm_created.py [wpt.fyi]
    • test_dedicated_worker: FAIL (Chrome: PASS, Safari: ERROR)
    • test_shared_worker: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_service_worker: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/script/realm_destroyed/realm_destroyed.py [wpt.fyi]
    • test_dedicated_worker: FAIL (Chrome: PASS, Safari: ERROR)
    • test_shared_worker: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/storage/delete_cookies/partition.py [wpt.fyi]
    • test_partition_context_iframe[cross_origin]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-opt] (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/classic/element_clear/clear.py [wpt.fyi]
    • test_input_file: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-opt, GitHub] (Chrome: PASS, Safari: PASS)
    • test_input_file_multiple: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-opt, GitHub] (Chrome: PASS, Safari: FAIL)
  • /webdriver/tests/classic/element_click/interactability.py [wpt.fyi]
    • test_element_not_visible_overflow_hidden: FAIL (Chrome: PASS, Safari: FAIL)
  • /webdriver/tests/classic/execute_async_script/collections.py [wpt.fyi]
    • test_file_list: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-opt, GitHub] (Chrome: PASS, Safari: PASS)
  • /webdriver/tests/classic/execute_async_script/objects.py [wpt.fyi]
    • test_object_to_json: FAIL (Chrome: PASS, Safari: PASS)
    • test_object_to_json_exception: FAIL (Chrome: PASS, Safari: PASS)
  • /webdriver/tests/classic/execute_async_script/promise.py [wpt.fyi]
    • test_await_promise_resolve: FAIL (Chrome: PASS, Safari: PASS)
  • /webdriver/tests/classic/execute_script/promise.py [wpt.fyi]
    • test_await_promise_resolve: FAIL (Chrome: PASS, Safari: PASS)
  • /webdriver/tests/classic/find_element_from_element/find.py [wpt.fyi]
    • test_parent_of_document_node_errors: FAIL (Chrome: FAIL, Safari: FAIL)
  • /webdriver/tests/classic/find_element_from_shadow_root/find.py [wpt.fyi]
    • test_find_element[open-tag name-a]: FAIL (Chrome: FAIL, Safari: FAIL)
    • test_find_element[open-xpath-//a]: FAIL (Chrome: FAIL, Safari: FAIL)
    • test_find_element[closed-tag name-a]: FAIL (Chrome: FAIL, Safari: FAIL)
    • test_find_element[closed-xpath-//a]: FAIL (Chrome: FAIL, Safari: FAIL)
  • /webdriver/tests/classic/find_elements_from_element/find.py [wpt.fyi]
    • test_parent_of_document_node_errors: FAIL (Chrome: FAIL, Safari: FAIL)
  • /webdriver/tests/classic/find_elements_from_shadow_root/find.py [wpt.fyi]
    • test_find_elements[open-tag name-a]: FAIL (Chrome: FAIL, Safari: FAIL)
    • test_find_elements[open-xpath-//a]: FAIL (Chrome: FAIL, Safari: FAIL)
    • test_find_elements[closed-tag name-a]: FAIL (Chrome: FAIL, Safari: FAIL)
    • test_find_elements[closed-xpath-//a]: FAIL (Chrome: FAIL, Safari: FAIL)
  • /webdriver/tests/classic/new_session/default_values.py [wpt.fyi]
    • test_desired: FAIL (Chrome: PASS, Safari: FAIL)
  • /webdriver/tests/classic/new_session/response.py [wpt.fyi]
    • test_capability_user_agent: FAIL (Chrome: FAIL, Safari: FAIL)
  • /webdriver/tests/classic/perform_actions/pointer_mouse.py [wpt.fyi]
    • test_drag_and_drop_with_draggable_element[0]: FAIL (Chrome: FAIL, Safari: FAIL)
    • test_drag_and_drop_with_draggable_element[300]: FAIL (Chrome: FAIL, Safari: FAIL)
    • test_drag_and_drop_with_draggable_element[800]: FAIL (Chrome: FAIL, Safari: FAIL)
  • /webdriver/tests/classic/perform_actions/pointer_pen.py [wpt.fyi]
    • test_null_response_value: ERROR (Chrome: PASS, Safari: PASS)
    • test_pen_pointer_in_shadow_tree[outer-open]: FAIL (Chrome: PASS, Safari: FAIL)
    • test_pen_pointer_in_shadow_tree[outer-closed]: FAIL (Chrome: FAIL, Safari: FAIL)
    • test_pen_pointer_in_shadow_tree[inner-open]: FAIL (Chrome: PASS, Safari: FAIL)
    • test_pen_pointer_in_shadow_tree[inner-closed]: FAIL (Chrome: FAIL, Safari: FAIL)
    • test_pen_pointer_properties: FAIL (Chrome: FAIL, Safari: FAIL)
  • /webdriver/tests/classic/perform_actions/pointer_touch.py [wpt.fyi]
    • test_touch_pointer_properties_angle_twist: FAIL (Chrome: FAIL, Safari: FAIL)
  • /webdriver/tests/classic/permissions/set.py [wpt.fyi]: ERROR [GitHub], OK [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-opt] (Chrome: OK, Safari: OK)
    • test_invalid_parameters[parameters0]: FAIL (Chrome: PASS, Safari: FAIL)
    • test_invalid_parameters[parameters1]: FAIL (Chrome: PASS, Safari: FAIL)
    • test_invalid_parameters[parameters2]: FAIL (Chrome: PASS, Safari: FAIL)
    • test_invalid_parameters[parameters3]: FAIL (Chrome: PASS, Safari: FAIL)
    • test_invalid_parameters[parameters4]: FAIL (Chrome: PASS, Safari: FAIL)
    • test_invalid_parameters[parameters5]: FAIL (Chrome: PASS, Safari: FAIL)
    • test_invalid_parameters[parameters6]: FAIL (Chrome: PASS, Safari: FAIL)
    • test_non_secure_context[granted]: FAIL (Chrome: PASS, Safari: FAIL)
    • test_non_secure_context[denied]: FAIL (Chrome: PASS, Safari: FAIL)
    • test_non_secure_context[prompt]: FAIL (Chrome: PASS, Safari: FAIL)
    • test_set_to_state[granted]: FAIL (Chrome: PASS, Safari: FAIL)
    • test_set_to_state[denied]: FAIL (Chrome: PASS, Safari: FAIL)
    • test_set_to_state[prompt]: FAIL (Chrome: PASS, Safari: FAIL)

Tests Disabled in Gecko Infrastructure

Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/d383e6148d7d [wpt PR 44986] - [WebDriverBiDi] refactor test to use `bidi_session.<module>.<command>` syntax, a=testonly

https://hg.mozilla.org/mozilla-central/rev/d383e6148d7d

Status: NEW → RESOLVED
Closed: 2 years ago
status-firefox125: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 125 Branch
You need to log in before you can comment on or make changes to this bug.