Closed Bug 1875786 Opened 1 year ago Closed 1 year ago

[wpt-sync] Sync PR 44117 - test: clean up cookies

Categories

(Remote Protocol :: WebDriver BiDi, task, P4)

task

Tracking

(firefox124 fixed)

RESOLVED FIXED
124 Branch
Tracking Status
firefox124 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

()

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 44117 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/44117
Details from upstream follow.

Maksim Sadym <sadym@google.com> wrote:

test: clean up cookies

Clean up set cookies after each test run to avoid collisions. Used the same pattern as in subscribe_events.

Component: web-platform-tests → WebDriver BiDi
Product: Testing → Remote Protocol
Status: NEW → RESOLVED
Closed: 1 year ago
Resolution: --- → INVALID
Whiteboard: [wptsync downstream] → [wptsync downstream error]
Status: RESOLVED → REOPENED
Resolution: INVALID → ---
Whiteboard: [wptsync downstream error] → [wptsync downstream]

CI Results

Ran 6 Firefox configurations based on mozilla-central, and Safari on GitHub CI

Total 377 tests and 18 subtests

Status Summary

Firefox

OK : 357[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] 376[Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt]
PASS : 5647[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] 5940[Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt]
FAIL : 333[Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] 335[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview]
ERROR : 1

Safari

OK : 375
PASS : 2447
FAIL : 755
TIMEOUT: 2
ERROR : 2611

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

  • /webdriver/tests/bidi/browsing_context/set_viewport/invalid.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
    • test_params_devicePixelRatio_invalid_type[False]: FAIL (Safari: ERROR)
    • test_params_devicePixelRatio_invalid_type[]: FAIL (Safari: ERROR)
    • test_params_devicePixelRatio_invalid_type[device_pixel_ratio2]: FAIL (Safari: ERROR)
    • test_params_devicePixelRatio_invalid_type[device_pixel_ratio3]: FAIL (Safari: ERROR)
    • test_params_devicePixelRatio_invalid_value[0]: FAIL (Safari: ERROR)
    • test_params_devicePixelRatio_invalid_value[-1]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/set_viewport/viewport.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/bidi/browsing_context/traverse_history/context.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/bidi/browsing_context/traverse_history/delta.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/element_send_keys/file_upload.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/fullscreen_window/fullscreen.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/fullscreen_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/fullscreen_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/get_current_url/file.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/maximize_window/maximize.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/maximize_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/maximize_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/minimize_window/minimize.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/minimize_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/minimize_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/navigate_to/file.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/new_session/no_capabilities.py [wpt.fyi]: SKIP (Safari: OK)
  • /webdriver/tests/classic/new_window/new_window.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/set_window_rect/set.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/set_window_rect/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/bidi/browsing_context/capture_screenshot/format.py [wpt.fyi]
    • test_format_type: FAIL (Safari: ERROR)
    • test_format_quality: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/capture_screenshot/invalid.py [wpt.fyi]
    • test_closed_frame: FAIL (Safari: ERROR)
    • test_params_format_invalid_value: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/close/close.py [wpt.fyi]
    • test_top_level_context[window]: FAIL [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/context_destroyed/context_destroyed.py [wpt.fyi]
    • test_delete_nested_iframes: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/fragment_navigated/fragment_navigated.py [wpt.fyi]
    • test_timestamp: FAIL (Safari: ERROR)
    • test_document_write: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/locate_nodes/invalid.py [wpt.fyi]
    • test_params_locator_value_invalid_value[innerText-]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/locate_nodes/locator.py [wpt.fyi]
    • test_find_by_locator[innerText-foobarBARbaz]: FAIL (Safari: ERROR)
    • test_find_by_inner_text[ignore_case_true_full_match_no_max_depth]: FAIL (Safari: ERROR)
    • test_find_by_inner_text[ignore_case_false_full_match_no_max_depth]: FAIL (Safari: ERROR)
    • test_find_by_inner_text[ignore_case_true_partial_match_no_max_depth]: FAIL (Safari: ERROR)
    • test_find_by_inner_text[ignore_case_false_partial_match_no_max_depth]: FAIL (Safari: ERROR)
    • test_find_by_inner_text[ignore_case_true_full_match_max_depth_zero]: FAIL (Safari: ERROR)
    • test_find_by_inner_text[ignore_case_false_full_match_max_depth_zero]: FAIL (Safari: ERROR)
    • test_find_by_inner_text[ignore_case_true_partial_match_max_depth_zero]: FAIL (Safari: ERROR)
    • test_find_by_inner_text[ignore_case_false_partial_match_max_depth_zero]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/locate_nodes/max_node_count.py [wpt.fyi]
    • test_find_by_locator_limit_return_count[inner_text_single]: FAIL (Safari: ERROR)
    • test_find_by_locator_limit_return_count[inner_text_multiple]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/locate_nodes/start_nodes.py [wpt.fyi]
    • test_locate_with_context_nodes[innerText-foo-expected4]: FAIL (Safari: ERROR)
    • test_locate_with_multiple_context_nodes[innerText-foo]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/navigation_started/navigation_started.py [wpt.fyi]
    • test_redirect_http_equiv: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/print/invalid.py [wpt.fyi]
    • test_params_page_invalid_value[page2]: FAIL (Safari: ERROR)
    • test_params_page_invalid_value[page3]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/print/margin.py [wpt.fyi]
    • test_margin_same_as_page_dimension[top]: FAIL (Safari: ERROR)
    • test_margin_same_as_page_dimension[left]: FAIL (Safari: ERROR)
    • test_margin_same_as_page_dimension[right]: FAIL (Safari: ERROR)
    • test_margin_same_as_page_dimension[bottom]: FAIL (Safari: ERROR)
    • test_margin_same_as_page_dimension[all]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/reload/invalid.py [wpt.fyi]
    • test_params_ignore_cache_invalid_type[]: FAIL (Safari: ERROR)
    • test_params_ignore_cache_invalid_type[42]: FAIL (Safari: ERROR)
    • test_params_ignore_cache_invalid_type[value2]: FAIL (Safari: ERROR)
    • test_params_ignore_cache_invalid_type[value3]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/set_viewport/device_pixel_ratio.py [wpt.fyi]
    • test_device_pixel_ratio_only[0.5]: FAIL (Safari: ERROR)
    • test_device_pixel_ratio_only[2]: FAIL (Safari: ERROR)
    • test_device_pixel_ratio_with_viewport[0.5]: FAIL (Safari: ERROR)
    • test_device_pixel_ratio_with_viewport[2]: FAIL (Safari: ERROR)
    • test_reset_device_pixel_ratio: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/browsing_context/user_prompt_opened/user_prompt_opened.py [wpt.fyi]
    • test_prompt_default_value[null]: FAIL (Safari: ERROR)
    • test_prompt_default_value[empty string]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/external/permissions/set_permission/invalid.py [wpt.fyi]
    • test_params_descriptor_invalid_type[False]: FAIL (Safari: ERROR)
    • test_params_descriptor_invalid_type[SOME_STRING]: FAIL (Safari: ERROR)
    • test_params_descriptor_invalid_type[42]: FAIL (Safari: ERROR)
    • test_params_descriptor_invalid_type[descriptor3]: FAIL (Safari: ERROR)
    • test_params_descriptor_invalid_type[descriptor4]: FAIL (Safari: ERROR)
    • test_params_descriptor_invalid_type[descriptor5]: FAIL (Safari: ERROR)
    • test_params_descriptor_invalid_type[None]: FAIL (Safari: ERROR)
    • test_params_descriptor_invalid_type[descriptor7]: FAIL (Safari: ERROR)
    • test_params_descriptor_invalid_value[descriptor0]: FAIL (Safari: ERROR)
    • test_params_state_invalid_type[False]: FAIL (Safari: ERROR)
    • test_params_state_invalid_type[42]: FAIL (Safari: ERROR)
    • test_params_state_invalid_type[state2]: FAIL (Safari: ERROR)
    • test_params_state_invalid_type[state3]: FAIL (Safari: ERROR)
    • test_params_state_invalid_type[None]: FAIL (Safari: ERROR)
    • test_params_state_invalid_type[state5]: FAIL (Safari: ERROR)
    • test_params_state_invalid_value[UNKOWN]: FAIL (Safari: ERROR)
    • test_params_state_invalid_value[Granted]: FAIL (Safari: ERROR)
    • test_params_origin_invalid_type[False]: FAIL (Safari: ERROR)
    • test_params_origin_invalid_type[42]: FAIL (Safari: ERROR)
    • test_params_origin_invalid_type[origin2]: FAIL (Safari: ERROR)
    • test_params_origin_invalid_type[origin3]: FAIL (Safari: ERROR)
    • test_params_origin_invalid_type[None]: FAIL (Safari: ERROR)
    • test_params_origin_invalid_type[origin5]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/external/permissions/set_permission/set_permission.py [wpt.fyi]
    • test_set_permission: FAIL (Safari: ERROR)
    • test_set_permission_insecure_context: FAIL (Safari: ERROR)
    • test_set_permission_new_context: FAIL (Safari: ERROR)
    • test_set_permission_origin_unknown[UNKNOWN]: FAIL (Safari: ERROR)
    • test_set_permission_origin_unknown[]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/input/perform_actions/invalid.py [wpt.fyi]
    • test_params_key_action_value_invalid_multiple_codepoints[fa]: FAIL
    • test_params_key_action_value_invalid_multiple_codepoints[\u0ba8\u0bbfb]: FAIL
    • test_params_key_action_value_invalid_multiple_codepoints[\u0ba8\u0bbf\u0ba8]: FAIL
    • test_params_key_action_value_invalid_multiple_codepoints[\u1100\u1161\u11a8c]: FAIL
  • /webdriver/tests/bidi/input/perform_actions/key_events.py [wpt.fyi]
    • test_non_printable_key_sends_events[\ue00c-ESCAPE]: FAIL (Safari: ERROR)
    • test_non_printable_key_sends_events[\ue014-RIGHT]: FAIL (Safari: ERROR)
    • test_key_printable_sequence[True]: FAIL (Safari: ERROR)
    • test_key_printable_sequence[False]: FAIL (Safari: ERROR)
    • test_key_space: FAIL (Safari: ERROR)
    • test_keyup_only_sends_no_events: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/input/perform_actions/pointer_mouse_drag.py [wpt.fyi]
    • test_drag_and_drop[10-15-0]: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Safari: ERROR)
    • test_drag_and_drop[10-15-300]: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Safari: ERROR)
    • test_drag_and_drop[10-15-800]: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Safari: ERROR)
    • test_drag_and_drop[10--15-0]: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Safari: ERROR)
    • test_drag_and_drop[10--15-300]: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Safari: ERROR)
    • test_drag_and_drop[10--15-800]: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Safari: ERROR)
    • test_drag_and_drop_with_draggable_element[0]: FAIL (Safari: ERROR)
    • test_drag_and_drop_with_draggable_element[300]: FAIL (Safari: ERROR)
    • test_drag_and_drop_with_draggable_element[800]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/input/perform_actions/pointer_pen.py [wpt.fyi]
    • test_pen_pointer_in_shadow_tree[outer-open]: FAIL (Safari: ERROR)
    • test_pen_pointer_in_shadow_tree[outer-closed]: FAIL (Safari: ERROR)
    • test_pen_pointer_in_shadow_tree[inner-open]: FAIL (Safari: ERROR)
    • test_pen_pointer_in_shadow_tree[inner-closed]: FAIL (Safari: ERROR)
    • test_pen_pointer_properties: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/input/perform_actions/pointer_touch.py [wpt.fyi]
    • test_touch_pointer_properties_angle_twist: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/log/entry_added/console.py [wpt.fyi]
    • test_method_timeEnd: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/log/entry_added/event_buffer.py [wpt.fyi]
    • test_console_log_cached_message_after_refresh[console_api_log]: FAIL (Safari: ERROR)
    • test_console_log_cached_message_after_refresh[javascript_error]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/log/entry_added/realm.py [wpt.fyi]
    • test_realm[sandbox]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/log/entry_added/stacktrace.py [wpt.fyi]
    • test_console_entry_sync_callstack[warn-True]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/log/entry_added/subscription.py [wpt.fyi]
    • test_subscribe_unsubscribe[console_api_log]: FAIL (Safari: ERROR)
    • test_subscribe_unsubscribe[javascript_error]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/network/continue_request/invalid.py [wpt.fyi]
    • test_params_method_invalid_type[False]: FAIL (Safari: ERROR)
    • test_params_method_invalid_type[42]: FAIL (Safari: ERROR)
    • test_params_method_invalid_type[value2]: FAIL (Safari: ERROR)
    • test_params_method_invalid_type[value3]: FAIL (Safari: ERROR)
    • test_params_request_invalid_type[None]: FAIL (Safari: ERROR)
    • test_params_request_invalid_type[False]: FAIL (Safari: ERROR)
    • test_params_request_invalid_type[42]: FAIL (Safari: ERROR)
    • test_params_request_invalid_type[value3]: FAIL (Safari: ERROR)
    • test_params_request_invalid_type[value4]: FAIL (Safari: ERROR)
    • test_params_request_invalid_value[]: FAIL (Safari: ERROR)
    • test_params_request_invalid_value[foo]: FAIL (Safari: ERROR)
    • test_params_request_no_such_request: FAIL (Safari: ERROR)
    • test_params_url_invalid_type[False]: FAIL (Safari: ERROR)
    • test_params_url_invalid_type[42]: FAIL (Safari: ERROR)
    • test_params_url_invalid_type[value2]: FAIL (Safari: ERROR)
    • test_params_url_invalid_type[value3]: FAIL (Safari: ERROR)
    • test_params_url_invalid_value[:invalid-http]: FAIL (Safari: ERROR)
    • test_params_url_invalid_value[:invalid-https]: FAIL (Safari: ERROR)
    • test_params_url_invalid_value[#invalid-http]: FAIL (Safari: ERROR)
    • test_params_url_invalid_value[#invalid-https]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/network/continue_response/invalid.py [wpt.fyi]
    • test_params_request_invalid_phase: FAIL (Safari: ERROR)
    • test_params_request_invalid_type[None]: FAIL (Safari: ERROR)
    • test_params_request_invalid_type[False]: FAIL (Safari: ERROR)
    • test_params_request_invalid_type[42]: FAIL (Safari: ERROR)
    • test_params_request_invalid_type[value3]: FAIL (Safari: ERROR)
    • test_params_request_invalid_type[value4]: FAIL (Safari: ERROR)
    • test_params_request_invalid_value[]: FAIL (Safari: ERROR)
    • test_params_request_invalid_value[foo]: FAIL (Safari: ERROR)
    • test_params_request_no_such_request: FAIL (Safari: ERROR)
    • test_params_reason_phrase_invalid_type[False]: FAIL (Safari: ERROR)
    • test_params_reason_phrase_invalid_type[42]: FAIL (Safari: ERROR)
    • test_params_reason_phrase_invalid_type[value2]: FAIL (Safari: ERROR)
    • test_params_reason_phrase_invalid_type[value3]: FAIL (Safari: ERROR)
    • test_params_status_code_invalid_type[False]: FAIL (Safari: ERROR)
    • test_params_status_code_invalid_type[foo]: FAIL (Safari: ERROR)
    • test_params_status_code_invalid_type[value2]: FAIL (Safari: ERROR)
    • test_params_status_code_invalid_type[value3]: FAIL (Safari: ERROR)
    • test_params_status_code_invalid_value[-1]: FAIL (Safari: ERROR)
    • test_params_status_code_invalid_value[4.3]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/network/provide_response/invalid.py [wpt.fyi]
    • test_params_request_invalid_type[None]: FAIL (Safari: ERROR)
    • test_params_request_invalid_type[False]: FAIL (Safari: ERROR)
    • test_params_request_invalid_type[42]: FAIL (Safari: ERROR)
    • test_params_request_invalid_type[value3]: FAIL (Safari: ERROR)
    • test_params_request_invalid_type[value4]: FAIL (Safari: ERROR)
    • test_params_request_invalid_value[]: FAIL (Safari: ERROR)
    • test_params_request_invalid_value[foo]: FAIL (Safari: ERROR)
    • test_params_request_no_such_request: FAIL (Safari: ERROR)
    • test_params_reason_phrase_invalid_type[False]: FAIL (Safari: ERROR)
    • test_params_reason_phrase_invalid_type[42]: FAIL (Safari: ERROR)
    • test_params_reason_phrase_invalid_type[value2]: FAIL (Safari: ERROR)
    • test_params_reason_phrase_invalid_type[value3]: FAIL (Safari: ERROR)
    • test_params_status_code_invalid_type[False]: FAIL (Safari: ERROR)
    • test_params_status_code_invalid_type[foo]: FAIL (Safari: ERROR)
    • test_params_status_code_invalid_type[value2]: FAIL (Safari: ERROR)
    • test_params_status_code_invalid_type[value3]: FAIL (Safari: ERROR)
    • test_params_status_code_invalid_value[-1]: FAIL (Safari: ERROR)
    • test_params_status_code_invalid_value[4.3]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/exception_details.py [wpt.fyi]
    • test_exception_details[[1, 2]Symbol.iterator-expected28]: FAIL (Safari: ERROR)
    • test_exception_details['mystring'Symbol.iterator-expected29]: FAIL (Safari: ERROR)
    • test_exception_details[(new Set([1,2]))Symbol.iterator-expected30]: FAIL (Safari: ERROR)
    • test_exception_details[(new Map([[1,2]]))Symbol.iterator-expected31]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/exception_details_await_promise.py [wpt.fyi]
    • test_exception_details[[1, 2]Symbol.iterator-expected28]: FAIL (Safari: ERROR)
    • test_exception_details['mystring'Symbol.iterator-expected29]: FAIL (Safari: ERROR)
    • test_exception_details[(new Set([1,2]))Symbol.iterator-expected30]: FAIL (Safari: ERROR)
    • test_exception_details[(new Map([[1,2]]))Symbol.iterator-expected31]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/remote_values.py [wpt.fyi]
    • test_remote_values[[1, 2]Symbol.iterator-expected15-True]: FAIL (Safari: ERROR)
    • test_remote_values[[1, 2]Symbol.iterator-expected15-False]: FAIL (Safari: ERROR)
    • test_remote_values['mystring'Symbol.iterator-expected16-True]: FAIL (Safari: ERROR)
    • test_remote_values['mystring'Symbol.iterator-expected16-False]: FAIL (Safari: ERROR)
    • test_remote_values[(new Set([1,2]))Symbol.iterator-expected17-True]: FAIL (Safari: ERROR)
    • test_remote_values[(new Set([1,2]))Symbol.iterator-expected17-False]: FAIL (Safari: ERROR)
    • test_remote_values[(new Map([[1,2]]))Symbol.iterator-expected18-True]: FAIL (Safari: ERROR)
    • test_remote_values[(new Map([[1,2]]))Symbol.iterator-expected18-False]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/exception_details.py [wpt.fyi]
    • test_exception_details[[1, 2]Symbol.iterator-expected28]: FAIL (Safari: ERROR)
    • test_exception_details['mystring'Symbol.iterator-expected29]: FAIL (Safari: ERROR)
    • test_exception_details[(new Set([1,2]))Symbol.iterator-expected30]: FAIL (Safari: ERROR)
    • test_exception_details[(new Map([[1,2]]))Symbol.iterator-expected31]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/exception_details_await_promise.py [wpt.fyi]
    • test_exception_details_await_promise[[1, 2]Symbol.iterator-expected28]: FAIL (Safari: ERROR)
    • test_exception_details_await_promise['mystring'Symbol.iterator-expected29]: FAIL (Safari: ERROR)
    • test_exception_details_await_promise[(new Set([1,2]))Symbol.iterator-expected30]: FAIL (Safari: ERROR)
    • test_exception_details_await_promise[(new Map([[1,2]]))Symbol.iterator-expected31]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/evaluate/remote_values.py [wpt.fyi]
    • test_remote_values[[1, 2]Symbol.iterator-expected15]: FAIL (Safari: ERROR)
    • test_remote_values['mystring'Symbol.iterator-expected16]: FAIL (Safari: ERROR)
    • test_remote_values[(new Set([1,2]))Symbol.iterator-expected17]: FAIL (Safari: ERROR)
    • test_remote_values[(new Map([[1,2]]))Symbol.iterator-expected18]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/storage/set_cookie/cookie_domain.py [wpt.fyi]
    • test_cookie_domain[-]: FAIL (Safari: ERROR)
    • test_cookie_domain[-www]: FAIL (Safari: ERROR)
    • test_cookie_domain[alt-]: FAIL (Safari: ERROR)
    • test_cookie_domain[alt-www]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/storage/set_cookie/cookie_expiry.py [wpt.fyi]
    • test_cookie_expiry_unset: FAIL (Safari: ERROR)
    • test_cookie_expiry_future: FAIL (Safari: ERROR)
    • test_cookie_expiry_past: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/storage/set_cookie/cookie_http_only.py [wpt.fyi]
    • test_cookie_http_only[True]: FAIL (Safari: ERROR)
    • test_cookie_http_only[False]: FAIL (Safari: ERROR)
    • test_cookie_http_only[None]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/storage/set_cookie/cookie_name.py [wpt.fyi]
    • test_cookie_name[]: FAIL (Safari: ERROR)
    • test_cookie_name[cookie name with special symbols !@#$%&*()_+-{}[]|\:"'<>,.?/~]:FAIL(Safari:ERROR`)
    • test_cookie_name[123cookie]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/storage/set_cookie/cookie_path.py [wpt.fyi]
    • test_cookie_path[/]: FAIL (Safari: ERROR)
    • test_cookie_path[/some_path]: FAIL (Safari: ERROR)
    • test_cookie_path[/some/nested/path]: FAIL (Safari: ERROR)
    • test_cookie_path[None]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/storage/set_cookie/cookie_same_site.py [wpt.fyi]
    • test_cookie_secure[strict]: FAIL (Safari: ERROR)
    • test_cookie_secure[lax]: FAIL (Safari: ERROR)
    • test_cookie_secure[none]: FAIL (Safari: ERROR)
    • test_cookie_secure[None]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/storage/set_cookie/cookie_secure.py [wpt.fyi]
    • test_cookie_secure[True]: FAIL (Safari: ERROR)
    • test_cookie_secure[False]: FAIL (Safari: ERROR)
    • test_cookie_secure[None]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/storage/set_cookie/cookie_value.py [wpt.fyi]
    • test_cookie_value_string[simple_value]: FAIL (Safari: ERROR)
    • test_cookie_value_string[special_symbols =!@#$%^&*()_+-{}[]|\:"'<>,.?/~]:FAIL(Safari:ERROR`)
  • /webdriver/tests/bidi/storage/set_cookie/invalid.py [wpt.fyi]
    • test_cookie_domain_invalid_type[None]: FAIL (Safari: ERROR)
    • test_cookie_domain_invalid_type[False]: FAIL (Safari: ERROR)
    • test_cookie_domain_invalid_type[42]: FAIL (Safari: ERROR)
    • test_cookie_domain_invalid_type[domain3]: FAIL (Safari: ERROR)
    • test_cookie_domain_invalid_type[domain4]: FAIL (Safari: ERROR)
    • test_cookie_expiry_invalid_type[False]: FAIL (Safari: ERROR)
    • test_cookie_expiry_invalid_type[SOME_STRING_VALUE]: FAIL (Safari: ERROR)
    • test_cookie_expiry_invalid_type[expiry2]: FAIL (Safari: ERROR)
    • test_cookie_expiry_invalid_type[expiry3]: FAIL (Safari: ERROR)
    • test_cookie_http_only_invalid_type[42]: FAIL (Safari: ERROR)
    • test_cookie_http_only_invalid_type[SOME_STRING_VALUE]: FAIL (Safari: ERROR)
    • test_cookie_http_only_invalid_type[http_only2]: FAIL (Safari: ERROR)
    • test_cookie_http_only_invalid_type[http_only3]: FAIL (Safari: ERROR)
    • test_cookie_name_invalid_value[ cookieName]: FAIL (Safari: ERROR)
    • test_cookie_name_invalid_value[cookie=name]: FAIL (Safari: ERROR)
    • test_cookie_name_invalid_value[cookie\tname]: FAIL (Safari: ERROR)
    • test_cookie_name_invalid_value[cookie\nname]: FAIL (Safari: ERROR)
    • test_cookie_name_invalid_value[cookie\x01name]: FAIL (Safari: ERROR)
    • test_cookie_name_invalid_value[cookie\x0fname]: FAIL (Safari: ERROR)
    • test_cookie_name_invalid_value[cookie;name]: FAIL (Safari: ERROR)
    • test_cookie_name_invalid_type[None]: FAIL (Safari: ERROR)
    • test_cookie_name_invalid_type[False]: FAIL (Safari: ERROR)
    • test_cookie_name_invalid_type[42]: FAIL (Safari: ERROR)
    • test_cookie_name_invalid_type[name3]: FAIL (Safari: ERROR)
    • test_cookie_name_invalid_type[name4]: FAIL (Safari: ERROR)
    • test_cookie_path_invalid_value[no_leading_forward_slash]: FAIL (Safari: ERROR)
    • test_cookie_path_invalid_type[False]: FAIL (Safari: ERROR)
    • test_cookie_path_invalid_type[42]: FAIL (Safari: ERROR)
    • test_cookie_path_invalid_type[path2]: FAIL (Safari: ERROR)
    • test_cookie_path_invalid_type[path3]: FAIL (Safari: ERROR)
    • test_cookie_same_site_invalid_value[]: FAIL (Safari: ERROR)
    • test_cookie_same_site_invalid_value[INVALID_SAME_SITE_STATE]: FAIL (Safari: ERROR)
    • test_cookie_same_site_invalid_type[42]: FAIL (Safari: ERROR)
    • test_cookie_same_site_invalid_type[False]: FAIL (Safari: ERROR)
    • test_cookie_same_site_invalid_type[same_site2]: FAIL (Safari: ERROR)
    • test_cookie_same_site_invalid_type[same_site3]: FAIL (Safari: ERROR)
    • test_cookie_secure_invalid_type[42]: FAIL (Safari: ERROR)
    • test_cookie_secure_invalid_type[SOME_STRING_VALUE]: FAIL (Safari: ERROR)
    • test_cookie_secure_invalid_type[secure2]: FAIL (Safari: ERROR)
    • test_cookie_secure_invalid_type[secure3]: FAIL (Safari: ERROR)
    • test_cookie_value_invalid_type[None]: FAIL (Safari: ERROR)
    • test_cookie_value_invalid_type[False]: FAIL (Safari: ERROR)
    • test_cookie_value_invalid_type[42]: FAIL (Safari: ERROR)
    • test_cookie_value_invalid_type[SOME_STRING_VALUE]: FAIL (Safari: ERROR)
    • test_cookie_value_invalid_type[value4]: FAIL (Safari: ERROR)
    • test_cookie_value_invalid_type[value5]: FAIL (Safari: ERROR)
    • test_cookie_value_invalid_type[value6]: FAIL (Safari: ERROR)
    • test_cookie_value_string_invalid_value[value\twith\ttab]: FAIL (Safari: ERROR)
    • test_cookie_value_string_invalid_value[value\nwith\nnewline]: FAIL (Safari: ERROR)
    • test_cookie_value_string_invalid_value[value;with;semicolon]: FAIL (Safari: ERROR)
    • test_cookie_value_string_invalid_type[None]: FAIL (Safari: ERROR)
    • test_cookie_value_string_invalid_type[False]: FAIL (Safari: ERROR)
    • test_cookie_value_string_invalid_type[42]: FAIL (Safari: ERROR)
    • test_cookie_value_string_invalid_type[str_value3]: FAIL (Safari: ERROR)
    • test_cookie_value_string_invalid_type[str_value4]: FAIL (Safari: ERROR)
    • test_partition_invalid_type[42]: FAIL (Safari: ERROR)
    • test_partition_invalid_type[False]: FAIL (Safari: ERROR)
    • test_partition_invalid_type[SOME_STRING_VALUE]: FAIL (Safari: ERROR)
    • test_partition_invalid_type[partition3]: FAIL (Safari: ERROR)
    • test_partition_invalid_type[partition4]: FAIL (Safari: ERROR)
    • test_partition_invalid_type[partition5]: FAIL (Safari: ERROR)
    • test_partition_context_invalid_type[None]: FAIL (Safari: ERROR)
    • test_partition_context_invalid_type[42]: FAIL (Safari: ERROR)
    • test_partition_context_invalid_type[False]: FAIL (Safari: ERROR)
    • test_partition_context_invalid_type[browsing_context3]: FAIL (Safari: ERROR)
    • test_partition_context_invalid_type[browsing_context4]: FAIL (Safari: ERROR)
    • test_partition_context_unknown: FAIL (Safari: ERROR)
    • test_partition_storage_key_source_origin_invalid_type[42]: FAIL (Safari: ERROR)
    • test_partition_storage_key_source_origin_invalid_type[False]: FAIL (Safari: ERROR)
    • test_partition_storage_key_source_origin_invalid_type[source_origin2]: FAIL (Safari: ERROR)
    • test_partition_storage_key_source_origin_invalid_type[source_origin3]: FAIL (Safari: ERROR)
    • test_partition_storage_key_user_context_invalid_type[42]: FAIL (Safari: ERROR)
    • test_partition_storage_key_user_context_invalid_type[False]: FAIL (Safari: ERROR)
    • test_partition_storage_key_user_context_invalid_type[user_context2]: FAIL (Safari: ERROR)
    • test_partition_storage_key_user_context_invalid_type[user_context3]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/storage/set_cookie/page_protocols.py [wpt.fyi]
    • test_page_protocols[http]: FAIL (Safari: ERROR)
    • test_page_protocols[https]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/storage/set_cookie/partition.py [wpt.fyi]
    • test_partition_context: FAIL (Safari: ERROR)
    • test_partition_context_frame: FAIL (Safari: ERROR)
    • test_partition_storage_key_source_origin: FAIL (Safari: ERROR)
  • /webdriver/tests/classic/element_clear/clear.py [wpt.fyi]
    • test_input_file: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Safari: PASS)
    • test_input_file_multiple: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Safari: FAIL)
  • /webdriver/tests/classic/element_click/interactability.py [wpt.fyi]
    • test_element_not_visible_overflow_hidden: FAIL (Safari: FAIL)
  • /webdriver/tests/classic/execute_async_script/collections.py [wpt.fyi]
    • test_file_list: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] (Safari: PASS)
  • /webdriver/tests/classic/execute_async_script/objects.py [wpt.fyi]
    • test_object_to_json: FAIL (Safari: PASS)
    • test_object_to_json_exception: FAIL (Safari: PASS)
  • /webdriver/tests/classic/execute_async_script/promise.py [wpt.fyi]
    • test_await_promise_resolve: FAIL (Safari: PASS)
  • /webdriver/tests/classic/execute_script/promise.py [wpt.fyi]
    • test_await_promise_resolve: FAIL (Safari: PASS)
  • /webdriver/tests/classic/find_element_from_element/find.py [wpt.fyi]
    • test_parent_of_document_node_errors: FAIL (Safari: FAIL)
  • /webdriver/tests/classic/find_element_from_shadow_root/find.py [wpt.fyi]
    • test_find_element[open-tag name-a]: FAIL (Safari: FAIL)
    • test_find_element[open-xpath-//a]: FAIL (Safari: FAIL)
    • test_find_element[closed-tag name-a]: FAIL (Safari: FAIL)
    • test_find_element[closed-xpath-//a]: FAIL (Safari: FAIL)
  • /webdriver/tests/classic/find_elements_from_element/find.py [wpt.fyi]
    • test_parent_of_document_node_errors: FAIL (Safari: FAIL)
  • /webdriver/tests/classic/find_elements_from_shadow_root/find.py [wpt.fyi]
    • test_find_elements[open-tag name-a]: FAIL (Safari: FAIL)
    • test_find_elements[open-xpath-//a]: FAIL (Safari: FAIL)
    • test_find_elements[closed-tag name-a]: FAIL (Safari: FAIL)
    • test_find_elements[closed-xpath-//a]: FAIL (Safari: FAIL)
  • /webdriver/tests/classic/get_element_text/get.py [wpt.fyi]
    • test_shadow_root_slot[default visible]: FAIL (Safari: FAIL)
    • test_shadow_root_slot[default outside]: FAIL (Safari: FAIL)
    • test_shadow_root_slot[default hidden]: FAIL (Safari: FAIL)
  • /webdriver/tests/classic/new_session/default_values.py [wpt.fyi]
    • test_desired: FAIL (Safari: FAIL)
  • /webdriver/tests/classic/perform_actions/pointer_mouse.py [wpt.fyi]
    • test_drag_and_drop_with_draggable_element[0]: FAIL (Safari: FAIL)
    • test_drag_and_drop_with_draggable_element[300]: FAIL (Safari: FAIL)
    • test_drag_and_drop_with_draggable_element[800]: FAIL (Safari: FAIL)
  • /webdriver/tests/classic/perform_actions/pointer_pen.py [wpt.fyi]
    • test_null_response_value: ERROR (Safari: PASS)
    • test_pen_pointer_in_shadow_tree[outer-open]: FAIL (Safari: FAIL)
    • test_pen_pointer_in_shadow_tree[outer-closed]: FAIL (Safari: FAIL)
    • test_pen_pointer_in_shadow_tree[inner-open]: FAIL (Safari: FAIL)
    • test_pen_pointer_in_shadow_tree[inner-closed]: FAIL (Safari: FAIL)
    • test_pen_pointer_properties: FAIL (Safari: FAIL)
  • /webdriver/tests/classic/perform_actions/pointer_touch.py [wpt.fyi]
    • test_touch_pointer_properties_angle_twist: FAIL (Safari: FAIL)
  • /webdriver/tests/classic/permissions/set.py [wpt.fyi]
    • test_invalid_parameters[parameters0]: FAIL (Safari: FAIL)
    • test_invalid_parameters[parameters1]: FAIL (Safari: FAIL)
    • test_invalid_parameters[parameters2]: FAIL (Safari: FAIL)
    • test_invalid_parameters[parameters3]: FAIL (Safari: FAIL)
    • test_invalid_parameters[parameters4]: FAIL (Safari: FAIL)
    • test_invalid_parameters[parameters5]: FAIL (Safari: FAIL)
    • test_invalid_parameters[parameters6]: FAIL (Safari: FAIL)
    • test_non_secure_context[granted]: FAIL (Safari: FAIL)
    • test_non_secure_context[denied]: FAIL (Safari: FAIL)
    • test_non_secure_context[prompt]: FAIL (Safari: FAIL)
    • test_set_to_state[granted]: FAIL (Safari: FAIL)
    • test_set_to_state[denied]: FAIL (Safari: FAIL)
    • test_set_to_state[prompt]: FAIL (Safari: FAIL)

Tests Disabled in Gecko Infrastructure

  • /webdriver/tests/bidi/browsing_context/set_viewport/invalid.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/bidi/browsing_context/set_viewport/viewport.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/bidi/browsing_context/traverse_history/context.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/bidi/browsing_context/traverse_history/delta.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/element_send_keys/file_upload.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/fullscreen_window/fullscreen.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/fullscreen_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/fullscreen_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/get_current_url/file.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/maximize_window/maximize.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/maximize_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/maximize_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/minimize_window/minimize.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/minimize_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/minimize_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/navigate_to/file.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/new_session/no_capabilities.py [wpt.fyi]: SKIP (Safari: OK)
  • /webdriver/tests/classic/new_window/new_window.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/set_window_rect/set.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/set_window_rect/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/5172eb0a82e1 [wpt PR 44117] - test: clean up cookies, a=testonly
Status: REOPENED → RESOLVED
Closed: 1 year ago1 year ago
Resolution: --- → FIXED
Target Milestone: --- → 124 Branch
You need to log in before you can comment on or make changes to this bug.