Closed Bug 1822836 Opened 1 year ago Closed 1 year ago

[wpt-sync] Sync PR 39034 - Set custom default timeouts for WebDriver classic session

Categories

(Remote Protocol :: Marionette, task, P4)

Product:
Remote Protocol
Component:
Marionette
Type:
task

Tracking

(firefox113 fixed)

Status:
RESOLVED FIXED
Milestone:
113 Branch
Tracking Flags:
Tracking Status
firefox113 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 39034 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/39034
Details from upstream follow.

Henrik Skupin <mail@hskupin.info> wrote:

Set custom default timeouts for WebDriver classic session

The default wdspec timeout for a complete file is set to 25s. Having a page_load timeout of 300s and a script timeout of 30s here doesn't make sense. As such I propose to use custom values for our wdspec tests which load pages from a local server anyway and that shouldn't take longer than around 3s.

To incorporate slow running builds we will also use the timeout multiplier to account for that.

Component: web-platform-tests → Marionette
Product: Testing → Remote Protocol

CI Results

Ran 10 Firefox configurations based on mozilla-central, and Safari on GitHub CI

Total 275 tests and 18 subtests

Status Summary

Firefox

OK : 260[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] 275[Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt]
PASS : 3405[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] 3639[Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt]
FAIL : 195[Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] 199[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview]
ERROR: 1

Safari

OK : 275
PASS : 2227
FAIL : 459
ERROR: 1149

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

  • /webdriver/tests/element_send_keys/file_upload.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/fullscreen_window/fullscreen.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/fullscreen_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/fullscreen_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/get_current_url/file.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/maximize_window/maximize.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/maximize_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/maximize_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/minimize_window/minimize.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/minimize_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/minimize_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/navigate_to/file.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/new_window/new_window.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/set_window_rect/set.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/set_window_rect/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/bidi/browsing_context/capture_screenshot/invalid.py [wpt.fyi]
    • test_closed_frame: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/log/entry_added/event_buffer.py [wpt.fyi]
    • test_console_log_cached_message_after_refresh[console_api_log]: FAIL (Safari: ERROR)
    • test_console_log_cached_message_after_refresh[javascript_error]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/log/entry_added/stacktrace.py [wpt.fyi]
    • test_console_entry_sync_callstack[warn-True]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/log/entry_added/subscription.py [wpt.fyi]
    • test_subscribe_unsubscribe[console_api_log]: FAIL (Safari: ERROR)
    • test_subscribe_unsubscribe[javascript_error]: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/script/call_function/exception_details.py [wpt.fyi]
    • test_exception_details[new WeakSet()-expected25-False]: FAIL (Safari: ERROR)
    • test_exception_details[new Error('SOME_ERROR_TEXT')-expected26-False]: FAIL (Safari: ERROR)
    • test_exception_details[Promise.resolve()-expected27-False]: FAIL (Safari: ERROR)
    • test_exception_details[new Int32Array()-expected28-False]: FAIL (Safari: ERROR)
    • test_exception_details[new ArrayBuffer()-expected29-False]: FAIL (Safari: ERROR)
    • test_exception_details[document.createElement('div')-expected30-False]: FAIL (Safari: ERROR)
    • test_exception_details[window-expected31-False]: FAIL (Safari: ERROR)
  • /webdriver/tests/element_clear/clear.py [wpt.fyi]
    • test_input_file: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Safari: PASS)
    • test_input_file_multiple: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Safari: FAIL)
  • /webdriver/tests/element_click/interactability.py [wpt.fyi]
    • test_element_not_visible_overflow_hidden: FAIL (Safari: FAIL)
  • /webdriver/tests/element_send_keys/events.py [wpt.fyi]
    • test_file_upload: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Safari: PASS)
  • /webdriver/tests/execute_async_script/arguments.py [wpt.fyi]
    • test_element_reference[frame]: FAIL (Safari: FAIL)
    • test_element_reference[window]: FAIL (Safari: FAIL)
  • /webdriver/tests/execute_async_script/collections.py [wpt.fyi]
    • test_file_list: FAIL [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview], PASS [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Safari: PASS)
  • /webdriver/tests/execute_async_script/node.py [wpt.fyi]
    • test_element_reference[frame]: FAIL (Safari: FAIL)
    • test_element_reference[window]: FAIL (Safari: FAIL)
  • /webdriver/tests/execute_async_script/objects.py [wpt.fyi]
    • test_object_to_json: FAIL (Safari: PASS)
    • test_object_to_json_exception: FAIL (Safari: PASS)
  • /webdriver/tests/execute_async_script/promise.py [wpt.fyi]
    • test_await_promise_resolve: FAIL (Safari: PASS)
  • /webdriver/tests/execute_script/arguments.py [wpt.fyi]
    • test_element_reference[frame]: FAIL (Safari: FAIL)
    • test_element_reference[window]: FAIL (Safari: FAIL)
  • /webdriver/tests/execute_script/json_serialize_windowproxy.py [wpt.fyi]
    • test_initial_window: FAIL (Safari: FAIL)
    • test_window_open: FAIL (Safari: FAIL)
    • test_frame: FAIL (Safari: FAIL)
  • /webdriver/tests/execute_script/node.py [wpt.fyi]
    • test_element_reference[frame]: FAIL (Safari: FAIL)
    • test_element_reference[window]: FAIL (Safari: FAIL)
  • /webdriver/tests/execute_script/promise.py [wpt.fyi]
    • test_await_promise_resolve: FAIL (Safari: PASS)
  • /webdriver/tests/find_element_from_element/find.py [wpt.fyi]
    • test_parent_of_document_node_errors: FAIL (Safari: FAIL)
  • /webdriver/tests/find_element_from_shadow_root/find.py [wpt.fyi]
    • test_null_parameter_value: FAIL (Safari: PASS)
    • test_no_top_browsing_context: FAIL (Safari: PASS)
    • test_no_browsing_context: FAIL (Safari: FAIL)
    • test_no_such_shadow_root_with_element: FAIL (Safari: FAIL)
    • test_no_such_shadow_root_with_unknown_shadow_root: FAIL (Safari: FAIL)
    • test_no_such_shadow_root_with_shadow_root_from_other_window_handle: FAIL (Safari: FAIL)
    • test_no_such_shadow_root_with_shadow_root_from_other_frame: FAIL (Safari: FAIL)
    • test_detached_shadow_root[top_context]: FAIL (Safari: PASS)
    • test_detached_shadow_root[child_context]: FAIL (Safari: PASS)
    • test_no_such_element_with_unknown_selector[not-existent]: FAIL (Safari: PASS)
    • test_no_such_element_with_unknown_selector[existent-other-frame]: FAIL (Safari: PASS)
    • test_no_such_element_with_unknown_selector[existent-outside-shadow-root]: FAIL (Safari: PASS)
    • test_invalid_using_argument[a]: FAIL (Safari: PASS)
    • test_invalid_using_argument[True]: FAIL (Safari: PASS)
    • test_invalid_using_argument[None]: FAIL (Safari: PASS)
    • test_invalid_using_argument[1]: FAIL (Safari: PASS)
    • test_invalid_using_argument[using4]: FAIL (Safari: PASS)
    • test_invalid_using_argument[using5]: FAIL (Safari: PASS)
    • test_invalid_selector_argument[None]: FAIL (Safari: PASS)
    • test_invalid_selector_argument[value1]: FAIL (Safari: PASS)
    • test_invalid_selector_argument[value2]: FAIL (Safari: PASS)
    • test_found_element_equivalence: FAIL (Safari: PASS)
    • test_find_element[css selector-#linkText]: FAIL (Safari: PASS)
    • test_find_element[link text-full link text]: FAIL (Safari: PASS)
    • test_find_element[partial link text-link text]: FAIL (Safari: PASS)
    • test_find_element[tag name-a]: FAIL (Safari: FAIL)
    • test_find_element[xpath-//a]: FAIL (Safari: FAIL)
    • test_find_element_link_text[<a href=#>link text</a>-link text]: FAIL (Safari: PASS)
    • test_find_element_link_text[<a href=#> link text </a>-link text]: FAIL (Safari: PASS)
    • test_find_element_link_text[<a href=#>link<br>text</a>-link\ntext]: FAIL (Safari: PASS)
    • test_find_element_link_text[<a href=#>link&text</a>-link&text]: FAIL (Safari: PASS)
    • test_find_element_link_text[<a href=#>LINK TEXT</a>-LINK TEXT]: FAIL (Safari: PASS)
    • test_find_element_link_text[<a href=# style='text-transform: uppercase'>link text</a>-LINK TEXT]: FAIL (Safari: PASS)
    • test_find_element_partial_link_text[<a href=#>partial link text</a>-link]: FAIL (Safari: PASS)
    • test_find_element_partial_link_text[<a href=#> partial link text </a>-link]: FAIL (Safari: PASS)
    • test_find_element_partial_link_text[<a href=#>partial link text</a>-k t]: FAIL (Safari: PASS)
    • test_find_element_partial_link_text[<a href=#>partial link<br>text</a>-k\nt]: FAIL (Safari: PASS)
    • test_find_element_partial_link_text[<a href=#>partial link&text</a>-k&t]: FAIL (Safari: PASS)
    • test_find_element_partial_link_text[<a href=#>PARTIAL LINK TEXT</a>-LINK]: FAIL (Safari: PASS)
    • test_find_element_partial_link_text[<a href=# style='text-transform: uppercase'>partial link text</a>-LINK]: FAIL (Safari: PASS)
  • /webdriver/tests/find_element_from_shadow_root/user_prompts.py [wpt.fyi]
    • test_accept[capabilities0-alert-None]: FAIL (Safari: PASS)
    • test_accept[capabilities0-confirm-True]: FAIL (Safari: PASS)
    • test_accept[capabilities0-prompt-]: FAIL (Safari: PASS)
    • test_accept_and_notify[capabilities0-alert-None]: FAIL (Safari: PASS)
    • test_accept_and_notify[capabilities0-confirm-True]: FAIL (Safari: PASS)
    • test_accept_and_notify[capabilities0-prompt-]: FAIL (Safari: PASS)
    • test_dismiss[capabilities0-alert-None]: FAIL (Safari: PASS)
    • test_dismiss[capabilities0-confirm-False]: FAIL (Safari: PASS)
    • test_dismiss[capabilities0-prompt-None]: FAIL (Safari: PASS)
    • test_dismiss_and_notify[capabilities0-alert-None]: FAIL (Safari: PASS)
    • test_dismiss_and_notify[capabilities0-confirm-False]: FAIL (Safari: PASS)
    • test_dismiss_and_notify[capabilities0-prompt-None]: FAIL (Safari: PASS)
    • test_ignore[capabilities0-alert]: FAIL (Safari: PASS)
    • test_ignore[capabilities0-confirm]: FAIL (Safari: PASS)
    • test_ignore[capabilities0-prompt]: FAIL (Safari: PASS)
    • test_default[alert-None]: FAIL (Safari: PASS)
    • test_default[confirm-False]: FAIL (Safari: PASS)
    • test_default[prompt-None]: FAIL (Safari: PASS)
  • /webdriver/tests/find_elements_from_element/find.py [wpt.fyi]
    • test_parent_of_document_node_errors: FAIL (Safari: FAIL)
  • /webdriver/tests/find_elements_from_shadow_root/find.py [wpt.fyi]
    • test_null_parameter_value: FAIL (Safari: PASS)
    • test_no_top_browsing_context: FAIL (Safari: PASS)
    • test_no_browsing_context: FAIL (Safari: FAIL)
    • test_no_such_shadow_root_with_element: FAIL (Safari: FAIL)
    • test_no_such_shadow_root_with_unknown_shadow_root: FAIL (Safari: FAIL)
    • test_no_such_shadow_root_with_shadow_root_from_other_window_handle: FAIL (Safari: FAIL)
    • test_no_such_shadow_root_with_shadow_root_from_other_frame: FAIL (Safari: FAIL)
    • test_detached_shadow_root[top_context]: FAIL (Safari: PASS)
    • test_detached_shadow_root[child_context]: FAIL (Safari: PASS)
    • test_no_elements_with_unknown_selector[not-existent]: FAIL (Safari: PASS)
    • test_no_elements_with_unknown_selector[existent-other-frame]: FAIL (Safari: PASS)
    • test_no_elements_with_unknown_selector[existent-outside-shadow-root]: FAIL (Safari: PASS)
    • test_invalid_using_argument[a]: FAIL (Safari: PASS)
    • test_invalid_using_argument[True]: FAIL (Safari: PASS)
    • test_invalid_using_argument[None]: FAIL (Safari: PASS)
    • test_invalid_using_argument[1]: FAIL (Safari: PASS)
    • test_invalid_using_argument[using4]: FAIL (Safari: PASS)
    • test_invalid_using_argument[using5]: FAIL (Safari: PASS)
    • test_invalid_selector_argument[None]: FAIL (Safari: PASS)
    • test_invalid_selector_argument[value1]: FAIL (Safari: PASS)
    • test_invalid_selector_argument[value2]: FAIL (Safari: PASS)
    • test_find_elements_equivalence: FAIL (Safari: PASS)
    • test_find_elements[css selector-#linkText]: FAIL (Safari: PASS)
    • test_find_elements[link text-full link text]: FAIL (Safari: PASS)
    • test_find_elements[partial link text-link text]: FAIL (Safari: PASS)
    • test_find_elements[tag name-a]: FAIL (Safari: FAIL)
    • test_find_elements[xpath-//a]: FAIL (Safari: FAIL)
    • test_find_elements_link_text[<a href=#>link text</a>-link text]: FAIL (Safari: PASS)
    • test_find_elements_link_text[<a href=#> link text </a>-link text]: FAIL (Safari: PASS)
    • test_find_elements_link_text[<a href=#>link<br>text</a>-link\ntext]: FAIL (Safari: PASS)
    • test_find_elements_link_text[<a href=#>link&text</a>-link&text]: FAIL (Safari: PASS)
    • test_find_elements_link_text[<a href=#>LINK TEXT</a>-LINK TEXT]: FAIL (Safari: PASS)
    • test_find_elements_link_text[<a href=# style='text-transform: uppercase'>link text</a>-LINK TEXT]: FAIL (Safari: PASS)
    • test_find_elements_partial_link_text[<a href=#>partial link text</a>-link]: FAIL (Safari: PASS)
    • test_find_elements_partial_link_text[<a href=#> partial link text </a>-link]: FAIL (Safari: PASS)
    • test_find_elements_partial_link_text[<a href=#>partial link text</a>-k t]: FAIL (Safari: PASS)
    • test_find_elements_partial_link_text[<a href=#>partial link<br>text</a>-k\nt]: FAIL (Safari: PASS)
    • test_find_elements_partial_link_text[<a href=#>partial link&text</a>-k&t]: FAIL (Safari: PASS)
    • test_find_elements_partial_link_text[<a href=#>PARTIAL LINK TEXT</a>-LINK]: FAIL (Safari: PASS)
    • test_find_elements_partial_link_text[<a href=# style='text-transform: uppercase'>partial link text</a>-LINK]: FAIL (Safari: PASS)
  • /webdriver/tests/find_elements_from_shadow_root/user_prompts.py [wpt.fyi]
    • test_accept[capabilities0-alert-None]: FAIL (Safari: PASS)
    • test_accept[capabilities0-confirm-True]: FAIL (Safari: PASS)
    • test_accept[capabilities0-prompt-]: FAIL (Safari: PASS)
    • test_accept_and_notify[capabilities0-alert-None]: FAIL (Safari: PASS)
    • test_accept_and_notify[capabilities0-confirm-True]: FAIL (Safari: PASS)
    • test_accept_and_notify[capabilities0-prompt-]: FAIL (Safari: PASS)
    • test_dismiss[capabilities0-alert-None]: FAIL (Safari: PASS)
    • test_dismiss[capabilities0-confirm-False]: FAIL (Safari: PASS)
    • test_dismiss[capabilities0-prompt-None]: FAIL (Safari: PASS)
    • test_dismiss_and_notify[capabilities0-alert-None]: FAIL (Safari: PASS)
    • test_dismiss_and_notify[capabilities0-confirm-False]: FAIL (Safari: PASS)
    • test_dismiss_and_notify[capabilities0-prompt-None]: FAIL (Safari: PASS)
    • test_ignore[capabilities0-alert]: FAIL (Safari: PASS)
    • test_ignore[capabilities0-confirm]: FAIL (Safari: PASS)
    • test_ignore[capabilities0-prompt]: FAIL (Safari: PASS)
    • test_default[alert-None]: FAIL (Safari: PASS)
    • test_default[confirm-False]: FAIL (Safari: PASS)
    • test_default[prompt-None]: FAIL (Safari: PASS)
  • /webdriver/tests/get_computed_label/get.py [wpt.fyi]
    • test_no_browsing_context: FAIL (Safari: FAIL)
    • test_no_such_element_with_invalid_value: FAIL (Safari: PASS)
    • test_no_such_element_with_shadow_root: FAIL (Safari: FAIL)
    • test_no_such_element_from_other_window_handle[open]: FAIL (Safari: FAIL)
    • test_no_such_element_from_other_window_handle[closed]: FAIL (Safari: FAIL)
    • test_no_such_element_from_other_frame[open]: FAIL (Safari: FAIL)
    • test_no_such_element_from_other_frame[closed]: FAIL (Safari: FAIL)
    • test_stale_element_reference[top_context]: FAIL (Safari: PASS)
    • test_stale_element_reference[child_context]: FAIL (Safari: PASS)
    • test_get_computed_label[<button>ok</button>-button-ok]: FAIL (Safari: PASS)
    • test_get_computed_label[<button aria-labelledby="one two"></button><div id=one>ok</div><div id=two>go</div>-button-ok go]: FAIL (Safari: PASS)
    • test_get_computed_label[<button aria-label=foo>bar</button>-button-foo]: FAIL (Safari: PASS)
    • test_get_computed_label[<label><input> foo</label>-input-foo]: FAIL (Safari: PASS)
    • test_get_computed_label[<label for=b>foo<label><input id=b>-input-foo]: FAIL (Safari: PASS)
  • /webdriver/tests/get_computed_role/get.py [wpt.fyi]
    • test_no_browsing_context: FAIL (Safari: FAIL)
    • test_no_such_element_with_invalid_value: FAIL (Safari: PASS)
    • test_no_such_element_with_shadow_root: FAIL (Safari: FAIL)
    • test_no_such_element_from_other_window_handle[open]: FAIL (Safari: FAIL)
    • test_no_such_element_from_other_window_handle[closed]: FAIL (Safari: FAIL)
    • test_no_such_element_from_other_frame[open]: FAIL (Safari: FAIL)
    • test_no_such_element_from_other_frame[closed]: FAIL (Safari: FAIL)
    • test_stale_element_reference[top_context]: FAIL (Safari: PASS)
    • test_stale_element_reference[child_context]: FAIL (Safari: PASS)
    • test_computed_roles[<li role=menuitem>foo-li-menuitem]: FAIL (Safari: PASS)
    • test_computed_roles[<input role=searchbox>-input-searchbox]: FAIL (Safari: PASS)
    • test_computed_roles[<img role=presentation>-img-presentation]: FAIL (Safari: PASS)
  • /webdriver/tests/get_element_property/get.py [wpt.fyi]
    • test_web_reference[frame-Frame]: FAIL (Safari: FAIL)
    • test_web_reference[window-Window]: FAIL (Safari: FAIL)
  • /webdriver/tests/new_session/default_values.py [wpt.fyi]
    • test_no_capabilites: FAIL (Safari: FAIL)
    • test_desired: FAIL (Safari: FAIL)
  • /webdriver/tests/perform_actions/pointer_mouse.py [wpt.fyi]
    • test_drag_and_drop_with_draggable_element[0]: FAIL (Safari: FAIL)
    • test_drag_and_drop_with_draggable_element[300]: FAIL (Safari: FAIL)
    • test_drag_and_drop_with_draggable_element[800]: FAIL (Safari: FAIL)
  • /webdriver/tests/perform_actions/pointer_pen.py [wpt.fyi]
    • test_null_response_value: ERROR (Safari: PASS)
    • test_pen_pointer_properties: FAIL (Safari: FAIL)
  • /webdriver/tests/perform_actions/pointer_tripleclick.py [wpt.fyi]
    • test_tripleclick_at_coordinates: FAIL (Safari: FAIL)
  • /webdriver/tests/permissions/set.py [wpt.fyi]
    • test_invalid_parameters[capabilities0-parameters0]: FAIL (Safari: FAIL)
    • test_invalid_parameters[capabilities0-parameters1]: FAIL (Safari: FAIL)
    • test_invalid_parameters[capabilities0-parameters2]: FAIL (Safari: FAIL)
    • test_invalid_parameters[capabilities0-parameters3]: FAIL (Safari: FAIL)
    • test_invalid_parameters[capabilities0-parameters4]: FAIL (Safari: FAIL)
    • test_invalid_parameters[capabilities0-parameters5]: FAIL (Safari: FAIL)
    • test_invalid_parameters[capabilities0-parameters6]: FAIL (Safari: FAIL)
    • test_non_secure_context[granted]: FAIL (Safari: FAIL)
    • test_non_secure_context[denied]: FAIL (Safari: FAIL)
    • test_non_secure_context[prompt]: FAIL (Safari: FAIL)
    • test_set_to_state[capabilities0-granted]: FAIL (Safari: FAIL)
    • test_set_to_state[capabilities0-denied]: FAIL (Safari: FAIL)
    • test_set_to_state[capabilities0-prompt]: FAIL (Safari: FAIL)

Tests Disabled in Gecko Infrastructure

  • /webdriver/tests/element_send_keys/file_upload.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/fullscreen_window/fullscreen.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/fullscreen_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/fullscreen_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/get_current_url/file.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/maximize_window/maximize.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/maximize_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/maximize_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/minimize_window/minimize.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/minimize_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/minimize_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/navigate_to/file.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/new_window/new_window.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/set_window_rect/set.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/set_window_rect/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/0a32f3862560
[wpt PR 39034] - Set custom default timeouts for WebDriver classic session, a=testonly
https://hg.mozilla.org/integration/autoland/rev/3224a292b8b7
[wpt PR 39034] - Update wpt metadata, a=testonly

https://hg.mozilla.org/mozilla-central/rev/0a32f3862560
https://hg.mozilla.org/mozilla-central/rev/3224a292b8b7

Status: NEW → RESOLVED
Closed: 1 year ago
status-firefox113: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 113 Branch
You need to log in before you can comment on or make changes to this bug.