Closed Bug 1652060 Opened 4 years ago Closed 4 years ago

[wpt-sync] Sync PR 24562 - Python 3: port tests in webdriver

Categories

(Testing :: geckodriver, task, P4)

Product:
Testing
Component:
geckodriver
Type:
task

Tracking

(firefox80 fixed)

Status:
RESOLVED FIXED
Milestone:
mozilla80
Tracking Flags:
Tracking Status
firefox80 --- fixed

People

(Reporter: mozilla.org, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 24562 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/24562
Details from upstream follow.

Ziran Sun <zsun@igalia.com> wrote:

Python 3: port tests in webdriver

Component: web-platform-tests → geckodriver

CI Results

Ran 10 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 154 tests and 18 subtests

Status Summary

Firefox

OK : 152[Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] 153[Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] 154[GitHub]
PASS : 2028[GitHub] 2061[Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] 2063[Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt]
FAIL : 66[Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] 111[GitHub]

Chrome

OK : 153
PASS : 2088
FAIL : 50
TIMEOUT: 1

Safari

OK : 153
PASS : 1467
FAIL : 307
TIMEOUT: 1
ERROR : 364

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

/webdriver/tests/element_clear/clear.py
test_contenteditable: FAIL
/webdriver/tests/get_element_property/get.py
test_primitives[js_primitive3-py_primitive3]: FAIL
test_primitives["foobar"-foobar]: FAIL
test_primitives_set_by_execute_script[42-42]: FAIL
test_primitives[42-42]: FAIL
test_primitives[js_primitive2-py_primitive2]: FAIL
test_primitives_set_by_execute_script[js_primitive2-py_primitive2]: FAIL
test_primitives_set_by_execute_script[js_primitive3-py_primitive3]: FAIL
test_primitives_set_by_execute_script["foobar"-foobar]: FAIL
/webdriver/tests/element_send_keys/events.py
test_file_upload: FAIL
/webdriver/tests/execute_async_script/promise.py
test_await_promise_resolve: FAIL
/webdriver/tests/execute_script/promise.py
test_await_promise_resolve: FAIL
/webdriver/tests/perform_actions/key_events.py
test_special_key_sends_keydown[SUBTRACT-expected16]: FAIL
test_special_key_sends_keydown[PAGE_UP-expected6]: FAIL
test_special_key_sends_keydown[ADD-expected40]: FAIL
test_special_key_sends_keydown[NUMPAD4-expected22]: FAIL
test_modifier_key_sends_correct_events[\ue03d-META]: FAIL
test_special_key_sends_keydown[NUMPAD5-expected61]: FAIL
test_special_key_sends_keydown[PAGE_DOWN-expected30]: FAIL
test_special_key_sends_keydown[META-expected11]: FAIL

New Tests That Don't Pass

/webdriver/tests/element_clear/clear.py
test_contenteditable: FAIL (Chrome: PASS, Safari: PASS)
/webdriver/tests/perform_actions/pointer_tripleclick.py
test_tripleclick_at_coordinates: FAIL (Chrome: FAIL)
/webdriver/tests/find_elements_from_element/find.py
test_parent_of_document_node_errors: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/find_element_from_element/find.py
test_parent_of_document_node_errors: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/get_element_property/get.py
test_primitives[js_primitive3-py_primitive3]: FAIL (Chrome: PASS, Safari: PASS)
test_primitives["foobar"-foobar]: FAIL (Chrome: PASS, Safari: PASS)
test_primitives_set_by_execute_script[42-42]: FAIL (Chrome: PASS, Safari: PASS)
test_primitives[42-42]: FAIL (Chrome: PASS, Safari: PASS)
test_primitives[js_primitive2-py_primitive2]: FAIL (Chrome: PASS, Safari: PASS)
test_primitives_set_by_execute_script[js_primitive2-py_primitive2]: FAIL (Chrome: PASS, Safari: PASS)
test_primitives_set_by_execute_script[js_primitive3-py_primitive3]: FAIL (Chrome: PASS, Safari: PASS)
test_primitives_set_by_execute_script["foobar"-foobar]: FAIL (Chrome: PASS, Safari: PASS)
/webdriver/tests/get_named_cookie/get.py
test_get_cookie_with_same_site_flag[capabilities0-Lax]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_get_cookie_with_same_site_flag[capabilities0-None]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_get_named_cookie: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: FAIL, Safari: FAIL)
test_get_named_session_cookie: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: FAIL, Safari: FAIL)
test_get_cookie_with_same_site_flag[capabilities0-Strict]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_duplicated_cookie: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: FAIL, Safari: FAIL)
/webdriver/tests/execute_script/json_serialize_windowproxy.py
test_frame: FAIL (Chrome: FAIL, Safari: FAIL)
test_window_open: FAIL (Chrome: FAIL, Safari: FAIL)
test_initial_window: FAIL (Chrome: FAIL, Safari: FAIL)
/webdriver/tests/new_window/new_window.py: OK [GitHub], SKIP [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: OK, Safari: OK)
/webdriver/tests/element_send_keys/events.py
test_file_upload: FAIL (Chrome: PASS, Safari: PASS)
/webdriver/tests/maximize_window/maximize.py
test_maximize_when_resized_to_max_size: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: PASS)
/webdriver/tests/new_session/response.py
test_capability_default_value[proxy-default_value2]: FAIL (Chrome: PASS, Safari: FAIL)
test_capability_type[proxy-dict]: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/set_window_rect/user_prompts.py
test_dismiss_and_notify[capabilities0-alert-None]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
/webdriver/tests/execute_async_script/promise.py
test_await_promise_resolve: FAIL (Chrome: PASS, Safari: PASS)
/webdriver/tests/print/printcmd.py
test_invalid[options4]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_invalid[options6]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_invalid[options5]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_invalid[options7]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_invalid[options3]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_invalid[options8]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_invalid[options2]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_no_browsing_context: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_invalid[options0]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_html_document: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: FAIL, Safari: ERROR)
test_invalid[options1]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
/webdriver/tests/print/user_prompts.py
test_accept_and_notify[capabilities0-prompt-]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_dismiss[capabilities0-alert-None]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: FAIL, Safari: ERROR)
test_dismiss_and_notify[capabilities0-prompt-None]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_dismiss_and_notify[capabilities0-alert-None]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_dismiss_and_notify[capabilities0-confirm-False]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_default[alert-None]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_accept[capabilities0-confirm-True]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: FAIL, Safari: ERROR)
test_accept_and_notify[capabilities0-confirm-True]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_accept[capabilities0-alert-None]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: FAIL, Safari: ERROR)
test_ignore[capabilities0-prompt]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_default[confirm-False]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_ignore[capabilities0-alert]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_ignore[capabilities0-confirm]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_accept_and_notify[capabilities0-alert-None]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_dismiss[capabilities0-prompt-None]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: FAIL, Safari: ERROR)
test_accept[capabilities0-prompt-]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: FAIL, Safari: ERROR)
test_default[prompt-None]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: ERROR)
test_dismiss[capabilities0-confirm-False]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: FAIL, Safari: ERROR)
/webdriver/tests/perform_actions/pointer.py
test_drag_and_drop_with_draggable_element[0]: FAIL (Chrome: FAIL, Safari: FAIL)
test_drag_and_drop_with_draggable_element[300]: FAIL (Chrome: FAIL, Safari: FAIL)
test_drag_and_drop_with_draggable_element[800]: FAIL (Chrome: FAIL, Safari: FAIL)
/webdriver/tests/execute_script/promise.py
test_await_promise_resolve: FAIL (Chrome: PASS, Safari: PASS)
/webdriver/tests/permissions/set.py
test_set_to_state[capabilities0-realmSetting2-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting1-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting1-prompt]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting1-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting1-prompt]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters1]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting0-prompt]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters3]: FAIL (Chrome: PASS, Safari: ERROR)
test_non_secure_context[prompt]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters5]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting2-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting0-prompt]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting0-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting1-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting1-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_non_secure_context[granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting0-denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters7]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters2]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters4]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting0-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state[capabilities0-realmSetting2-prompt]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters6]: FAIL (Chrome: PASS, Safari: ERROR)
test_set_to_state_cross_realm[capabilities0-realmSetting0-granted]: FAIL (Chrome: PASS, Safari: ERROR)
test_non_secure_context[denied]: FAIL (Chrome: PASS, Safari: ERROR)
test_invalid_parameters[capabilities0-parameters0]: FAIL (Chrome: PASS, Safari: ERROR)
/webdriver/tests/perform_actions/validity.py
test_pause_positive_integer[key]: FAIL (Chrome: PASS, Safari: ERROR)
test_pause_positive_integer[none]: FAIL (Chrome: PASS, Safari: ERROR)
test_pause_positive_integer[pointer]: FAIL (Chrome: PASS, Safari: ERROR)
/webdriver/tests/add_cookie/add.py
test_add_cookie_with_invalid_samesite_type[12]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: FAIL)
test_add_cookie_with_invalid_samesite_flag: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: FAIL)
test_add_cookie_with_valid_samesite_flag[Strict]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: FAIL)
test_add_cookie_with_valid_samesite_flag[None]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: FAIL, Safari: FAIL)
test_add_cookie_with_invalid_samesite_type[same_site2]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: FAIL)
test_add_cookie_with_valid_samesite_flag[Lax]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: FAIL)
test_add_cookie_with_invalid_samesite_type[False]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: FAIL)
/webdriver/tests/perform_actions/key_events.py
test_special_key_sends_keydown[SUBTRACT-expected16]: FAIL (Chrome: PASS, Safari: PASS)
test_special_key_sends_keydown[PAGE_UP-expected6]: FAIL (Chrome: PASS, Safari: PASS)
test_special_key_sends_keydown[ADD-expected40]: FAIL (Chrome: PASS, Safari: PASS)
test_special_key_sends_keydown[SEPARATOR-expected66]: FAIL (Chrome: PASS, Safari: FAIL)
test_modifier_key_sends_correct_events[\ue053-R_META]: FAIL (Chrome: PASS, Safari: FAIL)
test_special_key_sends_keydown[NUMPAD4-expected22]: FAIL (Chrome: PASS, Safari: PASS)
test_modifier_key_sends_correct_events[\ue03d-META]: FAIL (Chrome: PASS, Safari: PASS)
test_special_key_sends_keydown[R_META-expected19]: FAIL (Chrome: PASS, Safari: FAIL)
test_special_key_sends_keydown[NUMPAD5-expected61]: FAIL (Chrome: PASS, Safari: PASS)
test_special_key_sends_keydown[PAGE_DOWN-expected30]: FAIL (Chrome: PASS, Safari: PASS)
test_special_key_sends_keydown[META-expected11]: FAIL (Chrome: PASS, Safari: PASS)
/webdriver/tests/new_session/default_values.py
test_no_capabilites: FAIL (Chrome: PASS, Safari: FAIL)
test_desired: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/element_click/interactability.py
test_element_not_visible_overflow_hidden: FAIL (Chrome: PASS, Safari: FAIL)
/webdriver/tests/maximize_window/user_prompts.py
test_ignore[capabilities0-alert]: FAIL [GitHub], PASS [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: PASS, Safari: PASS)

Tests Disabled in Gecko Infrastructure

/webdriver/tests/new_window/new_window.py: OK [GitHub], SKIP [Gecko-linux1804-64-debug, Gecko-linux1804-64-opt, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows10-64-debug, Gecko-windows10-64-opt, Gecko-windows10-64-qr-debug, Gecko-windows10-64-qr-opt, Gecko-windows7-32-debug, Gecko-windows7-32-opt] (Chrome: OK, Safari: OK)

Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/090e8d62a127
[wpt PR 24562] - Python 3: port tests in webdriver, a=testonly

https://hg.mozilla.org/mozilla-central/rev/090e8d62a127

Status: NEW → RESOLVED
Closed: 4 years ago
status-firefox80: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → mozilla80
You need to log in before you can comment on or make changes to this bug.