Closed Bug 1485763 Opened Last year Closed Last year

[wpt-sync] Sync PR 12654 - Convert webdriver pytest fixtures to use pytest.fixture as a decorator.

Categories

(Testing :: geckodriver, enhancement, P4)

enhancement

Tracking

(firefox63 fixed)

RESOLVED FIXED
mozilla63
Tracking Status
firefox63 --- fixed

People

(Reporter: wptsync, Unassigned)

References

()

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 12654 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/12654
Details from upstream follow.

Brian Burg <bburg@apple.com> wrote:
>  Convert webdriver pytest fixtures to use pytest.fixture as a decorator.
>  
>  Starting in pytest 3.7.0, calling the decorator pytest.fixture directly
>  and passing a function object does not work. Since this is a weird way to
>  set up fixtures, just migrate fixture implementations from fixtures.py
>  to the top-level conftest.py and use a decorator to register each fixture.
>  
>  Move non-fixture helpers to tests/support/helpers.py. Move constant values
>  used as defaults to tests/support/defaults.py and adjust imports and uses.
>  Some default values are used both by fixtures in conftest.py and by helpers
>  in helpers.py.
Component: web-platform-tests → geckodriver
Ran 102 tests and 1332[linux64-opt], 1349[linux64-debug], 1350[linux32-debug,linux32-opt] subtests
OK     : 96[linux64-opt], 97[linux32-debug,linux32-opt,linux64-debug]
PASS   : 816[linux32-debug,linux32-opt], 798[linux64-opt], 815[linux64-debug]
FAIL   : 498
ERROR  : 40

Existing tests that now have a worse result (e.g. they used to PASS and now FAIL):
/webdriver/tests/accept_alert/accept.py
    test_accept_alert: FAIL
    test_accept_confirm: FAIL
    test_accept_prompt: FAIL
    test_null_response_value: FAIL
/webdriver/tests/actions/mouse.py
    test_click_navigation: FAIL
/webdriver/tests/actions/pointer_origin.py
    test_element_center_point: FAIL
    test_element_center_point_with_offset: FAIL
    test_element_in_view_center_point_partly_visible: FAIL
    test_element_larger_than_viewport: FAIL
    test_element_outside_of_view_port: FAIL
    test_pointer_inside: FAIL
    test_viewport_inside: FAIL
/webdriver/tests/back/back.py
    test_data_urls: FAIL
    test_dismissed_beforeunload: FAIL
    test_history_pushstate: FAIL
    test_null_response_value: FAIL
/webdriver/tests/back/user_prompts.py
    test_accept[capabilities0-alert]: ERROR
    test_accept[capabilities0-confirm]: ERROR
    test_accept[capabilities0-prompt]: ERROR
    test_accept_and_notify[capabilities0-alert-None]: ERROR
    test_accept_and_notify[capabilities0-confirm-True]: ERROR
    test_accept_and_notify[capabilities0-prompt-]: ERROR
    test_default[alert-None]: ERROR
    test_default[confirm-False]: ERROR
    test_default[prompt-None]: ERROR
    test_dismiss[capabilities0-alert]: ERROR
    test_dismiss[capabilities0-confirm]: ERROR
    test_dismiss[capabilities0-prompt]: ERROR
    test_dismiss_and_notify[capabilities0-alert-None]: ERROR
    test_dismiss_and_notify[capabilities0-confirm-False]: ERROR
    test_dismiss_and_notify[capabilities0-prompt-None]: ERROR
    test_ignore[capabilities0-alert]: ERROR
    test_ignore[capabilities0-confirm]: ERROR
    test_ignore[capabilities0-prompt]: ERROR
/webdriver/tests/close_window/close.py
    test_close_browsing_context_with_dismissed_beforeunload_prompt: FAIL
/webdriver/tests/delete_session/delete.py
    test_dismissed_beforeunload_prompt: FAIL
/webdriver/tests/dismiss_alert/dismiss.py
    test_dismiss_alert: FAIL
    test_dismiss_confirm: FAIL
    test_dismiss_prompt: FAIL
    test_null_response_value: FAIL
/webdriver/tests/element_clear/clear.py
    test_button: FAIL
    test_button_with_subtree: FAIL
    test_connected_element: FAIL
    test_contenteditable: FAIL
    test_designmode: FAIL
    test_input[color-#ff0000-#000000]: FAIL
    test_input[date-2017-12-26-]: FAIL
    test_input[datetime-2017-12-26T19:48-]: FAIL
    test_input[datetime-local-2017-12-26T19:48-]: FAIL
    test_input[email-foo@example.com-]: FAIL
    test_input[month-2017-11-]: FAIL
    test_input[number-42-]: FAIL
    test_input[password-password-]: FAIL
    test_input[range-42-50]: FAIL
    test_input[search-search-]: FAIL
    test_input[tel-999-]: FAIL
    test_input[text-text-]: FAIL
    test_input[time-19:48-]: FAIL
    test_input[url-https://example.com/-]: FAIL
    test_input[week-2017-W52-]: FAIL
    test_input_disabled[color]: FAIL
    test_input_disabled[date]: FAIL
    test_input_disabled[datetime-local]: FAIL
    test_input_disabled[datetime]: FAIL
    test_input_disabled[email]: FAIL
    test_input_disabled[file]: FAIL
    test_input_disabled[month]: FAIL
    test_input_disabled[number]: FAIL
    test_input_disabled[password]: FAIL
    test_input_disabled[range]: FAIL
    test_input_disabled[search]: FAIL
    test_input_disabled[tel]: FAIL
    test_input_disabled[text]: FAIL
    test_input_disabled[time]: FAIL
    test_input_disabled[url]: FAIL
    test_input_disabled[week]: FAIL
    test_input_file: FAIL
    test_input_file_multiple: FAIL
    test_input_readonly[color]: FAIL
    test_input_readonly[date]: FAIL
    test_input_readonly[datetime-local]: FAIL
    test_input_readonly[datetime]: FAIL
    test_input_readonly[email]: FAIL
    test_input_readonly[file]: FAIL
    test_input_readonly[month]: FAIL
    test_input_readonly[number]: FAIL
    test_input_readonly[password]: FAIL
    test_input_readonly[range]: FAIL
    test_input_readonly[search]: FAIL
    test_input_readonly[tel]: FAIL
    test_input_readonly[text]: FAIL
    test_input_readonly[time]: FAIL
    test_input_readonly[url]: FAIL
    test_input_readonly[week]: FAIL
    test_keyboard_interactable: FAIL
    test_non_editable_inputs[button]: FAIL
    test_non_editable_inputs[checkbox]: FAIL
    test_non_editable_inputs[hidden]: FAIL
    test_non_editable_inputs[image]: FAIL
    test_non_editable_inputs[radio]: FAIL
    test_non_editable_inputs[submit]: FAIL
    test_null_response_value: FAIL
    test_pointer_interactable: FAIL
    test_resettable_element_does_not_satisfy_validation_constraints[color-foo]: FAIL
    test_resettable_element_does_not_satisfy_validation_constraints[date-foo]: FAIL
    test_resettable_element_does_not_satisfy_validation_constraints[datetime-foo]: FAIL
    test_resettable_element_does_not_satisfy_validation_constraints[datetime-local-foo]: FAIL
    test_resettable_element_does_not_satisfy_validation_constraints[email-foo]: FAIL
    test_resettable_element_does_not_satisfy_validation_constraints[month-foo]: FAIL
    test_resettable_element_does_not_satisfy_validation_constraints[number-foo]: FAIL
    test_resettable_element_does_not_satisfy_validation_constraints[range-foo]: FAIL
    test_resettable_element_does_not_satisfy_validation_constraints[time-foo]: FAIL
    test_resettable_element_does_not_satisfy_validation_constraints[url-foo]: FAIL
    test_resettable_element_does_not_satisfy_validation_constraints[week-foo]: FAIL
    test_resettable_element_focus_when_empty: FAIL
    test_scroll_into_view: FAIL
    test_select: FAIL
    test_textarea: FAIL
    test_textarea_disabled: FAIL
    test_textarea_readonly: FAIL
/webdriver/tests/element_click/bubbling.py
    test_click_event_bubbles_to_parents: FAIL
    test_element_disappears_during_click: FAIL
    test_spin_event_loop: FAIL
/webdriver/tests/element_click/click.py
    test_null_response_value: FAIL
/webdriver/tests/element_click/file_upload.py
    test_file_upload_state: FAIL
/webdriver/tests/element_click/interactability.py
    test_element_intercepted: FAIL
    test_element_intercepted_no_pointer_events: FAIL
    test_element_not_interactable_css_transform[rotate(50deg)]: FAIL
    test_element_not_interactable_css_transform[translate(-100px, -100px)]: FAIL
    test_element_not_interactable_out_of_view: FAIL
/webdriver/tests/element_click/navigate.py
    test_link_closes_window: FAIL
    test_link_hash: FAIL
    test_link_unload_event: FAIL
    test_multi_line_link: FAIL
    test_numbers_link: FAIL
/webdriver/tests/element_click/scroll_into_view.py
    test_scroll_into_view: FAIL
/webdriver/tests/element_click/select.py
    test_click_deselects_others: FAIL
    test_click_multiple_does_not_deselect_others: FAIL
    test_click_multiple_option: FAIL
    test_click_option: FAIL
    test_click_preselected_multiple_option: FAIL
    test_click_preselected_option: FAIL
    test_click_selected_multiple_option: FAIL
    test_click_selected_option: FAIL
    test_option_disabled: FAIL
    test_out_of_view_dropdown: FAIL
    test_out_of_view_multiple: FAIL
/webdriver/tests/element_click/stale.py
    test_is_stale: FAIL
/webdriver/tests/element_send_keys/content_editable.py
    test_sets_insertion_point_to_after_last_text_node: FAIL
    test_sets_insertion_point_to_end: FAIL
/webdriver/tests/element_send_keys/events.py
    test_form_control_send_text[input]: FAIL
    test_form_control_send_text[textarea]: FAIL
    test_not_blurred[input]: FAIL
    test_not_blurred[textarea]: FAIL
/webdriver/tests/element_send_keys/file_upload.py
    test_empty_text: FAIL
    test_multiple_files: FAIL
    test_multiple_files_last_path_not_found: FAIL
    test_multiple_files_reset_with_element_clear: FAIL
    test_multiple_files_send_twice: FAIL
    test_multiple_files_without_multiple_attribute: FAIL
    test_single_file: FAIL
    test_single_file_appends_with_multiple_attribute: FAIL
    test_single_file_replaces_without_multiple_attribute: FAIL
/webdriver/tests/element_send_keys/form_controls.py
    test_input: FAIL
    test_input_append: FAIL
    test_textarea: FAIL
    test_textarea_append: FAIL
/webdriver/tests/element_send_keys/interactability.py
    test_body_is_interactable: FAIL
    test_disabled_element: FAIL
    test_document_element_is_interactable: FAIL
    test_hidden_element: FAIL
    test_iframe_is_interactable: FAIL
    test_not_a_focusable_element: FAIL
    test_not_displayed_element: FAIL
    test_obscured_element: FAIL
    test_readonly_element: FAIL
    test_transparent_element: FAIL
/webdriver/tests/element_send_keys/scroll_into_view.py
    test_contenteditable_element_outside_of_scrollable_viewport: FAIL
    test_element_outside_of_not_scrollable_viewport: FAIL
    test_element_outside_of_scrollable_viewport: FAIL
    test_option_select_container_outside_of_scrollable_viewport: FAIL
    test_option_stays_outside_of_scrollable_viewport: FAIL
/webdriver/tests/element_send_keys/send_keys.py
    test_invalid_text_type[1]: FAIL
    test_invalid_text_type[None]: FAIL
    test_invalid_text_type[True]: FAIL
    test_invalid_text_type[value3]: FAIL
    test_invalid_text_type[value4]: FAIL
    test_null_parameter_value: FAIL
    test_null_response_value: FAIL
    test_stale_element: FAIL
/webdriver/tests/element_send_keys/user_prompts.py
    test_accept_and_notify[capabilities0-alert-None]: FAIL
    test_accept_and_notify[capabilities0-confirm-True]: FAIL
    test_accept_and_notify[capabilities0-prompt-]: FAIL
    test_default[alert-None]: FAIL
    test_default[confirm-False]: FAIL
    test_default[prompt-None]: FAIL
    test_dismiss_and_notify[capabilities0-alert-None]: FAIL
    test_dismiss_and_notify[capabilities0-confirm-False]: FAIL
    test_dismiss_and_notify[capabilities0-prompt-None]: FAIL
    test_ignore[capabilities0-alert]: FAIL
    test_ignore[capabilities0-confirm]: FAIL
    test_ignore[capabilities0-prompt]: FAIL
/webdriver/tests/execute_async_script/collections.py
    test_file_list: FAIL
    test_html_all_collection: FAIL
    test_html_collection: FAIL
    test_html_form_controls_collection: FAIL
    test_html_options_collection: FAIL
    test_node_list: FAIL
/webdriver/tests/execute_script/collections.py
    test_file_list: FAIL
    test_html_all_collection: FAIL
    test_html_collection: FAIL
    test_html_form_controls_collection: FAIL
    test_html_options_collection: FAIL
    test_node_list: FAIL
/webdriver/tests/execute_script/cyclic.py
    test_element_in_collection: FAIL
    test_element_in_object: FAIL
/webdriver/tests/find_element/find.py
    test_find_element[css selector-#linkText]: FAIL
    test_find_element[link text-full link text]: FAIL
    test_find_element[partial link text-link text]: FAIL
    test_find_element[tag name-a]: FAIL
    test_find_element[xpath-//a]: FAIL
    test_find_element_link_text[<a href=# style='text-transform: uppercase'>link text</a>-LINK TEXT]: FAIL
    test_find_element_link_text[<a href=#>&nbsp;link text&nbsp;</a>-link text]: FAIL
    test_find_element_link_text[<a href=#>LINK TEXT</a>-LINK TEXT]: FAIL
    test_find_element_link_text[<a href=#>link text</a>-link text]: FAIL
    test_find_element_link_text[<a href=#>link&amp;text</a>-link&text]: FAIL
    test_find_element_link_text[<a href=#>link<br>text</a>-link
text]: FAIL
    test_find_element_partial_link_text[<a href=# style='text-transform: uppercase'>partial link text</a>-LINK]: FAIL
    test_find_element_partial_link_text[<a href=#>&nbsp;partial link text&nbsp;</a>-link]: FAIL
    test_find_element_partial_link_text[<a href=#>PARTIAL LINK TEXT</a>-LINK]: FAIL
    test_find_element_partial_link_text[<a href=#>partial link text</a>-k t]: FAIL
    test_find_element_partial_link_text[<a href=#>partial link text</a>-link]: FAIL
    test_find_element_partial_link_text[<a href=#>partial link&amp;text</a>-k&t]: FAIL
    test_find_element_partial_link_text[<a href=#>partial link<br>text</a>-k
t]: FAIL
    test_htmldocument[css selector-:root]: FAIL
    test_htmldocument[tag name-html]: FAIL
    test_htmldocument[xpath-/html]: FAIL
    test_xhtml_namespace[css selector-#linkText]: FAIL
    test_xhtml_namespace[link text-full link text]: FAIL
    test_xhtml_namespace[partial link text-link text]: FAIL
    test_xhtml_namespace[tag name-a]: FAIL
    test_xhtml_namespace[xpath-//*[name()='a']]: FAIL
/webdriver/tests/find_element_from_element/find.py
    test_find_element[css selector-#linkText]: FAIL
    test_find_element[link text-full link text]: FAIL
    test_find_element[partial link text-link text]: FAIL
    test_find_element[tag name-a]: FAIL
    test_find_element[xpath-//a]: FAIL
    test_find_element_link_text[<a href=# style='text-transform: uppercase'>link text</a>-LINK TEXT]: FAIL
    test_find_element_link_text[<a href=#>&nbsp;link text&nbsp;</a>-link text]: FAIL
    test_find_element_link_text[<a href=#>LINK TEXT</a>-LINK TEXT]: FAIL
    test_find_element_link_text[<a href=#>link text</a>-link text]: FAIL
    test_find_element_link_text[<a href=#>link&amp;text</a>-link&text]: FAIL
    test_find_element_link_text[<a href=#>link<br>text</a>-link
text]: FAIL
    test_find_element_partial_link_text[<a href=# style='text-transform: uppercase'>partial link text</a>-LINK]: FAIL
    test_find_element_partial_link_text[<a href=#>&nbsp;partial link text&nbsp;</a>-link]: FAIL
    test_find_element_partial_link_text[<a href=#>PARTIAL LINK TEXT</a>-LINK]: FAIL
    test_find_element_partial_link_text[<a href=#>partial link text</a>-k t]: FAIL
    test_find_element_partial_link_text[<a href=#>partial link text</a>-link]: FAIL
    test_find_element_partial_link_text[<a href=#>partial link&amp;text</a>-k&t]: FAIL
    test_find_element_partial_link_text[<a href=#>partial link<br>text</a>-k
t]: FAIL
    test_no_element[css selector-#wontExist]: FAIL
    test_null_parameter_value: FAIL
    test_parent_htmldocument: FAIL
    test_xhtml_namespace[css selector-#linkText]: FAIL
    test_xhtml_namespace[link text-full link text]: FAIL
    test_xhtml_namespace[partial link text-link text]: FAIL
    test_xhtml_namespace[tag name-a]: FAIL
    test_xhtml_namespace[xpath-//*[name()='a']]: FAIL
/webdriver/tests/find_elements/find.py
    test_find_elements[css selector-#linkText]: FAIL
    test_find_elements[link text-full link text]: FAIL
    test_find_elements[partial link text-link text]: FAIL
    test_find_elements[tag name-a]: FAIL
    test_find_elements[xpath-//a]: FAIL
    test_find_elements_link_text[<a href=# style='text-transform: uppercase'>link text</a>-LINK TEXT]: FAIL
    test_find_elements_link_text[<a href=#>&nbsp;link text&nbsp;</a>-link text]: FAIL
    test_find_elements_link_text[<a href=#>LINK TEXT</a>-LINK TEXT]: FAIL
    test_find_elements_link_text[<a href=#>link text</a>-link text]: FAIL
    test_find_elements_link_text[<a href=#>link&amp;text</a>-link&text]: FAIL
    test_find_elements_link_text[<a href=#>link<br>text</a>-link
text]: FAIL
    test_find_elements_partial_link_text[<a href=# style='text-transform: uppercase'>partial link text</a>-LINK]: FAIL
    test_find_elements_partial_link_text[<a href=#>&nbsp;partial link text&nbsp;</a>-link]: FAIL
    test_find_elements_partial_link_text[<a href=#>PARTIAL LINK TEXT</a>-LINK]: FAIL
    test_find_elements_partial_link_text[<a href=#>partial link text</a>-k t]: FAIL
    test_find_elements_partial_link_text[<a href=#>partial link text</a>-link]: FAIL
    test_find_elements_partial_link_text[<a href=#>partial link&amp;text</a>-k&t]: FAIL
    test_find_elements_partial_link_text[<a href=#>partial link<br>text</a>-k
t]: FAIL
    test_htmldocument[css selector-:root]: FAIL
    test_htmldocument[tag name-html]: FAIL
    test_htmldocument[xpath-/html]: FAIL
    test_xhtml_namespace[css selector-#linkText]: FAIL
    test_xhtml_namespace[link text-full link text]: FAIL
    test_xhtml_namespace[partial link text-link text]: FAIL
    test_xhtml_namespace[tag name-a]: FAIL
    test_xhtml_namespace[xpath-//*[name()='a']]: FAIL
/webdriver/tests/find_elements_from_element/find.py
    test_find_elements[css selector-#linkText]: FAIL
    test_find_elements[link text-full link text]: FAIL
    test_find_elements[partial link text-link text]: FAIL
    test_find_elements[tag name-a]: FAIL
    test_find_elements[xpath-//a]: FAIL
    test_find_elements_link_text[<a href=# style='text-transform: uppercase'>link text</a>-LINK TEXT]: FAIL
    test_find_elements_link_text[<a href=#>&nbsp;link text&nbsp;</a>-link text]: FAIL
    test_find_elements_link_text[<a href=#>LINK TEXT</a>-LINK TEXT]: FAIL
    test_find_elements_link_text[<a href=#>link text</a>-link text]: FAIL
    test_find_elements_link_text[<a href=#>link&amp;text</a>-link&text]: FAIL
    test_find_elements_link_text[<a href=#>link<br>text</a>-link
text]: FAIL
    test_find_elements_partial_link_text[<a href=# style='text-transform: uppercase'>partial link text</a>-LINK]: FAIL
    test_find_elements_partial_link_text[<a href=#>&nbsp;partial link text&nbsp;</a>-link]: FAIL
    test_find_elements_partial_link_text[<a href=#>PARTIAL LINK TEXT</a>-LINK]: FAIL
    test_find_elements_partial_link_text[<a href=#>partial link text</a>-k t]: FAIL
    test_find_elements_partial_link_text[<a href=#>partial link text</a>-link]: FAIL
    test_find_elements_partial_link_text[<a href=#>partial link&amp;text</a>-k&t]: FAIL
    test_find_elements_partial_link_text[<a href=#>partial link<br>text</a>-k
t]: FAIL
    test_no_element[css selector-#wontExist]: FAIL
    test_null_parameter_value: FAIL
    test_parent_htmldocument: FAIL
    test_xhtml_namespace[css selector-#linkText]: FAIL
    test_xhtml_namespace[link text-full link text]: FAIL
    test_xhtml_namespace[partial link text-link text]: FAIL[linux32-opt,linux64-debug,linux64-opt]
    test_xhtml_namespace[tag name-a]: FAIL
    test_xhtml_namespace[xpath-//*[name()='a']]: FAIL
/webdriver/tests/forward/forward.py
    test_data_urls: FAIL
    test_dismissed_beforeunload: FAIL
    test_history_pushstate: FAIL
    test_no_browsing_history: FAIL
    test_null_response_value: FAIL
/webdriver/tests/forward/user_prompts.py
    test_accept[capabilities0-alert]: ERROR
    test_accept[capabilities0-confirm]: ERROR
    test_accept[capabilities0-prompt]: ERROR
    test_accept_and_notify[capabilities0-alert-None]: ERROR
    test_accept_and_notify[capabilities0-confirm-True]: ERROR
    test_accept_and_notify[capabilities0-prompt-]: ERROR
    test_default[alert-None]: ERROR
    test_default[confirm-False]: ERROR
    test_default[prompt-None]: ERROR
    test_dismiss[capabilities0-alert]: ERROR
    test_dismiss[capabilities0-confirm]: ERROR
    test_dismiss[capabilities0-prompt]: ERROR
    test_dismiss_and_notify[capabilities0-alert-None]: ERROR
    test_dismiss_and_notify[capabilities0-confirm-False]: ERROR
    test_dismiss_and_notify[capabilities0-prompt-None]: ERROR
    test_ignore[capabilities0-alert]: ERROR
    test_ignore[capabilities0-confirm]: ERROR
    test_ignore[capabilities0-prompt]: ERROR
/webdriver/tests/get_active_element/get.py
    test_missing_document_element: FAIL
    test_success_document: FAIL
    test_success_explicit_focus: FAIL
    test_success_iframe_content: FAIL
    test_sucess_input: FAIL
    test_sucess_input_non_interactable: FAIL
/webdriver/tests/get_alert_text/get.py
    test_get_alert_text: FAIL
    test_get_confirm_text: FAIL
    test_get_prompt_text: FAIL
/webdriver/tests/get_current_url/get.py: ERROR
/webdriver/tests/get_current_url/user_prompts.py
    test_accept[capabilities0-alert-None]: FAIL
    test_accept[capabilities0-confirm-True]: FAIL
    test_accept[capabilities0-prompt-]: FAIL
    test_accept_and_notify[capabilities0-alert-None]: FAIL
    test_accept_and_notify[capabilities0-confirm-True]: FAIL
    test_accept_and_notify[capabilities0-prompt-]: FAIL
    test_default[alert-None]: FAIL
    test_default[confirm-False]: FAIL
    test_default[prompt-None]: FAIL
    test_dismiss[capabilities0-alert-None]: FAIL
    test_dismiss[capabilities0-confirm-False]: FAIL
    test_dismiss[capabilities0-prompt-None]: FAIL
    test_dismiss_and_notify[capabilities0-alert-None]: FAIL
    test_dismiss_and_notify[capabilities0-confirm-False]: FAIL
    test_dismiss_and_notify[capabilities0-prompt-None]: FAIL
    test_ignore[capabilities0-alert]: FAIL
    test_ignore[capabilities0-confirm]: FAIL
    test_ignore[capabilities0-prompt]: FAIL
/webdriver/tests/get_element_attribute/get.py
    test_boolean_attribute[audio-attrs0]: FAIL
    test_boolean_attribute[button-attrs1]: FAIL
    test_boolean_attribute[details-attrs2]: FAIL
    test_boolean_attribute[dialog-attrs3]: FAIL
    test_boolean_attribute[fieldset-attrs4]: FAIL
    test_boolean_attribute[form-attrs5]: FAIL
    test_boolean_attribute[iframe-attrs6]: FAIL
    test_boolean_attribute[img-attrs7]: FAIL
    test_boolean_attribute[input-attrs8]: FAIL
    test_boolean_attribute[menuitem-attrs9]: FAIL
    test_boolean_attribute[object-attrs10]: FAIL
    test_boolean_attribute[ol-attrs11]: FAIL
    test_boolean_attribute[optgroup-attrs12]: FAIL
    test_boolean_attribute[option-attrs13]: FAIL
    test_boolean_attribute[script-attrs14]: FAIL
    test_boolean_attribute[select-attrs15]: FAIL
    test_boolean_attribute[textarea-attrs16]: FAIL
    test_boolean_attribute[track-attrs17]: FAIL
    test_boolean_attribute[video-attrs18]: FAIL
    test_element_stale: FAIL
    test_global_boolean_attributes: FAIL
    test_normal: FAIL
/webdriver/tests/get_element_property/get.py: ERROR
/webdriver/tests/get_element_property/user_prompts.py
    test_accept[capabilities0-alert-None]: FAIL
    test_accept[capabilities0-confirm-True]: FAIL
    test_accept[capabilities0-prompt-]: FAIL
    test_accept_and_notify[capabilities0-alert-None]: FAIL
    test_accept_and_notify[capabilities0-confirm-True]: FAIL
    test_accept_and_notify[capabilities0-prompt-]: FAIL
    test_default[alert-None]: FAIL
    test_default[confirm-False]: FAIL
    test_default[prompt-None]: FAIL
    test_dismiss[capabilities0-alert-None]: FAIL
    test_dismiss[capabilities0-confirm-False]: FAIL
    test_dismiss[capabilities0-prompt-None]: FAIL
    test_dismiss_and_notify[capabilities0-alert-None]: FAIL
    test_dismiss_and_notify[capabilities0-confirm-False]: FAIL
    test_dismiss_and_notify[capabilities0-prompt-None]: FAIL
    test_ignore[capabilities0-alert]: FAIL
    test_ignore[capabilities0-confirm]: FAIL
    test_ignore[capabilities0-prompt]: FAIL
/webdriver/tests/get_element_tag_name/get.py
    test_element_stale: FAIL
    test_get_element_tag_name: FAIL
/webdriver/tests/get_element_tag_name/user_prompts.py
    test_accept[capabilities0-alert-None]: FAIL
    test_accept[capabilities0-confirm-True]: FAIL
    test_accept[capabilities0-prompt-]: FAIL
    test_accept_and_notify[capabilities0-alert-None]: FAIL
    test_accept_and_notify[capabilities0-confirm-True]: FAIL
    test_accept_and_notify[capabilities0-prompt-]: FAIL
    test_default[alert-None]: FAIL
    test_default[confirm-False]: FAIL
    test_default[prompt-None]: FAIL
    test_dismiss[capabilities0-alert-None]: FAIL
    test_dismiss[capabilities0-confirm-False]: FAIL
    test_dismiss[capabilities0-prompt-None]: FAIL
    test_dismiss_and_notify[capabilities0-alert-None]: FAIL
    test_dismiss_and_notify[capabilities0-confirm-False]: FAIL
    test_dismiss_and_notify[capabilities0-prompt-None]: FAIL
    test_ignore[capabilities0-alert]: FAIL
    test_ignore[capabilities0-confirm]: FAIL
    test_ignore[capabilities0-prompt]: FAIL
/webdriver/tests/get_element_text/get.py
    test_getting_text_of_a_non_existant_element_is_an_error: FAIL
    test_read_element_text: FAIL
/webdriver/tests/get_named_cookie/get.py
    test_duplicated_cookie: FAIL
/webdriver/tests/get_title/get.py
    test_title_after_modification: FAIL
    test_title_from_frame: FAIL
    test_title_from_top_context: FAIL
    test_title_strip_and_collapse: FAIL
    test_title_with_duplicate_element: FAIL
    test_title_without_element: FAIL
/webdriver/tests/get_title/user_prompts.py
    test_accept[capabilities0-alert-None]: FAIL
    test_accept[capabilities0-confirm-True]: FAIL
    test_accept[capabilities0-prompt-]: FAIL
    test_accept_and_notify[capabilities0-alert-None]: FAIL
    test_accept_and_notify[capabilities0-confirm-True]: FAIL
    test_accept_and_notify[capabilities0-prompt-]: FAIL
    test_default[alert-None]: FAIL
    test_default[confirm-False]: FAIL
    test_default[prompt-None]: FAIL
    test_dismiss[capabilities0-alert-None]: FAIL
    test_dismiss[capabilities0-confirm-False]: FAIL
    test_dismiss[capabilities0-prompt-None]: FAIL
    test_dismiss_and_notify[capabilities0-alert-None]: FAIL
    test_dismiss_and_notify[capabilities0-confirm-False]: FAIL
    test_dismiss_and_notify[capabilities0-prompt-None]: FAIL
    test_ignore[capabilities0-alert]: FAIL
    test_ignore[capabilities0-confirm]: FAIL
    test_ignore[capabilities0-prompt]: FAIL
/webdriver/tests/get_window_rect/get.py: ERROR
/webdriver/tests/is_element_selected/selected.py: ERROR
/webdriver/tests/is_element_selected/user_prompts.py
    test_accept[capabilities0-alert-None]: FAIL
    test_accept[capabilities0-confirm-True]: FAIL
    test_accept[capabilities0-prompt-]: FAIL
    test_accept_and_notify[capabilities0-alert-None]: FAIL
    test_accept_and_notify[capabilities0-confirm-True]: FAIL
    test_accept_and_notify[capabilities0-prompt-]: FAIL
    test_default[alert-None]: FAIL
    test_default[confirm-False]: FAIL
    test_default[prompt-None]: FAIL
    test_dismiss[capabilities0-alert-None]: FAIL
    test_dismiss[capabilities0-confirm-False]: FAIL
    test_dismiss[capabilities0-prompt-None]: FAIL
    test_dismiss_and_notify[capabilities0-alert-None]: FAIL
    test_dismiss_and_notify[capabilities0-confirm-False]: FAIL
    test_dismiss_and_notify[capabilities0-prompt-None]: FAIL
    test_ignore[capabilities0-alert]: FAIL
    test_ignore[capabilities0-confirm]: FAIL
    test_ignore[capabilities0-prompt]: FAIL
/webdriver/tests/navigate_to/navigate.py
    test_null_response_value: FAIL
/webdriver/tests/page_source/source.py
    test_source_matches_outer_html: FAIL
/webdriver/tests/refresh/refresh.py
    test_basic: FAIL
    test_dismissed_beforeunload: FAIL
    test_history_pushstate: FAIL
    test_null_response_value: FAIL
    test_refresh_switches_to_parent_browsing_context: FAIL
/webdriver/tests/refresh/user_prompts.py
    test_accept[capabilities0-alert]: FAIL
    test_accept[capabilities0-confirm]: FAIL
    test_accept[capabilities0-prompt]: FAIL
    test_accept_and_notify[capabilities0-alert-None]: FAIL
    test_accept_and_notify[capabilities0-confirm-True]: FAIL
    test_accept_and_notify[capabilities0-prompt-]: FAIL
    test_default[alert-None]: FAIL
    test_default[confirm-False]: FAIL
    test_default[prompt-None]: FAIL
    test_dismiss[capabilities0-alert]: FAIL
    test_dismiss[capabilities0-confirm]: FAIL
    test_dismiss[capabilities0-prompt]: FAIL
    test_dismiss_and_notify[capabilities0-alert-None]: FAIL
    test_dismiss_and_notify[capabilities0-confirm-False]: FAIL
    test_dismiss_and_notify[capabilities0-prompt-None]: FAIL
    test_ignore[capabilities0-alert]: FAIL
    test_ignore[capabilities0-confirm]: FAIL
    test_ignore[capabilities0-prompt]: FAIL
/webdriver/tests/send_alert_text/send.py
    test_alert_element_not_interactable: FAIL
    test_confirm_element_not_interactable: FAIL
    test_invalid_input[42]: FAIL
    test_invalid_input[None]: FAIL
    test_invalid_input[True]: FAIL
    test_invalid_input[text1]: FAIL
    test_invalid_input[text2]: FAIL
    test_null_response_value: FAIL
    test_send_alert_text: FAIL
    test_send_alert_text_with_whitespace: FAIL
/webdriver/tests/switch_to_frame/switch.py
    test_null_response_value: FAIL
/webdriver/tests/switch_to_parent_frame/switch.py
    test_null_response_value: FAIL
    test_stale_element_from_iframe: FAIL

Tests that are disabled for instability:
/webdriver/tests/get_window_rect/user_prompts.py: [linux64-opt]
/webdriver/tests/maximize_window/user_prompts.py
Pushed by wptsync@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/5d49aabdab5c
[wpt PR 12654] - Convert webdriver pytest fixtures to use pytest.fixture as a decorator., a=testonly
https://hg.mozilla.org/integration/mozilla-inbound/rev/88e463f817b3
[wpt PR 12654] - Update wpt metadata, a=testonly
https://hg.mozilla.org/mozilla-central/rev/5d49aabdab5c
https://hg.mozilla.org/mozilla-central/rev/88e463f817b3
Status: NEW → RESOLVED
Closed: Last year
Resolution: --- → FIXED
Target Milestone: --- → mozilla63
You need to log in before you can comment on or make changes to this bug.