Closed Bug 1884137 Opened 1 year ago Closed 1 year ago

[wpt-sync] Sync PR 44977 - [WebDriverBiDi] improve some tests

Categories

(Remote Protocol :: WebDriver BiDi, task, P4)

task

Tracking

(firefox125 fixed)

RESOLVED FIXED
125 Branch
Tracking Status
firefox125 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

()

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 44977 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/44977
Details from upstream follow.

Nikolay Vitkov <nvitkov@chromium.org> wrote:

[WebDriverBiDi] improve some tests

Small fix to the create_block_request to respect the context in all cases.
Also wrapped the event in a timeout to prevent blocking all test in case of failure.

Component: web-platform-tests → WebDriver BiDi
Product: Testing → Remote Protocol

CI Results

Ran 10 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 30 tests and 6 subtests

Status Summary

Firefox

OK : 30
PASS : 806[GitHub] 809[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] 810[Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt]
FAIL : 12[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] 16[GitHub]

Chrome

OK : 23
PASS : 431
FAIL : 68
TIMEOUT: 7

Safari

OK : 30
ERROR : 822

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

  • /webdriver/tests/bidi/network/add_intercept/contexts.py [wpt.fyi]
    • test_other_context_with_event_subscription: FAIL (Chrome: FAIL, Safari: ERROR)
    • test_two_contexts_global_intercept: FAIL (Chrome: FAIL, Safari: ERROR)
  • /webdriver/tests/bidi/network/add_intercept/invalid.py [wpt.fyi]
    • test_params_contexts_invalid_type[False]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Safari: ERROR)
    • test_params_contexts_invalid_type[42]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Safari: ERROR)
    • test_params_contexts_invalid_type[value2]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Safari: ERROR)
    • test_params_contexts_invalid_type[]: FAIL [GitHub], PASS [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Safari: ERROR)
    • test_params_contexts_invalid_value[value0]: FAIL
    • test_params_contexts_invalid_value[value1]: FAIL
    • test_params_contexts_context_non_top_level: FAIL (Safari: ERROR)
    • test_params_contexts_empty_list: FAIL (Safari: ERROR)
    • test_params_contexts_context_invalid_value: FAIL (Safari: ERROR)
  • /webdriver/tests/bidi/network/before_request_sent/before_request_sent_cached.py [wpt.fyi]
    • test_page_with_cached_resource: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/network/continue_request/invalid.py [wpt.fyi]
    • test_params_url_invalid_value[:invalid-http]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_url_invalid_value[:invalid-https]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_url_invalid_value[#invalid-http]: FAIL (Chrome: PASS, Safari: ERROR)
    • test_params_url_invalid_value[#invalid-https]: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/network/response_completed/response_completed_cached.py [wpt.fyi]
    • test_page_with_cached_resource: FAIL (Chrome: PASS, Safari: ERROR)
  • /webdriver/tests/bidi/network/response_started/response_started_cached.py [wpt.fyi]
    • test_page_with_cached_resource: FAIL (Chrome: PASS, Safari: ERROR)
Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/286955bfd811 [wpt PR 44977] - [WebDriverBiDi] improve some tests, a=testonly
Status: NEW → RESOLVED
Closed: 1 year ago
Resolution: --- → FIXED
Target Milestone: --- → 125 Branch
You need to log in before you can comment on or make changes to this bug.