Closed Bug 1842137 Opened 1 year ago Closed 1 year ago

[wpt-sync] Sync PR 40910 - Webdriver tests should default to use the HTTPS protocol

Categories

(Remote Protocol :: Marionette, task, P1)

task
Points:
2

Tracking

(firefox118 fixed)

RESOLVED FIXED
118 Branch
Tracking Status
firefox118 --- fixed

People

(Reporter: wpt-sync, Assigned: whimboo)

References

()

Details

(Whiteboard: [webdriver:m8][wptsync downstream])

Sync web-platform-tests PR 40910 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/40910
Details from upstream follow.

Henrik Skupin <mail@hskupin.info> wrote:

Webdriver tests should default to use the HTTPS protocol

This converts all the usages of HTTP to HTTPS by default. Some tests will still use HTTP to test non-secure connections like the navigation tests.

Closes #28847.

Component: web-platform-tests → Marionette
Product: Testing → Remote Protocol

Taking because I'm working on it and we need it for M8 tracking.

Assignee: wptsync → hskupin
Status: NEW → ASSIGNED
Priority: P4 → P1
Whiteboard: [wptsync downstream] → [webdriver:m8][wptsync downstream]

Check on try before setting points

Flags: needinfo?(jdescottes)

Applied the patch locally and pushed to try: https://treeherder.mozilla.org/jobs?repo=try&revision=4c9d23c67edb1c639182d96380b7bfd56400dcd2

Seems fine so let's set 2 points.

Points: --- → 2
Flags: needinfo?(jdescottes)
Whiteboard: [webdriver:m8][wptsync downstream] → [webdriver:m8][wptsync downstream error]
Whiteboard: [webdriver:m8][wptsync downstream error] → [webdriver:m8][wptsync downstream]

CI Results

Ran 6 Firefox configurations based on mozilla-central, and Safari on GitHub CI

Total 306 tests and 11 subtests

Status Summary

Firefox

OK : 279[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] 294[Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt]
PASS : 3846[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] 4092[Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt]
FAIL : 109[Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt] 115[Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview]
ERROR: 1

Safari

OK : 306
PASS : 2439
FAIL : 722
ERROR: 1694

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

Tests Disabled in Gecko Infrastructure

  • /webdriver/tests/classic/element_send_keys/file_upload.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/fullscreen_window/fullscreen.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/fullscreen_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/fullscreen_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/get_current_url/file.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/maximize_window/maximize.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/maximize_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/maximize_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/minimize_window/minimize.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/minimize_window/stress.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/minimize_window/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/navigate_to/file.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/new_window/new_window.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/set_window_rect/set.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
  • /webdriver/tests/classic/set_window_rect/user_prompts.py [wpt.fyi]: OK [Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-isolated-process-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview] (Safari: OK)
Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/1607d1582f79 [wpt PR 40910] - Webdriver tests should default to use the HTTPS protocol, a=testonly https://hg.mozilla.org/integration/autoland/rev/2b4fee4efc51 [wpt PR 40910] - Update wpt metadata, a=testonly
Status: ASSIGNED → RESOLVED
Closed: 1 year ago
Resolution: --- → FIXED
Target Milestone: --- → 118 Branch
You need to log in before you can comment on or make changes to this bug.