Closed Bug 1917068 Opened 1 year ago Closed 1 year ago

[wpt-sync] Sync PR 47992 - Add an empyt pytest.ini file for webdriver tests

Categories

(Remote Protocol :: Agent, task, P4)

task

Tracking

(firefox132 fixed)

RESOLVED FIXED
132 Branch
Tracking Status
firefox132 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

()

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 47992 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/47992
Details from upstream follow.

Weizhong Xia <weizhong@google.com> wrote:

Add an empyt pytest.ini file for webdriver tests

pytest will look for pytest.ini file to determine the value for rootdir.
With this file added, pytest will always set rootdir to webdriver/tests.

Webdriver tests currently fail on the Android WPT builder[1]. The reason
is that rootdir is set to some subdirectory of webdriver/tests, e.g.
/tmp/wpt/webdriver/tests/classic/navigate_to, and that caused fixtures
inside the support directory can not be found.

[1] https://ci.chromium.org/ui/p/chromium/builders/ci/android-chrome-pie-x86-wpt-fyi-rel

Bug: 364109563
Cq-Include-Trybots: luci.chromium.try:linux-blink-rel
Change-Id: I7adf0ef64cb591f60c21259701ba58ee736f4997
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/5838000
Reviewed-by: Alex Rudenko \<alexrudenko@chromium.org>
Commit-Queue: Alex Rudenko \<alexrudenko@chromium.org>
Cr-Commit-Position: refs/heads/main@{#1351242}

Component: web-platform-tests → Marionette
Product: Testing → Remote Protocol
Component: Marionette → Agent

CI Results

Ran 3 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 427 tests and 5 subtests

Status Summary

Firefox

OK : 426
PASS : 7386[GitHub] 7408[Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-opt]
FAIL : 106[Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-opt] 119[GitHub]
ERROR : 1[Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-opt] 2[GitHub]

Chrome

OK : 423
PASS : 7030
FAIL : 445
TIMEOUT: 3
ERROR : 1

Safari

OK : 426
PASS : 2501
FAIL : 852
TIMEOUT: 1
ERROR : 3756

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

Firefox-only Failures

New Tests That Don't Pass

Tests Disabled in Gecko Infrastructure

Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/59261f4dcd01 [wpt PR 47992] - Add an empyt pytest.ini file for webdriver tests, a=testonly https://hg.mozilla.org/integration/autoland/rev/89a24423fae3 [wpt PR 47992] - Update wpt metadata, a=testonly
Status: NEW → RESOLVED
Closed: 1 year ago
Resolution: --- → FIXED
Target Milestone: --- → 132 Branch
You need to log in before you can comment on or make changes to this bug.