1838742 - `web-platform-tests` jobs should not run WebGPU's WPT tests (for now)

Status: RESOLVED FIXED

(Testing :: web-platform-tests, defect, P1)

Description

[Erich Gubler [:ErichDonGubler] (he/him)]

Bug 1829715 attempted to move WebGPU's WPT tests (i.e., webgpu tasks in TreeHerder like these) to its own set of CI jobs. However, I've discovered that it did not succeed in its intent to stop WebGPU's WPT tests from running in the main body of WPT tests. I have confirmed with :jgraham that this is because WPT currently does not have the filtering power to eliminate --includes more specific than --excludes; CI's decision task bakes several inclusions as positional arguments to the WPT runner when orchestrating chunked web-platform-tests tasks. 😭

We need to stop running WebGPU tests in the main web-platform-tests. In addition to duplicating work scoped to WebGPU WPT jobs, the WebGPU team will start using an environment with higher different hardware/software requirements in order to unblock work to bring WebGPU's compliance up to spec. See also dependencies of webgpu-v1-cts-blockers.

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1829715

Comment 2

[Erich Gubler [:ErichDonGubler] (he/him)]

Attachment: Bug 1838742: feat(wpt): add `--exclude-tag` r=jgraham

Comment 3

[Erich Gubler [:ErichDonGubler] (he/him)]

Attachment: Bug 1838742: test(wpt): use `--exclude-tag=webgpu` instead of `--exclude=…` for `web-platform-tests` r?#webgpu-reviewers r=jgraham

Comment 4

[Erich Gubler [:ErichDonGubler] (he/him)]

Attachment: Bug 1838742: test(wpt): add commentary as ctx. for tag filter tests r=jgraham

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/492197502967
test(wpt): add commentary as ctx. for tag filter tests r=jgraham
https://hg.mozilla.org/integration/autoland/rev/215562ff5dac
feat(wpt): add `--exclude-tag` r=jgraham
https://hg.mozilla.org/integration/autoland/rev/b63c85346aa0
test(wpt): use `--exclude-tag=webgpu` instead of `--exclude=…` for `web-platform-tests` r=jgraham

Comment 6

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Created web-platform-tests PR https://github.com/web-platform-tests/wpt/pull/40646 for changes under testing/web-platform/tests

Comment 7

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/492197502967
https://hg.mozilla.org/mozilla-central/rev/215562ff5dac
https://hg.mozilla.org/mozilla-central/rev/b63c85346aa0

Comment 8

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1829715

Comment 9

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Upstream PR merged by moz-wptsync-bot

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/55b8e9879db7
[wpt PR 40646] - [Gecko Bug 1838742] test(wpt): add commentary as ctx. for tag filter tests, a=testonly

Comment 11

[Cristian Tuns]

https://hg.mozilla.org/mozilla-central/rev/55b8e9879db7