1873687 - Enable incremental upgrading of test tier for WebGPU CTS

Status: RESOLVED FIXED

(Core :: Graphics: WebGPU, task, P2)

Comment 1

[Erich Gubler [:ErichDonGubler]]

I currently plan on doing this via the implementation-status, a la web-platform-test jobs that use implementation-status already in Firefox CI. CC'ing :jmaher, who I'll likely be contacting soon with questions. 🙂

Comment 2

[Erich Gubler [:ErichDonGubler]]

I'm not currently working on this; dropping assignment to indicate such.

Comment 3

[Erich Gubler [:ErichDonGubler]]

I've asked :jgraham about some issues I'm discovering with using implementation-status to implement this. I'm considering using an approach with tags instead, but I think that that would be less than ideal.

Comment 4

[Erich Gubler [:ErichDonGubler]]

After discussing the implementation-status WPT property with :jgraham, it turns out that the only valid values relevant to use are implementing and backlog (before, I thought a default value was in the set of valid values due to a docs. issue). We might want to use a tag value to differentiate more than 2 stages later, but I think we need to focus on having 2 stages right now if that's easily achievable with implementation-status. Will move forward with implementing and backlog for now.

Comment 5

[Erich Gubler [:ErichDonGubler]]

Attachment: Bug 1873687 - test(webgpu): skip `not-implementing` tests in CTS r=#webgpu-reviewers!

Comment 6

[Erich Gubler [:ErichDonGubler]]

Attachment: Bug 1873687 - test(wpt): pass test paths via `--include-file` on Windows r=#webgpu-reviewers!,jgraham

Comment 7

[Erich Gubler [:ErichDonGubler]]

Attachment: Bug 1873687 - test(webgpu): split (most) tests from `webgpu` into `webgpu-backlog` r=#webgpu-reviewers!

Comment 8

[Erich Gubler [:ErichDonGubler]]

Attachment: Bug 1873687 - test(webgpu): update outcomes for backlog timeout multiplier r=#webgpu-reviewers!

We need to do this because of 0.25 timeout multiplier imposed on
--backlog WPT tests; permalink:
https://searchfox.org/mozilla-central/rev/eb4700a6be8371fe07053bc066c2d48ba813ce3d/testing/mozharness/scripts/web_platform_tests.py#433-435

Updated using:

• moz-webgpu-cts update-expected --preset new-fx … with reports from
  try:4ee59d698a3a,
  version 0.9.0, then…
• …not committing new metadata files in
  testing/web-platform/mozilla/meta/webgpu/webgpu/, which will be
  handled in a subsequent patch from this stack.
• …some manual effort to remove if os == "mac": SKIP outcomes for
  various jobs in MacOS' webgpu-backlog6 tasks. Will follow up with
  these in bug
  1893047.

Comment 9

[Erich Gubler [:ErichDonGubler]]

Attachment: Bug 1873687 - test(webgpu): mark `webworker` CTS cases as `expected: SKIP` r=#webgpu-reviewers!

Comment 10

[Erich Gubler [:ErichDonGubler]]

Attachment: Bug 1873687 - test(webgpu): remove unused `fs::existing_file` in CTS vendoring script r=#webgpu-reviewers!

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ea0e5c68965a
test(webgpu): skip `not-implementing` tests in CTS r=webgpu-reviewers,teoxoy
https://hg.mozilla.org/integration/autoland/rev/451636e3ac1e
test(wpt): pass test paths via `--include-file` on Windows r=webgpu-reviewers,teoxoy
https://hg.mozilla.org/integration/autoland/rev/d5bd60ebaf65
test(webgpu): split (most) tests from `webgpu` into `webgpu-backlog` r=webgpu-reviewers,taskgraph-reviewers,bhearsum,nical

Comment 12

[Aron Cseh]

https://hg.mozilla.org/mozilla-central/rev/ea0e5c68965a
https://hg.mozilla.org/mozilla-central/rev/451636e3ac1e
https://hg.mozilla.org/mozilla-central/rev/d5bd60ebaf65

Comment 13

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/6796f3c9a6da
test(webgpu): update outcomes for backlog timeout multiplier r=webgpu-reviewers,teoxoy
https://hg.mozilla.org/integration/autoland/rev/f207a8a61d87
test(webgpu): mark `webworker` CTS cases as `expected: SKIP` r=webgpu-reviewers,teoxoy
https://hg.mozilla.org/integration/autoland/rev/9382506b792f
test(webgpu): remove unused `fs::existing_file` in CTS vendoring script r=webgpu-reviewers,teoxoy

Comment 14

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/6796f3c9a6da
https://hg.mozilla.org/mozilla-central/rev/f207a8a61d87
https://hg.mozilla.org/mozilla-central/rev/9382506b792f