Closed Bug 1873687 Opened 5 months ago Closed 1 month ago

Enable incremental upgrading of test tier for WebGPU CTS

Categories

(Core :: Graphics: WebGPU, task, P2)

task

Tracking

()

RESOLVED FIXED
127 Branch
Tracking Status
firefox127 --- fixed

People

(Reporter: ErichDonGubler, Assigned: ErichDonGubler)

References

(Blocks 1 open bug)

Details

Attachments

(6 files)

No description provided.

I currently plan on doing this via the implementation-status, a la web-platform-test jobs that use implementation-status already in Firefox CI. CC'ing :jmaher, who I'll likely be contacting soon with questions. 🙂

Priority: -- → P1
Status: ASSIGNED → NEW
Priority: P1 → P2
Blocks: 1886808
Assignee: nobody → egubler
Status: NEW → ASSIGNED

After discussing the implementation-status WPT property with :jgraham, it turns out that the only valid values relevant to use are implementing and backlog (before, I thought a default value was in the set of valid values due to a docs. issue). We might want to use a tag value to differentiate more than 2 stages later, but I think we need to focus on having 2 stages right now if that's easily achievable with implementation-status. Will move forward with implementing and backlog for now.

Attachment #9396143 - Attachment description: WIP: Bug 1873687 - test(wpt): pass test paths via `--include-file` on Windows r=#webgpu-reviewers!,jgraham → Bug 1873687 - test(wpt): pass test paths via `--include-file` on Windows r=#webgpu-reviewers!,jgraham
Blocks: 1822096
No longer blocks: 1822096
Attachment #9396144 - Attachment description: Bug 1873687: test(webgpu): split (most) tests from `webgpu` into `webgpu-backlog` r=#webgpu-reviewers! → Bug 1873687 - test(webgpu): split (most) tests from `webgpu` into `webgpu-backlog` r=#webgpu-reviewers!

We need to do this because of 0.25 timeout multiplier imposed on
--backlog WPT tests; permalink:
https://searchfox.org/mozilla-central/rev/eb4700a6be8371fe07053bc066c2d48ba813ce3d/testing/mozharness/scripts/web_platform_tests.py#433-435

Updated using:

  • moz-webgpu-cts update-expected --preset new-fx … with reports from
    try:4ee59d698a3a,
    version 0.9.0, then…
  • not committing new metadata files in
    testing/web-platform/mozilla/meta/webgpu/webgpu/, which will be
    handled in a subsequent patch from this stack.
  • …some manual effort to remove if os == "mac": SKIP outcomes for
    various jobs in MacOS' webgpu-backlog6 tasks. Will follow up with
    these in bug
    1893047
    .
Attachment #9398226 - Attachment description: Bug 1873687 - test(webgpu): remove unused `fs::existing_file` r=#webgpu-reviewers! → Bug 1873687 - test(webgpu): remove unused `fs::existing_file` in CTS vendoring script r=#webgpu-reviewers!
Blocks: 1893054
No longer blocks: 1886808, 1893054
Keywords: leave-open
Blocks: 1893054
Pushed by egubler@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/ea0e5c68965a
test(webgpu): skip `not-implementing` tests in CTS r=webgpu-reviewers,teoxoy
https://hg.mozilla.org/integration/autoland/rev/451636e3ac1e
test(wpt): pass test paths via `--include-file` on Windows r=webgpu-reviewers,teoxoy
https://hg.mozilla.org/integration/autoland/rev/d5bd60ebaf65
test(webgpu): split (most) tests from `webgpu` into `webgpu-backlog` r=webgpu-reviewers,taskgraph-reviewers,bhearsum,nical
Keywords: leave-open
Pushed by egubler@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/6796f3c9a6da
test(webgpu): update outcomes for backlog timeout multiplier r=webgpu-reviewers,teoxoy
https://hg.mozilla.org/integration/autoland/rev/f207a8a61d87
test(webgpu): mark `webworker` CTS cases as `expected: SKIP` r=webgpu-reviewers,teoxoy
https://hg.mozilla.org/integration/autoland/rev/9382506b792f
test(webgpu): remove unused `fs::existing_file` in CTS vendoring script r=webgpu-reviewers,teoxoy
Status: ASSIGNED → RESOLVED
Closed: 1 month ago
Resolution: --- → FIXED
Target Milestone: --- → 127 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: