Closed Bug 2014043 Opened 4 months ago Closed 4 months ago

Update WebGPU CTS to new version 5cfc580345c90401bfe6d2ac4133d28051b3e0f6 from 2026-02-03 00:41:16

Categories

(Core :: Graphics: WebGPU, task, P1)

task

Tracking

()

RESOLVED FIXED
149 Branch
Tracking Status
firefox149 --- fixed

People

(Reporter: update-bot, Assigned: aleiserson)

References

(Blocks 1 open bug)

Details

(Whiteboard: [3pl-filed][task_id: U4xcrYmfTOe29LPsVBONSQ])

Attachments

(2 files)

This update covers 4 commits. Here are the overall diff statistics, and then the commit information.


dom/webgpu/tests/cts/checkout/src/webgpu/api/validation/buffer/mapping.spec.ts | 31 +-
dom/webgpu/tests/cts/checkout/src/webgpu/capability_info.ts | 1 +
dom/webgpu/tests/cts/checkout/src/webgpu/shader/execution/expression/call/builtin/select.spec.ts | 35 +
dom/webgpu/tests/cts/checkout/src/webgpu/shader/execution/statement/swizzle_assignment.spec.ts | 277 ++++++++++
dom/webgpu/tests/cts/checkout/src/webgpu/shader/validation/decl/assignment_statement.spec.ts | 14 +
dom/webgpu/tests/cts/checkout/tools/gen_version | 2 +-
dom/webgpu/tests/cts/moz.yaml | 4 +-
testing/web-platform/mozilla/tests/webgpu/common/internal/version.js | 2 +-
testing/web-platform/mozilla/tests/webgpu/cts/webgpu/shader/execution/expression/call/builtin/select/cts.https.html | 1 +
testing/web-platform/mozilla/tests/webgpu/cts/webgpu/shader/execution/statement/swizzle_assignment/cts.https.html | 40 +
testing/web-platform/mozilla/tests/webgpu/cts/webgpu/shader/validation/decl/assignment_statement/cts.https.html | 1 +
testing/web-platform/mozilla/tests/webgpu/webgpu/api/validation/buffer/mapping.spec.js | 31 +-
testing/web-platform/mozilla/tests/webgpu/webgpu/capability_info.js | 3 +-
testing/web-platform/mozilla/tests/webgpu/webgpu/listing.js | 8 +
testing/web-platform/mozilla/tests/webgpu/webgpu/shader/execution/expression/call/builtin/select.spec.js | 35 +
testing/web-platform/mozilla/tests/webgpu/webgpu/shader/execution/statement/swizzle_assignment.spec.js | 277 ++++++++++
testing/web-platform/mozilla/tests/webgpu/webgpu/shader/validation/decl/assignment_statement.spec.js | 14 +
testing/web-platform/mozilla/tests/webgpu/webgpu/webworker/shader/execution/statement/swizzle_assignment.as_worker.js | 6 +
18 files changed, 743 insertions(+), 39 deletions(-)


5cfc580345c90401bfe6d2ac4133d28051b3e0f6 by Natalie Chouinard <chouinard@google.com>

https://github.com/gpuweb/cts/commit/5cfc580345c90401bfe6d2ac4133d28051b3e0f6
Authored: 2026-02-02 19:41:16 -0500
Committed: 2026-02-03 00:41:16 +0000

Swizzle assignment tests (#4580)

Files Added:

  • src/webgpu/shader/execution/statement/swizzle_assignment.spec.ts

Files Modified:

  • src/webgpu/capability_info.ts

b07fa2f25d1650e783fee02adf40e0ca12f96c23 by Natalie Chouinard <chouinard@google.com>

https://github.com/gpuweb/cts/commit/b07fa2f25d1650e783fee02adf40e0ca12f96c23
Authored: 2026-02-02 13:24:45 -0500
Committed: 2026-02-02 18:24:45 +0000

Add test for compound assignment with swizzle (#4581)

Files Modified:

  • src/webgpu/shader/validation/decl/assignment_statement.spec.ts

f4cda204fd6974d84b47376cadbc43598c6cd7c0 by Teodor Tanasoaia <28601907+teoxoy@users.noreply.github.com>

https://github.com/gpuweb/cts/commit/f4cda204fd6974d84b47376cadbc43598c6cd7c0
Authored: 2026-01-30 00:06:36 +0100
Committed: 2026-01-29 23:06:36 +0000

Update mapping tests to be in line with the spec (#4575)

Files Modified:

  • src/webgpu/api/validation/buffer/mapping.spec.ts

ded0ae3ab675767780bf4249b5fb71b2672df07b by Natalie Chouinard <chouinard@google.com>

https://github.com/gpuweb/cts/commit/ded0ae3ab675767780bf4249b5fb71b2672df07b
Authored: 2026-01-27 15:58:29 -0500
Committed: 2026-01-27 15:58:29 -0500

Test that select() does not short circuit (#4577)

Files Modified:

  • src/webgpu/shader/execution/expression/call/builtin/select.spec.ts

Assignee: nobody → aleiserson
Type: enhancement → task
Priority: -- → P1

The try push is done, we found jobs with unclassified failures.

Needs Close Investigation:

  • _mozilla/webgpu/cts/webgpu/api/operation/rendering/draw/cts.https.html?q=webgpu:api,operation,rendering,draw:arguments:*
    • 2 of 3 failed on the same (retriggered) task
      - test-macosx1470-64/debug-web-platform-tests-webgpu-long-2 (bxjxpUQHS4mNwvMlIF8ObA)
      - test-macosx1470-64/debug-web-platform-tests-webgpu-long-2 (QkMzsYHXS1CGnrZ0DydMwA)
  • test-linux2204-64-wayland/debug-web-platform-tests-webgpu-backlog-7 - 1 of 3 failed on the same (retriggered) task (failed: ZS32P75STOWr7fplTot39Q)
  • test-linux2204-64-wayland/opt-web-platform-tests-webgpu-backlog-13 - 3 of 3 failed on the same (retriggered) task (failed: Yp_USlmjSLKY0r041gw-GA, QjPwoRn0RRO_mPID4k309g, VK6aCwD4Ro2Eazh_krXrpw)
  • test-windows11-64-24h2/opt-web-platform-tests-webgpu-backlog-5 - 3 of 3 failed on the same (retriggered) task (failed: U-pmaQVeSwGk-HYvffk2mA, Wzg3hFoxRIaZPvvYKo7Bvg, Avn84rYCRmWCI5aHAcThug)
  • test-macosx1470-64/debug-web-platform-tests-webgpu-backlog-long-5 - 2 of 3 failed on the same (retriggered) task (failed: IZ22Eh-2TzChCxfI07fFyQ, TY1t2ykzRhCYuIJ1iNEwtA)
  • test-macosx1470-64/debug-web-platform-tests-webgpu-backlog-long-4 - 3 of 3 failed on the same (retriggered) task (failed: DWNO2hm8QKKn9QIDYTnphA, DWNnR-KFSnalV_jMdAM1GQ, NRmtQTPpSFubkm-rJ27W1w)
  • test-macosx1470-64/debug-web-platform-tests-webgpu-14 - 1 of 3 failed on the same (retriggered) task (failed: MMU-xb33RF-uieJAwp1Oow)
  • test-linux2204-64-wayland/debug-web-platform-tests-webgpu-backlog-long-3 - 3 of 3 failed on the same (retriggered) task (failed: QLmhsblETkS442j94MW-og, Tcqod9YBQ3CtJgVT1jisGQ, DyPgq05lTIarObOqtVotXA)
  • test-linux2204-64-wayland/debug-web-platform-tests-webgpu-backlog-13 - 3 of 3 failed on the same (retriggered) task (failed: CscAtxUTT1q6TbdLmWxrRw, CDEKHsWRSwON9y9dsU44FQ, BvXHbtPNT9KvbDk7LkY6Fg)
  • test-linux2204-64-wayland/opt-web-platform-tests-webgpu-backlog-10 - 1 of 3 failed on the same (retriggered) task (failed: JofzrfFRRDqP82HnEOwpFw)
  • test-linux2204-64-wayland/opt-web-platform-tests-webgpu-backlog-long-2 - 1 of 3 failed on the same (retriggered) task (failed: Se-GKc94Qda0i1RLAsMkTQ)
  • test-windows11-64-24h2/opt-web-platform-tests-webgpu-backlog-long-3 - 3 of 3 failed on the same (retriggered) task (failed: B3Qllf6gQ_mv0SpJ6EwyMA, K4xJTgeZSruJdHQQGogINw, eYOlbDg9SNiyo99XGNM7hA)
  • test-macosx1470-64/debug-web-platform-tests-webgpu-backlog-23 - 3 of 3 failed on the same (retriggered) task (failed: XoZr20yOQaqiMlir5FlHRw, Yf_eJCtlRoelNFtVtXEI0w, Oe_-5cgETK-ZWPnEALqVpA)
  • test-macosx1470-64/opt-web-platform-tests-webgpu-backlog-5 - 2 of 3 failed on the same (retriggered) task (failed: VCwO5ufsSDWJOEi6WVDQXA, L0-pzCr-RxmMx2W-IVGU2Q)
  • test-macosx1470-64/opt-web-platform-tests-webgpu-backlog-17 - 2 of 3 failed on the same (retriggered) task (failed: RmsDccjESFqc7tPzuzoMFQ, TsJC3eD0TbCL8ZxSsozm4Q)
  • test-macosx1470-64/opt-web-platform-tests-webgpu-backlog-23 - 3 of 3 failed on the same (retriggered) task (failed: E3Gb_gbBRHS5-5QP7aCj-w, SP9F-CSYSt6qLVSvT0y3CA, BCxE3i_jSsaYl3kosSG9HA)
  • test-macosx1470-64/opt-web-platform-tests-webgpu-backlog-long-4 - 3 of 3 failed on the same (retriggered) task (failed: eBzmnE6MRjyTEWqJ8KwBpQ, UOgCflbuRzaAqtCtUd_D_w, dmbDGWk3RoqMmqyZzbLsqQ)
  • test-macosx1470-64/opt-web-platform-tests-webgpu-backlog-long-5 - 3 of 3 failed on the same (retriggered) task (failed: KrBoRpWXTwyAtYQpqnpfzg, OYhJPIENRmO8lTK3ybyEVg, H_37y-JfR2aOUWZ-xf8DMw)
  • test-windows11-64-24h2/debug-web-platform-tests-webgpu-backlog-4 - 3 of 3 failed on the same (retriggered) task (failed: Ne2wps5VQZeNCBCqG2029A, WvZicWi9RISM6bsbTUvoKA, G8fzMMi0RjyOuU2PqjQPzw)
  • test-windows11-64-24h2/debug-web-platform-tests-webgpu-backlog-long-4 - 2 of 3 failed on the same (retriggered) task (failed: FnG24xwGQlCqv7R4BpAJ6w, Gc8qoa7ZQhyKrkY45YHxfw)
  • test-windows11-64-24h2/debug-web-platform-tests-webgpu-backlog-7 - 3 of 3 failed on the same (retriggered) task (failed: ZkNClpalQMWQli12TO9B3g, GLwbEw2nRZSH7miM_JjsJQ, E6gfL_XpT2KM9hB0vBcMpg)

Known Issues:

  • test-linux2204-64-wayland/debug-web-platform-tests-webgpu-backlog-15 - 1 of 3 failed on the same (retriggered) task (failed: MneBhvEoQ5u7ij3ta_VVIQ)
  • test-linux2204-64-wayland/debug-web-platform-tests-webgpu-backlog-long-2 - 2 of 3 failed on the same (retriggered) task (failed: aKOIRb1JSPSopyAgXFTb9w, AcWkGy10RgilM3siMeTiUQ)
  • test-linux2204-64-wayland/debug-web-platform-tests-webgpu-backlog-long-1 - 2 of 3 failed on the same (retriggered) task (failed: N-GQv56HQkqaN5v1M4sSQg, a1-mwnxyQSucWyodnETdeA)
  • test-windows11-64-24h2/opt-web-platform-tests-webgpu-backlog-long-1 - 2 of 3 failed on the same (retriggered) task (failed: A_Deo7RCRf6PBz3VZk1zaQ, ZhuzIa1MSuO158CtqAcDzw)
  • test-macosx1470-64/debug-web-platform-tests-webgpu-backlog-2 - 1 of 3 failed on the same (retriggered) task (failed: aL0llBB3TnOm8QFDeQi4pg)
  • test-windows11-64-24h2/opt-web-platform-tests-webgpu-backlog-3 - 1 of 3 failed on the same (retriggered) task (failed: DWVWCiLfSAymdxzPVnoJLQ)
  • test-linux2204-64-wayland/opt-web-platform-tests-webgpu-backlog-18 - 1 of 3 failed on the same (retriggered) task (failed: Jq9nvQ3bQ9-SdMvnqw0_vQ)
  • test-macosx1470-64/debug-web-platform-tests-webgpu-backlog-25 - 1 of 3 failed on the same (retriggered) task (failed: DcJcXVKHSgSmCTJt4vmRvA)
  • test-macosx1470-64/debug-web-platform-tests-webgpu-backlog-19 - 1 of 3 failed on the same (retriggered) task (failed: fz7UuECoS9aejEZpLxeTlA)
  • test-macosx1470-64/opt-web-platform-tests-webgpu-backlog-long-1 - 1 of 3 failed on the same (retriggered) task (failed: Aacb9BZ1SF-xlar4295zYg)
  • test-macosx1470-64/opt-web-platform-tests-webgpu-1 - 1 of 3 failed on the same (retriggered) task (failed: DgUdEOQsSjanFKjVBC830Q)
  • test-windows11-64-24h2/debug-web-platform-tests-webgpu-backlog-14 - 1 of 3 failed on the same (retriggered) task (failed: Alz3_5j5Squdv7dJ1aQ7ng)
  • test-windows11-64-24h2/debug-web-platform-tests-webgpu-backlog-long-2 - 1 of 3 failed on the same (retriggered) task (failed: GrbjL4gFSqi19vFYItRR0w)
  • test-windows11-64-24h2/debug-web-platform-tests-webgpu-backlog-long-3 - 1 of 3 failed on the same (retriggered) task (failed: EOl6AuPvS1SZnG0aeE50Qg)

These failures could mean that the library update changed something and caused
tests to fail. You'll need to review them yourself and decide where to go from here.

In either event, I have done all I can and you will need to take it from here. If you
don't want to land my patch, you can replicate it locally for editing with
./mach vendor dom/webgpu/tests/cts/moz.yaml

When reviewing, please note that this is external code, which needs a full and
careful inspection - not a rubberstamp.

Flags: needinfo?(egubler)
Flags: needinfo?(egubler)
Attachment #9541989 - Attachment description: Bug 2014043 - Update WebGPU CTS to 5cfc580345c90401bfe6d2ac4133d28051b3e0f6 → Bug 2014043 - Update WebGPU CTS to 5cfc580345c90401bfe6d2ac4133d28051b3e0f6 r=#webgpu-reviewers!
Pushed by aleiserson@mozilla.com: https://github.com/mozilla-firefox/firefox/commit/5400cc6cbe5c https://hg.mozilla.org/integration/autoland/rev/275eb46e234c Update WebGPU CTS to 5cfc580345c90401bfe6d2ac4133d28051b3e0f6 r=webgpu-reviewers,ErichDonGubler
Status: NEW → RESOLVED
Closed: 4 months ago
Resolution: --- → FIXED
Target Milestone: --- → 149 Branch
Pushed by nfay@mozilla.com: https://github.com/mozilla-firefox/firefox/commit/11232a627111 https://hg.mozilla.org/integration/autoland/rev/0482340fe212 Revert "Bug 2014043 - Additional WebGPU CTS expectation updates r=webgpu-reviewers,teoxoy" for causing bustage @ AccessibleTableCell.h.stub

Backed out latest changeset for causing bustage @ AccessibleTableCell.h.stub

Backout link

Push with failures

Failure log

Flags: needinfo?(aleiserson)
Status: RESOLVED → REOPENED
Flags: needinfo?(aleiserson)
Resolution: FIXED → ---
Target Milestone: 149 Branch → ---
Status: REOPENED → RESOLVED
Closed: 4 months ago4 months ago
Resolution: --- → FIXED
Target Milestone: --- → 149 Branch
QA Whiteboard: [qa-triage-done-c150/b149]
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: