Closed Bug 2042580 Opened 1 month ago Closed 1 month ago

Update WebGPU CTS to new version 9a848e6eae8bc1efda4908fd3f2e194bebf8d2c7 from 2026-05-26 01:12:13

Categories

(Core :: Graphics: WebGPU, enhancement)

enhancement

Tracking

()

RESOLVED FIXED
153 Branch
Tracking Status
firefox153 --- fixed

People

(Reporter: update-bot, Assigned: aleiserson)

References

(Blocks 1 open bug)

Details

(Whiteboard: [3pl-filed][task_id: UDjP9au1Qdyx9bQQ_rTXJA])

Attachments

(1 file)

This update covers 4 commits. Here are the overall diff statistics, and then the commit information.


dom/webgpu/tests/cts/checkout/src/webgpu/api/validation/capability_checks/features/subgroup_size_control.spec.ts | 22 ++
dom/webgpu/tests/cts/checkout/src/webgpu/api/validation/createTexture.spec.ts | 53 +++++
dom/webgpu/tests/cts/checkout/src/webgpu/shader/execution/shader_io/compute_builtins.spec.ts | 106 ++++++++++
dom/webgpu/tests/cts/checkout/src/webgpu/shader/validation/extension/subgroup_size_control.spec.ts | 103 +++++++++
dom/webgpu/tests/cts/checkout/tools/gen_version | 2 +-
dom/webgpu/tests/cts/moz.yaml | 4 +-
testing/web-platform/mozilla/tests/webgpu/common/internal/version.js | 2 +-
testing/web-platform/mozilla/tests/webgpu/cts/webgpu/api/validation/capability_checks/features/subgroup_size_control/cts.https.html | 36 +++
testing/web-platform/mozilla/tests/webgpu/cts/webgpu/api/validation/createTexture/cts.https.html | 1 +
testing/web-platform/mozilla/tests/webgpu/cts/webgpu/shader/execution/shader_io/compute_builtins/cts.https.html | 1 +
testing/web-platform/mozilla/tests/webgpu/cts/webgpu/shader/validation/extension/subgroup_size_control/cts.https.html | 38 +++
testing/web-platform/mozilla/tests/webgpu/webgpu/api/validation/capability_checks/features/subgroup_size_control.spec.js | 22 ++
testing/web-platform/mozilla/tests/webgpu/webgpu/api/validation/createTexture.spec.js | 53 +++++
testing/web-platform/mozilla/tests/webgpu/webgpu/listing.js | 17 +
testing/web-platform/mozilla/tests/webgpu/webgpu/shader/execution/shader_io/compute_builtins.spec.js | 106 ++++++++++
testing/web-platform/mozilla/tests/webgpu/webgpu/shader/validation/extension/subgroup_size_control.spec.js | 103 +++++++++
testing/web-platform/mozilla/tests/webgpu/webgpu/webworker/api/validation/capability_checks/features/subgroup_size_control.as_worker.js | 6 +
testing/web-platform/mozilla/tests/webgpu/webgpu/webworker/shader/validation/extension/subgroup_size_control.as_worker.js | 6 +
18 files changed, 677 insertions(+), 4 deletions(-)


9a848e6eae8bc1efda4908fd3f2e194bebf8d2c7 by Jiawei Shao <jiawei.shao@intel.com>

https://github.com/gpuweb/cts/commit/9a848e6eae8bc1efda4908fd3f2e194bebf8d2c7
Authored: 2026-05-26 09:12:13 +0800
Committed: 2026-05-26 09:12:13 +0800

Add shader execution tests on the feature subgroup-size-control (#4643)

  • Add shader execution tests on the feature subgroup-size-control

This patch adds the shader execution tests on the feature
subgroup-size-control:

  • The value of the built-in variable subgroup_size must equal the
    value of the @subgroup_size attribute.
  • At least one value in the range of [GPUAdapterInfo.subgroupMinSize,
    GPUAdapterInfo.subgroupMaxSize] can be used as @subgroup_size
    attribute in a simple compute pipeline.
  • Address reviewer's comments

  • Address reviewer's comments

Files Modified:

  • src/webgpu/shader/execution/shader_io/compute_builtins.spec.ts

d5d1f9df601c1976cbb3228c60b18f2394819483 by Jiawei Shao <jiawei.shao@intel.com>

https://github.com/gpuweb/cts/commit/d5d1f9df601c1976cbb3228c60b18f2394819483
Authored: 2026-05-23 07:18:32 +0800
Committed: 2026-05-22 23:18:32 +0000

Add API validation tests on the extension subgroup-size-control (#4642)

This patch adds the API validation tests on the extension
subgroup-size-control:

  • Enabling subgroup-size-control on the creation of device should
    also enable subgroups.

Files Added:

  • src/webgpu/api/validation/capability_checks/features/subgroup_size_control.spec.ts

f72cf53bbe836884577c443ee71d5a59e1b60730 by Kai Ninomiya <kainino@chromium.org>

https://github.com/gpuweb/cts/commit/f72cf53bbe836884577c443ee71d5a59e1b60730
Authored: 2026-05-21 14:13:14 -0700
Committed: 2026-05-21 14:13:14 -0700

Test viewFormats with TRANSIENT_ATTACHMENT (#4647)

  • Test viewFormats with TRANSIENT_ATTACHMENT

This should not be allowed.

Issue: https://github.com/gpuweb/gpuweb/issues/6263

  • also see what happens if we do try to create a view

  • fix for compat

Files Modified:

  • src/webgpu/api/validation/createTexture.spec.ts

f08551b0fc4d6cfa5ba582a0235b571aa363102d by Jiawei Shao <jiawei.shao@intel.com>

https://github.com/gpuweb/cts/commit/f08551b0fc4d6cfa5ba582a0235b571aa363102d
Authored: 2026-05-20 02:39:32 +0800
Committed: 2026-05-19 18:39:32 +0000

Add shader validation tests on subgroup-size-control - Part I (#4641)

  • Add shader validation tests on subgroup-size-control - Part I

This patch adds the first part of the shader validation tests on
the extension subgroup-size-control:

  • Enabling subgroup_size_control must also enable subgroups.
  • The WGSL attribute @subgroup_size must be used when
    subgroup_size_control is enabled.
  • @subgroup_size can only be used in the compute stage

issue: #4640

  • Fix comments

  • Address reviewer's comments

Files Added:

  • src/webgpu/shader/validation/extension/subgroup_size_control.spec.ts

The try push is done, we found jobs with unclassified failures.

Needs Close Investigation:

  • _mozilla/webgpu/cts/webgpu/api/operation/command_buffer/copyTextureToTexture/cts.https.html?q=webgpu:api,operation,command_buffer,copyTextureToTexture:color_textures,compressed,non_array:*

    • 1 of 3 failed on the same (retriggered) task
      - test-windows11-64-25h2/debug-web-platform-tests-webgpu-10 (YZpP4qmGR4mr9PlgU65hrQ)
  • _mozilla/webgpu/cts/webgpu/api/validation/createTexture/cts.https.html?q=webgpu:api,validation,createTexture:transient_viewFormats:*

    • 18 of 18 failed on different tasks
      - test-windows11-64-25h2/opt-web-platform-tests-webgpu-10 (QdkDqbNLQgeKQNKCyLSlKg)
      - test-windows11-64-25h2/opt-web-platform-tests-webgpu-10 (cROUZcNZQL652cJOE1nWSg)
      - test-windows11-64-25h2/opt-web-platform-tests-webgpu-10 (P7ZpawlpT16y-a4TTfvX_A)
      - test-macosx1470-64/debug-web-platform-tests-webgpu-7 (Rp42VuD0SM28EQfY2mzpWQ)
      - test-macosx1470-64/debug-web-platform-tests-webgpu-7 (VABmUEtSTE28nH3aO06Skw)
      - test-macosx1470-64/debug-web-platform-tests-webgpu-7 (fSHbOJCaQeeY4OurONC5nA)
      - test-windows11-64-25h2/debug-web-platform-tests-webgpu-11 (NUGE5P9iTxqtojNRI8Zdeg)
      - test-windows11-64-25h2/debug-web-platform-tests-webgpu-11 (SYUMwg7HRsyhe70pzlPL-Q)
      - test-windows11-64-25h2/debug-web-platform-tests-webgpu-11 (d8ZXXU6sRzm0st45Ebt4nA)
      - test-macosx1470-64/opt-web-platform-tests-webgpu-11 (NhtJTQdESp-1qzl664FuLw)
      - test-macosx1470-64/opt-web-platform-tests-webgpu-11 (brfoW3ynTd60dhv2ellvJw)
      - test-macosx1470-64/opt-web-platform-tests-webgpu-11 (b9kcBy-rTTS46ds90pH3zg)
      - test-linux2404-64/opt-web-platform-tests-webgpu-3 (Mjcx7mw8Timcv1q0JkOR7Q)
      - test-linux2404-64/opt-web-platform-tests-webgpu-3 (LZz-B50UTUOvmz0nd0YOdA)
      - test-linux2404-64/opt-web-platform-tests-webgpu-3 (dQ6EmEJPQFWU-Kkk94-6KA)
      - test-linux2404-64/debug-web-platform-tests-webgpu-9 (LlDbusOFQ1uC5WeOqvUHjg)
      - test-linux2404-64/debug-web-platform-tests-webgpu-9 (S3xxMvFkTsO1zO185B6t6A)
      - test-linux2404-64/debug-web-platform-tests-webgpu-9 (eq6QBP4MQ6CD-7Hqbwh9kw)
  • test-linux2404-64/opt-web-platform-tests-webgpu-backlog-long-1 - 3 of 3 failed on the same (retriggered) task (failed: B9muT8HhTxCLf00Xxquz5w, AE1U4_olTYeijfGUiIizJQ, QslREEz-RZuhbsK8z5mqnw)

  • test-macosx1470-64/debug-web-platform-tests-webgpu-backlog-25 - 3 of 3 failed on the same (retriggered) task (failed: QEjdmVsaT5qJwFInDucXLw, QoR6v3EUQcK70M6PYGaB9A, Lsg9RuFBR0ixTUS2g7VCig)

  • test-linux2404-64/debug-web-platform-tests-webgpu-backlog-2 - 3 of 3 failed on the same (retriggered) task (failed: BripahvwTkq9VXDpJUd64Q, LRTeP7SNQPeC6mii5tSZCg, cY7WFOW9QiGCQeoqynL7Rg)

  • test-macosx1470-64/opt-web-platform-tests-webgpu-backlog-long-4 - 1 of 3 failed on the same (retriggered) task (failed: VSJpBgXvRPGXmTXPKl8eYA)

  • test-linux2404-64/debug-web-platform-tests-webgpu-backlog-3 - 3 of 3 failed on the same (retriggered) task (failed: Xc4YHl7CQx-6a4nHuQfPGg, G235gHtyRD-FmhWwE1r9VQ, FSPHHMmhTD-HnO7KexViuA)

  • test-linux2404-64/debug-web-platform-tests-webgpu-backlog-long-4 - 3 of 3 failed on the same (retriggered) task (failed: ZlDI-DjISi-E-Z_9yve1pw, YXQu4ftFSWu7z9s25fn5ew, GnjN-YCzSquLguQqKMn67A)

  • test-windows11-64-25h2/debug-web-platform-tests-webgpu-backlog-18 - 2 of 3 failed on the same (retriggered) task (failed: ND0QRwH1RoeJcyP9zGxYHg, VK3KswiRSwq2ETHjHHlGIA)

  • test-windows11-64-25h2/debug-web-platform-tests-webgpu-backlog-long-1 - 3 of 3 failed on the same (retriggered) task (failed: Mc-fklWkQFWlBoe3PbdcEQ, UqL1VfCdSaiwV0xv9VrH3Q, CF0nEXqvTIafPJd1Ju-i0A)

  • test-linux2404-64/debug-web-platform-tests-webgpu-backlog-5 - 2 of 3 failed on the same (retriggered) task (failed: XLGv4r6LQw2Sjv1-cJdm9A, JOxFqf1wSgSqRerX66ExNw)

  • test-macosx1470-64/debug-web-platform-tests-webgpu-backlog-23 - 3 of 3 failed on the same (retriggered) task (failed: OEGYS5fFQ1qauXTchoEbWg, dfVR97JfQma2X21VLuN_sg, OqQIfctlRVm2YPo_CseCeg)

  • test-windows11-64-25h2/debug-web-platform-tests-webgpu-backlog-13 - 3 of 3 failed on the same (retriggered) task (failed: Pw-M4zURRVK0frzId4Wx_w, BDyBUTxFQz-XhgQ5RJsJgw, JVYr8u-ORJ-caq2lC9yq4A)

  • test-windows11-64-25h2/opt-web-platform-tests-webgpu-backlog-11 - 1 of 3 failed on the same (retriggered) task (failed: V6EyKMV7S9i5QaHKLHpDeA)

  • test-linux2404-64/debug-web-platform-tests-webgpu-backlog-long-1 - 3 of 3 failed on the same (retriggered) task (failed: E7rXPbE0S7yJHQoXs3AC7Q, eKaGTTrtSiutFLbk-YRBNA, a9nlNr1ORMKh6ZVynBwxlQ)

  • test-macosx1470-64/opt-web-platform-tests-webgpu-backlog-24 - 1 of 3 failed on the same (retriggered) task (failed: ZxUCiYWRQ9CoCCrHXp_WXQ)

  • test-windows11-64-25h2/opt-web-platform-tests-webgpu-backlog-long-6 - 2 of 3 failed on the same (retriggered) task (failed: UWpdpIYbRcyd0ICcjgnSWA, Tk-A93fRRlClHYmsDezU8Q)

  • test-macosx1470-64/debug-web-platform-tests-webgpu-backlog-19 - 1 of 3 failed on the same (retriggered) task (failed: WFAW9RNXRvmMmUYyRRy3Vg)

Needs Investigation (Possible Intermittents):

  • test-macosx1470-64/opt-web-platform-tests-webgpu-1 - 1 of 3 failed on the same (retriggered) task (failed: B2y6j0JaSoqyl2aFodmYgg)
  • test-macosx1470-64/opt-web-platform-tests-webgpu-4 - 1 of 3 failed on the same (retriggered) task (failed: cjYk__8CRq-pp65HOIGDTg)

Known Issues:

  • test-linux2404-64/opt-web-platform-tests-webgpu-backlog-10 - 1 of 3 failed on the same (retriggered) task (failed: SbGICTYKRQqxmhe7Go-3DQ)
  • test-linux2404-64/opt-web-platform-tests-webgpu-backlog-long-3 - 1 of 3 failed on the same (retriggered) task (failed: YqEWfCrvQJ-s2Kc2rzpwIQ)
  • test-macosx1470-64/opt-web-platform-tests-webgpu-backlog-7 - 1 of 3 failed on the same (retriggered) task (failed: dk6JbfYFTCOCkgPj3B9Hew)
  • test-windows11-64-25h2/debug-web-platform-tests-webgpu-backlog-long-2 - 2 of 3 failed on the same (retriggered) task (failed: a78r6kyYSd2sU86cCgRURQ, O8QCymh9SpmdkdJZtFncfQ)
  • test-macosx1470-64/opt-web-platform-tests-webgpu-backlog-6 - 1 of 3 failed on the same (retriggered) task (failed: fINjUXCuRtWAmhgGNwwluw)
  • test-windows11-64-25h2/debug-web-platform-tests-webgpu-backlog-long-5 - 2 of 3 failed on the same (retriggered) task (failed: TnJonXEMRB-QCzBhCTgZ6g, dhrTv3czTfuZ5njvVEKJQQ)
  • test-macosx1470-64/opt-web-platform-tests-webgpu-7 - 1 of 3 failed on the same (retriggered) task (failed: CUtKf-A7TImfSSPyx35f1A)
  • test-windows11-64-25h2/debug-web-platform-tests-webgpu-backlog-long-4 - 1 of 3 failed on the same (retriggered) task (failed: c8o7yha-RfiwmGMi85gHJw)
  • test-windows11-64-25h2/opt-web-platform-tests-webgpu-backlog-long-1 - 1 of 3 failed on the same (retriggered) task (failed: QOm4r3-xRLurlQB9yZBIZg)
  • test-macosx1470-64/debug-web-platform-tests-webgpu-backlog-20 - 2 of 3 failed on the same (retriggered) task (failed: K5k5Mg4NQK-w4IlfdTrmog, AJWRBjSERXOZw9ln47rNGg)
  • test-macosx1470-64/debug-web-platform-tests-webgpu-11 - 1 of 3 failed on the same (retriggered) task (failed: Lz2NrFbxSG2ePaZEcmmZpQ)
  • test-macosx1470-64/debug-web-platform-tests-webgpu-backlog-long-4 - 2 of 3 failed on the same (retriggered) task (failed: Mf3T1jNxS0mR10hfKO3kiQ, IIo1bQJMRnGAGV3Iwq2Eug)
  • test-linux2404-64/debug-web-platform-tests-webgpu-backlog-long-3 - 2 of 3 failed on the same (retriggered) task (failed: CRp2ondwTWyBlwLFosJA-g, fpm2NOKWRGa4LY-sKnYOSw)
  • test-windows11-64-25h2/debug-web-platform-tests-webgpu-14 - 1 of 3 failed on the same (retriggered) task (failed: Ad5W6Q7XTiuZpp1_IcwInA)
  • test-macosx1470-64/debug-web-platform-tests-webgpu-backlog-long-5 - 1 of 3 failed on the same (retriggered) task (failed: JdJ6AXGnQESlUpbPa2PvyA)
  • test-macosx1470-64/debug-web-platform-tests-webgpu-8 - 1 of 3 failed on the same (retriggered) task (failed: FOwTlnKOSKK68rUSbYG_Lg)
  • test-windows11-64-25h2/debug-web-platform-tests-webgpu-6 - 1 of 3 failed on the same (retriggered) task (failed: bJF5pXlcRiW1EMCEhVnS0w)
  • test-macosx1470-64/debug-web-platform-tests-webgpu-backlog-long-3 - 2 of 3 failed on the same (retriggered) task (failed: JLfXx9rDRNmSzLN9n5KVFQ, Ajom3aSHQZaIX0t9K-m16w)
  • test-windows11-64-25h2/debug-web-platform-tests-webgpu-backlog-long-6 - 2 of 3 failed on the same (retriggered) task (failed: ZmBX8FvSSqenEJ8ld05q0A, LspLli1qRv2uGcGTtCWLjw)
  • test-macosx1470-64/debug-web-platform-tests-webgpu-backlog-11 - 1 of 3 failed on the same (retriggered) task (failed: CzAtYHATQoCHXXy8GBxaGg)

These failures could mean that the library update changed something and caused
tests to fail. You'll need to review them yourself and decide where to go from here.

In either event, I have done all I can and you will need to take it from here. If you
don't want to land my patch, you can replicate it locally for editing with
./mach vendor dom/webgpu/tests/cts/moz.yaml

When reviewing, please note that this is external code, which needs a full and
careful inspection - not a rubberstamp.

Assignee: nobody → egubler
Flags: needinfo?(egubler)
Assignee: egubler → aleiserson
Flags: needinfo?(egubler)
Attachment #9589993 - Attachment description: Bug 2042580 - Update WebGPU CTS to 9a848e6eae8bc1efda4908fd3f2e194bebf8d2c7 → Bug 2042580 - Update WebGPU CTS to 9a848e6eae8bc1efda4908fd3f2e194bebf8d2c7 r=#webgpu-reviewers
Pushed by aleiserson@mozilla.com: https://github.com/mozilla-firefox/firefox/commit/b673b592e920 https://hg.mozilla.org/integration/autoland/rev/fa3dfba75836 Update WebGPU CTS to 9a848e6eae8bc1efda4908fd3f2e194bebf8d2c7 r=webgpu-reviewers,nical
Status: NEW → RESOLVED
Closed: 1 month ago
Resolution: --- → FIXED
Target Milestone: --- → 153 Branch
QA Whiteboard: [qa-triage-done-c154/b153]
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: