1885257 - [wpt-sync] Sync PR 45100 - webnn: add concat validation tests in WPT

Status: RESOLVED FIXED

(Testing :: web-platform-tests, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 45100 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/45100
Details from upstream follow.

mei1127 <[e-mail]> wrote:

webnn: add concat validation tests in WPT

This CL adds WPT tests for concat and removes the unit tests MLGraphBuilderTest.ConcatTest and MLGraphTestMojo.ConcatTest.

Bug: 327337525, 328026885
Change-Id: I6dc130211693ca6c215f91ff4cf43fc7df13eafa
Reviewed-on: https://chromium-review.googlesource.com/5371168
WPT-Export-Revision: d182d55efd2a7386c1673d94cc4f347d5dd7972c

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=dd32423b0c9793c490f5dfa5634423e4f681e65f

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

CI Results

Ran 8 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 2 tests and 11 subtests

Status Summary

Firefox

OK : 2
PASS: 2
FAIL: 20

Chrome

OK : 2
PASS: 10
FAIL: 12

Safari

OK : 2
PASS: 2
FAIL: 20

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

• /webnn/validation_tests/concat.https.any.worker.html [wpt.fyi]: OK [Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-64-2009-qr-debug] (Chrome: OK, Safari: OK)
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with one input.: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with two inputs: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with three inputs: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with two 1D inputs.: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Throw if the argument types are inconsistent.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if the inputs have different ranks.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if the axis is equal to or greater than the size of ranks: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if concat with two 0-D scalars.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if the inputs have other axes with different sizes except on the axis.: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/concat.https.any.html [wpt.fyi]: OK [Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-64-2009-qr-debug] (Chrome: OK, Safari: OK)
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with one input.: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with two inputs: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with three inputs: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with two 1D inputs.: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Throw if the argument types are inconsistent.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if the inputs have different ranks.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if the axis is equal to or greater than the size of ranks: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if concat with two 0-D scalars.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if the inputs have other axes with different sizes except on the axis.: FAIL (Chrome: FAIL, Safari: FAIL)

Tests Disabled in Gecko Infrastructure

• /webnn/validation_tests/concat.https.any.worker.html [wpt.fyi]: OK [Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-64-2009-qr-debug] (Chrome: OK, Safari: OK)
• /webnn/validation_tests/concat.https.any.html [wpt.fyi]: OK [Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-opt, GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-64-2009-qr-debug] (Chrome: OK, Safari: OK)

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/52fe28f013da
[wpt PR 45100] - webnn: Migrate concat validation tests to WPTs, a=testonly
https://hg.mozilla.org/integration/autoland/rev/10e89b6a2538
[wpt PR 45100] - Update wpt metadata, a=testonly

Comment 4

[Cristian Tuns]

https://hg.mozilla.org/mozilla-central/rev/52fe28f013da
https://hg.mozilla.org/mozilla-central/rev/10e89b6a2538