1890913 - [wpt-sync] Sync PR 45659 - webnn: Migrate instanceNormalization validation tests to WPTs

Status: RESOLVED FIXED

(Testing :: web-platform-tests, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 45659 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/45659
Details from upstream follow.

mei1127 <[e-mail]> wrote:

webnn: Migrate instanceNormalization validation tests to WPTs

This CL adds WPT tests for Conv2d and removes the unit tests
MLGraphBuilderTest.InstanceNormalizationTest, and
MLGraphTestMojo.InstanceNormalizationTest.

Bug: 327337526, 328026885
Change-Id: Ib494a8e472683366d616f70cb728d46d5422df43
Reviewed-on: https://chromium-review.googlesource.com/5444311
WPT-Export-Revision: 5825c0235e15646964c6e79cb42d4e74ddc3e046

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=171dbac49cea41cf4d7a0a80996c754c2bc52388

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 2 tests and 19 subtests

Status Summary

Firefox

OK : 2
FAIL: 38

Chrome

OK : 2
PASS: 18
FAIL: 20

Safari

OK : 2
FAIL: 38

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

• /webnn/validation_tests/instanceNormalization.https.any.worker.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] throw if scale option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] throw if bias option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] Test with default options for 4-D input.: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] Test with scale, bias and default epsilon value.: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] Test with a non-default epsilon value.: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] Test with layout=nhwc.: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] Test when the input data type is float16.: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] Throw if the input is not a 4-D tensor.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the input data type is not one of floating point types.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the scale data type is not the same as the input data type.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the scale operand is not a 1-D tensor.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the size of scale operand is not equal to the size of the feature dimension of the input with layout=nhwc.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the size of scale operand is not equal to the size of the feature dimension of the input with layout=nchw.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the bias data type is not the same as the input data type.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the bias operand is not a 1-D tensor.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the size of bias operand is not equal to the size of the feature dimension of the input with layout=nhwc.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the size of bias operand is not equal to the size of the feature dimension of the input with layout=nchw.: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/instanceNormalization.https.any.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] throw if scale option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] throw if bias option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] Test with default options for 4-D input.: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] Test with scale, bias and default epsilon value.: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] Test with a non-default epsilon value.: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] Test with layout=nhwc.: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] Test when the input data type is float16.: FAIL (Chrome: PASS, Safari: FAIL)
  • [instanceNormalization] Throw if the input is not a 4-D tensor.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the input data type is not one of floating point types.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the scale data type is not the same as the input data type.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the scale operand is not a 1-D tensor.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the size of scale operand is not equal to the size of the feature dimension of the input with layout=nhwc.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the size of scale operand is not equal to the size of the feature dimension of the input with layout=nchw.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the bias data type is not the same as the input data type.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the bias operand is not a 1-D tensor.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the size of bias operand is not equal to the size of the feature dimension of the input with layout=nhwc.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [instanceNormalization] Throw if the size of bias operand is not equal to the size of the feature dimension of the input with layout=nchw.: FAIL (Chrome: FAIL, Safari: FAIL)

Tests Disabled in Gecko Infrastructure

• /webnn/validation_tests/instanceNormalization.https.any.worker.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
• /webnn/validation_tests/instanceNormalization.https.any.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/5d8005a3df1a
[wpt PR 45659] - webnn: Migrate instanceNormalization validation tests to WPTs, a=testonly

Comment 4

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/5d8005a3df1a