1896801 - [wpt-sync] Sync PR 46274 - webnn: Migrate BatchNormalization validation tests to WPTs

Status: RESOLVED FIXED

(Testing :: web-platform-tests, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 46274 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/46274
Details from upstream follow.

mei1127 <[e-mail]> wrote:

webnn: Migrate BatchNormalization validation tests to WPTs

This CL adds WPT tests for BatchNormalization and removes the unit tests
MLGraphTestMojo.BatchNormalizationTest and
MLGraphBuilderTest.BatchNormalizationTest.

Bug: 327337526, 328026885
Change-Id: Idb18eecdb85ff6dc60a682266c4b41afe06e3532

Reviewed-on: https://chromium-review.googlesource.com/5541389
WPT-Export-Revision: 7ffd8334fdcea8e0227638f3f221da17b6b84647

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=e978058d13078199d799893399de6941e6b9bd09

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

CI Results

Ran 9 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 2 tests and 23 subtests

Status Summary

Firefox

OK : 2
FAIL: 46

Chrome

OK : 2
PASS: 18
FAIL: 28

Safari

OK : 2
FAIL: 46

Links

Gecko CI (Treeherder)
GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

• /webnn/validation_tests/batchNormalization.https.any.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] throw if mean is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] throw if variance is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] throw if scale option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] throw if bias option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] throw if activation option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] Test with default options.: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] Test with axis = 2 and epsilon = 0.0001.: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] Throw if the input data type is not one of floating point types.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the mean data type is not the same as the input data type.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the mean operand is not a 1-D tensor.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the size of mean operand is not equal to the size of the input dimension denoted by axis.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the variance data type is not the same as the input data type.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the variance operand is not a 1-D tensor.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the size of variance operand is not equal to the size of the input dimension denoted by axis.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the scale data type is not the same as the input data type.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the scale operand is not a 1-D tensor.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the size of scale operand is not equal to the size of the input dimension denoted by axis.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the bias data type is not the same as the input data type.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the bias operand is not a 1-D tensor.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the size of bias operand is not equal to the size of the input dimension denoted by axis.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the value of axis is not in the range of [0,N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/batchNormalization.https.any.worker.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] throw if mean is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] throw if variance is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] throw if scale option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] throw if bias option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] throw if activation option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] Test with default options.: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] Test with axis = 2 and epsilon = 0.0001.: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] Throw if the input data type is not one of floating point types.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the mean data type is not the same as the input data type.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the mean operand is not a 1-D tensor.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the size of mean operand is not equal to the size of the input dimension denoted by axis.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the variance data type is not the same as the input data type.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the variance operand is not a 1-D tensor.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the size of variance operand is not equal to the size of the input dimension denoted by axis.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the scale data type is not the same as the input data type.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the scale operand is not a 1-D tensor.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the size of scale operand is not equal to the size of the input dimension denoted by axis.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the bias data type is not the same as the input data type.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the bias operand is not a 1-D tensor.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the size of bias operand is not equal to the size of the input dimension denoted by axis.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] Throw if the value of axis is not in the range of [0,N-1].: FAIL (Chrome: FAIL, Safari: FAIL)

Tests Disabled in Gecko Infrastructure

• /webnn/validation_tests/batchNormalization.https.any.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)
• /webnn/validation_tests/batchNormalization.https.any.worker.html [wpt.fyi]: OK [GitHub], SKIP [Gecko-android-em-7.0-x86_64-lite-qr-opt-geckoview, Gecko-android-em-7.0-x86_64-qr-debug-geckoview, Gecko-android-em-7.0-x86_64-qr-opt-geckoview, Gecko-linux1804-64-qr-debug, Gecko-linux1804-64-qr-opt, Gecko-windows11-32-2009-qr-debug, Gecko-windows11-32-2009-qr-opt, Gecko-windows11-64-2009-qr-debug, Gecko-windows11-64-2009-qr-opt] (Chrome: OK, Safari: OK)

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/8f3d4a671422
[wpt PR 46274] - webnn: Migrate BatchNormalization validation tests to WPTs, a=testonly

Comment 4

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/8f3d4a671422