Closed Bug 1893917 Opened 10 months ago Closed 9 months ago

[wpt-sync] Sync PR 45949 - webnn: Migrate Reduce validation tests to WPTs

Categories

(Testing :: web-platform-tests, task, P4)

Product:
Testing
Component:
web-platform-tests
Type:
task

Tracking

(firefox128 fixed)

Status:
RESOLVED FIXED
Milestone:
128 Branch
Tracking Flags:
Tracking Status
firefox128 --- fixed

People

(Reporter: wpt-sync, Unassigned)

References

(
URL
)

Details

(Whiteboard: [wptsync downstream])

Sync web-platform-tests PR 45949 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/45949
Details from upstream follow.

mei1127 <shanxing.mei@intel.com> wrote:

webnn: Migrate Reduce validation tests to WPTs

This CL adds WPT tests for reduce and removes the unit tests
MLGraphBuilderTest.ReduceTest, MLGraphTestMojo.ReduceTest and
MLGraphTest.ReduceTest.

Bug: 327337526, 328026885
Change-Id: I26717e0ffdbd2b5cd18f70fb9cefba5d9e719a69
Reviewed-on: https://chromium-review.googlesource.com/5496312
WPT-Export-Revision: 66eca2559d56a4a4b089a28377db631873180835

CI Results

Ran 0 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 2 tests and 81 subtests

Status Summary

Firefox

OK : 2
FAIL: 162

Chrome

OK : 2
PASS: 114
FAIL: 48

Safari

OK : 2
FAIL: 162

Links

GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

  • /webnn/validation_tests/reduction.https.any.html [wpt.fyi]
    • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL1] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL1] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL1] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL1] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL1] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL1] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceL1] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceL2] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL2] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL2] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL2] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL2] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL2] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceL2] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceLogSum] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSum] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSum] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSum] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSum] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSum] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceLogSum] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceLogSumExp] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSumExp] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSumExp] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSumExp] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSumExp] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSumExp] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceLogSumExp] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceMax] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMax] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMax] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMax] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMax] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMax] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceMax] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceMean] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMean] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMean] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMean] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMean] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMean] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceMean] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceMin] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMin] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMin] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMin] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMin] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMin] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceMin] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceProduct] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceProduct] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceProduct] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceProduct] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceProduct] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceProduct] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceProduct] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceSum] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSum] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSum] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSum] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSum] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSum] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceSum] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceSumSquare] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSumSquare] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSumSquare] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSumSquare] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSumSquare] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSumSquare] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceSumSquare] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceL2] Throw if the input data type is not one of the floating point.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceLogSum] Throw if the input data type is not one of the floating point.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceLogSumExp] Throw if the input data type is not one of the floating point.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceMean] Throw if the input data type is not one of the floating point.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceL1] Test when the input data type is not one of the floating point.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMax] Test when the input data type is not one of the floating point.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMin] Test when the input data type is not one of the floating point.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceProduct] Test when the input data type is not one of the floating point.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSum] Test when the input data type is not one of the floating point.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSumSquare] Test when the input data type is not one of the floating point.: FAIL (Chrome: PASS, Safari: FAIL)
  • /webnn/validation_tests/reduction.https.any.worker.html [wpt.fyi]
    • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL1] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL1] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL1] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL1] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL1] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL1] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceL1] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceL2] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL2] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL2] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL2] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL2] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceL2] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceL2] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceLogSum] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSum] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSum] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSum] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSum] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSum] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceLogSum] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceLogSumExp] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSumExp] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSumExp] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSumExp] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSumExp] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceLogSumExp] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceLogSumExp] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceMax] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMax] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMax] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMax] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMax] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMax] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceMax] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceMean] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMean] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMean] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMean] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMean] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMean] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceMean] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceMin] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMin] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMin] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMin] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMin] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMin] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceMin] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceProduct] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceProduct] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceProduct] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceProduct] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceProduct] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceProduct] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceProduct] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceSum] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSum] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSum] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSum] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSum] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSum] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceSum] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceSumSquare] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSumSquare] Test reduce with default options.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSumSquare] Test reduce when input's datatype is float16.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSumSquare] Test reduce with keepDimensions=true.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSumSquare] Test reduce with axes=[0, 1] and keep_dimensions=false.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSumSquare] Throw if a value in axes is out of range of [0, N-1].: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceSumSquare] Throw if the two values are same in axes sequence.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceL2] Throw if the input data type is not one of the floating point.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceLogSum] Throw if the input data type is not one of the floating point.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceLogSumExp] Throw if the input data type is not one of the floating point.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceMean] Throw if the input data type is not one of the floating point.: FAIL (Chrome: FAIL, Safari: FAIL)
    • [reduceL1] Test when the input data type is not one of the floating point.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMax] Test when the input data type is not one of the floating point.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceMin] Test when the input data type is not one of the floating point.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceProduct] Test when the input data type is not one of the floating point.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSum] Test when the input data type is not one of the floating point.: FAIL (Chrome: PASS, Safari: FAIL)
    • [reduceSumSquare] Test when the input data type is not one of the floating point.: FAIL (Chrome: PASS, Safari: FAIL)
Pushed by wptsync@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/cbcda6e10c25 [wpt PR 45949] - webnn: Migrate Reduce validation tests to WPTs, a=testonly

https://hg.mozilla.org/mozilla-central/rev/cbcda6e10c25

Status: NEW → RESOLVED
Closed: 9 months ago
status-firefox128: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 128 Branch
You need to log in before you can comment on or make changes to this bug.