1886873 - [wpt-sync] Sync PR 45260 - webnn: Remove long timeout for WPT validation_tests

Status: RESOLVED FIXED

(Testing :: web-platform-tests, task, P4)

Description

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Sync web-platform-tests PR 45260 into mozilla-central (this bug is closed when the sync is complete).

PR: https://github.com/web-platform-tests/wpt/pull/45260
Details from upstream follow.

Austin Sullivan <[e-mail]> wrote:

webnn: Remove long timeout for WPT validation_tests

These validation tests should all just hit synchronous exceptions in
the renderer, so they shouldn't need a long timeout

Change-Id: I1f50ac4a4a819d59a6f6954836dbf37e280553ff
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/5380961
Reviewed-by: Joshua Bell \<[e-mail]>
Commit-Queue: Joshua Bell \<[e-mail]>
Auto-Submit: Austin Sullivan \<[e-mail]>
Commit-Queue: Austin Sullivan \<[e-mail]>
Cr-Commit-Position: refs/heads/main@{#1276428}

Comment 1

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

PR 45260 applied with additional changes from upstream: b6d4a0ec8e22a59c374a718042c5f387cc7998a4, 6b40eb3abe8c77ca8d6e5c9ab26ff2c51694ea50

Comment 2

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=7e3ac50a396bdd27a0fef2accd048c268064ca04

Comment 3

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

Pushed to try (stability) https://treeherder.mozilla.org/#/jobs?repo=try&revision=dbf6fc2ff4106244c468cfd663f34299f680bc3c

Comment 4

[Web Platform Test Sync Bot [:wpt-sync] (Matrix: #interop:mozilla.org)]

CI Results

Ran 0 Firefox configurations based on mozilla-central, and Firefox, Chrome, and Safari on GitHub CI

Total 28 tests and 12 subtests

Status Summary

Firefox

OK : 28
PASS: 20
FAIL: 296

Chrome

OK : 28
PASS: 260
FAIL: 108

Safari

OK : 28
PASS: 20
FAIL: 296

Links

GitHub PR Head
GitHub PR Base

Details

New Tests That Don't Pass

• /webnn/validation_tests/argMinMax.https.any.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [argMin] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [argMax] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/argMinMax.https.any.worker.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [argMin] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [argMax] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/batchNormalization.https.any.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] TypeError is expected if options.axis is outside the 'unsigned long' value range: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if options.axis is 'unsigned long' and it's not in the range 0 to the rank of input, exclusive: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] TypeError is expected if options.axis is not an unsigned long interger: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if the size of mean.dimensions is not 1: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if mean.dimensions[0] is not equal to input.dimensions[options.axis]: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if the size of variance.dimensions is not 1: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if variance.dimensions[0] is not equal to input.dimensions[options.axis]: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if the size of scale.dimensions is not 1: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if scale.dimensions[0] is not equal to input.dimensions[options.axis]: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if the size of bias.dimensions is not 1: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if bias.dimensions[0] is not equal to input.dimensions[options.axis]: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] throw if mean is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] throw if variance is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] throw if scale option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] throw if bias option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/batchNormalization.https.any.worker.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] TypeError is expected if options.axis is outside the 'unsigned long' value range: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if options.axis is 'unsigned long' and it's not in the range 0 to the rank of input, exclusive: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] TypeError is expected if options.axis is not an unsigned long interger: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if the size of mean.dimensions is not 1: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if mean.dimensions[0] is not equal to input.dimensions[options.axis]: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if the size of variance.dimensions is not 1: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if variance.dimensions[0] is not equal to input.dimensions[options.axis]: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if the size of scale.dimensions is not 1: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if scale.dimensions[0] is not equal to input.dimensions[options.axis]: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if the size of bias.dimensions is not 1: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] DataError is expected if bias.dimensions[0] is not equal to input.dimensions[options.axis]: FAIL (Chrome: PASS, Safari: FAIL)
  • [batchNormalization] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] throw if mean is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] throw if variance is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] throw if scale option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [batchNormalization] throw if bias option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/concat.https.any.worker.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with one input.: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with two inputs: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with three inputs: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with two 1D inputs.: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Throw if the argument types are inconsistent.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if the inputs have different ranks.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if the axis is equal to or greater than the size of ranks: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if concat with two 0-D scalars.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if the inputs have other axes with different sizes except on the axis.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] throw if any input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
• /webnn/validation_tests/concat.https.any.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with one input.: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with two inputs: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with three inputs: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Test building Concat with two 1D inputs.: FAIL (Chrome: PASS, Safari: FAIL)
  • [concat] Throw if the argument types are inconsistent.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if the inputs have different ranks.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if the axis is equal to or greater than the size of ranks: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if concat with two 0-D scalars.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] Throw if the inputs have other axes with different sizes except on the axis.: FAIL (Chrome: FAIL, Safari: FAIL)
  • [concat] throw if any input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
• /webnn/validation_tests/constant.https.any.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a 0-D scalar constant without presenting dimensions: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a 0-D scalar constant with empty dimensions: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a constant with float32 data type: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a constant with int32 data type: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a constant with uint32 data type: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a constant with int64 data type: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a constant with uint64 data type: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a constant with int8 data type: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a constant with uint8 data type: FAIL (Chrome: PASS, Safari: FAIL)
• /webnn/validation_tests/constant.https.any.worker.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a 0-D scalar constant without presenting dimensions: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a 0-D scalar constant with empty dimensions: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a constant with float32 data type: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a constant with int32 data type: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a constant with uint32 data type: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a constant with int64 data type: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a constant with uint64 data type: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a constant with int8 data type: FAIL (Chrome: PASS, Safari: FAIL)
  • [constant] Test building a constant with uint8 data type: FAIL (Chrome: PASS, Safari: FAIL)
• /webnn/validation_tests/elementwise-binary.https.any.worker.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [add] throw if first input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [add] throw if second input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [sub] throw if first input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [sub] throw if second input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [mul] throw if first input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [mul] throw if second input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [div] throw if first input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [div] throw if second input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [max] throw if first input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [max] throw if second input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [min] throw if first input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [min] throw if second input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [pow] throw if first input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [pow] throw if second input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/elementwise-binary.https.any.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [add] throw if first input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [add] throw if second input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [sub] throw if first input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [sub] throw if second input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [mul] throw if first input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [mul] throw if second input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [div] throw if first input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [div] throw if second input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [max] throw if first input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [max] throw if second input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [min] throw if first input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [min] throw if second input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [pow] throw if first input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [pow] throw if second input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/gather.https.any.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [gather] Test gather with default options and 0-D indices: FAIL (Chrome: PASS, Safari: FAIL)
  • [gather] Test gather with axis = 2: FAIL (Chrome: PASS, Safari: FAIL)
  • [gather] TypeError is expected if the input is a scalar: FAIL (Chrome: PASS, Safari: FAIL)
  • [gather] TypeError is expected if the axis is greater than the rank of input: FAIL (Chrome: PASS, Safari: FAIL)
  • [gather] TypeError is expected if the data type of indices is invalid: FAIL (Chrome: PASS, Safari: FAIL)
  • [gather] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [gather] throw if indices is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/gather.https.any.worker.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [gather] Test gather with default options and 0-D indices: FAIL (Chrome: PASS, Safari: FAIL)
  • [gather] Test gather with axis = 2: FAIL (Chrome: PASS, Safari: FAIL)
  • [gather] TypeError is expected if the input is a scalar: FAIL (Chrome: PASS, Safari: FAIL)
  • [gather] TypeError is expected if the axis is greater than the rank of input: FAIL (Chrome: PASS, Safari: FAIL)
  • [gather] TypeError is expected if the data type of indices is invalid: FAIL (Chrome: PASS, Safari: FAIL)
  • [gather] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [gather] throw if indices is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/gru.https.any.worker.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] Test with default options: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] Test with given options: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if steps equals to zero: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if hiddenSize equals to zero: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if hiddenSize is too large: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the data type of the inputs is not one of the floating point types: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the rank of input is not 3: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if input.dimensions[0] is not equal to steps: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if weight.dimensions[1] is not 3 * hiddenSize: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the rank of recurrentWeight is not 3: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the recurrentWeight.dimensions is invalid: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the size of options.activations is not 2: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the rank of options.bias is not 2: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if options.bias.dimensions[1] is not 3 * hiddenSize: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if options.recurrentBias.dimensions[1] is not 3 * hiddenSize: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the rank of options.initialHiddenState is not 3: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if options.initialHiddenState.dimensions[2] is not inputSize: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the dataType of options.initialHiddenState is incorrect: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [gru] throw if weight is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [gru] throw if recurrentWeight is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [gru] throw if bias option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [gru] throw if recurrentBias option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [gru] throw if initialHiddenState option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/gru.https.any.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] Test with default options: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] Test with given options: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if steps equals to zero: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if hiddenSize equals to zero: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if hiddenSize is too large: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the data type of the inputs is not one of the floating point types: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the rank of input is not 3: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if input.dimensions[0] is not equal to steps: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if weight.dimensions[1] is not 3 * hiddenSize: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the rank of recurrentWeight is not 3: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the recurrentWeight.dimensions is invalid: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the size of options.activations is not 2: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the rank of options.bias is not 2: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if options.bias.dimensions[1] is not 3 * hiddenSize: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if options.recurrentBias.dimensions[1] is not 3 * hiddenSize: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the rank of options.initialHiddenState is not 3: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if options.initialHiddenState.dimensions[2] is not inputSize: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] TypeError is expected if the dataType of options.initialHiddenState is incorrect: FAIL (Chrome: PASS, Safari: FAIL)
  • [gru] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [gru] throw if weight is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [gru] throw if recurrentWeight is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [gru] throw if bias option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [gru] throw if recurrentBias option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [gru] throw if initialHiddenState option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/layerNormalization.https.any.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [layerNormalization] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [layerNormalization] throw if scale option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [layerNormalization] throw if bias option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/layerNormalization.https.any.worker.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [layerNormalization] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [layerNormalization] throw if scale option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [layerNormalization] throw if bias option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/lstm.https.any.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] Test with default options: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] Test with given options: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if hiddenSize equals to zero: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if hiddenSize is too large: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if steps equals to zero: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the data type is not one of the floating point types: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the rank of input is not 3: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if input.dimensions[0] is not equal to steps: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the shape of weight is incorrect: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the rank of recurrentWeight is not 3: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the size of options.activations is not 3: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the rank of options.bias is not 2: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the shape of options.recurrentBias.dimensions is incorrect: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the dataType of options.peepholeWeight is incorrect: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the dataType of options.initialHiddenState is incorrect: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the shape of options.initialCellState is incorrect: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [lstm] throw if weight is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [lstm] throw if recurrentWeight is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [lstm] throw if bias option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [lstm] throw if recurrentBias option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [lstm] throw if peepholeWeight option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [lstm] throw if initialHiddenState option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [lstm] throw if initialCellState option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/lstm.https.any.worker.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] Test with default options: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] Test with given options: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if hiddenSize equals to zero: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if hiddenSize is too large: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if steps equals to zero: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the data type is not one of the floating point types: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the rank of input is not 3: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if input.dimensions[0] is not equal to steps: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the shape of weight is incorrect: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the rank of recurrentWeight is not 3: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the size of options.activations is not 3: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the rank of options.bias is not 2: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the shape of options.recurrentBias.dimensions is incorrect: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the dataType of options.peepholeWeight is incorrect: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the dataType of options.initialHiddenState is incorrect: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] DataError is expected if the shape of options.initialCellState is incorrect: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstm] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [lstm] throw if weight is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [lstm] throw if recurrentWeight is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [lstm] throw if bias option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [lstm] throw if recurrentBias option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [lstm] throw if peepholeWeight option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [lstm] throw if initialHiddenState option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [lstm] throw if initialCellState option is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/lstmCell.https.any.worker.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if weight is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if recurrentWeight is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if hiddenState is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if cellState is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if bias option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if recurrentBias option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if peepholeWeight option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
• /webnn/validation_tests/lstmCell.https.any.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if input is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if weight is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if recurrentWeight is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if hiddenState is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if cellState is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if bias option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if recurrentBias option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
  • [lstmCell] throw if peepholeWeight option is from another builder: FAIL (Chrome: PASS, Safari: FAIL)
• /webnn/validation_tests/pooling.https.any.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [averagePool2d] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [l2Pool2d] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [maxPool2d] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/pooling.https.any.worker.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [averagePool2d] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [l2Pool2d] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [maxPool2d] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/resample2d.https.any.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [resample2d] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/resample2d.https.any.worker.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [resample2d] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/triangular.https.any.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [triangular] DataError is expected if input's rank is less than 2: FAIL (Chrome: PASS, Safari: FAIL)
  • [triangular] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/triangular.https.any.worker.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [triangular] DataError is expected if input's rank is less than 2: FAIL (Chrome: PASS, Safari: FAIL)
  • [triangular] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/where.https.any.worker.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Throw if the condition data type is not uint8.: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Throw if the data types of input and other do not match: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Throw if the shapes of input and other are not broadcastable: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Throw if the condition shape is not broadcastable: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Test building where with 2-D condition, 2-D input and 2-D other using broadcast: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Test building where with 2-D condition, 2-D input and 3-D other using broadcast: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Test building where with 3-D condition, 3-D input and 2-D other using broadcast: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Test building where with 4-D condition, 3-D input and 2-D other using broadcast: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] throw if condition is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [where] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [where] throw if other is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
• /webnn/validation_tests/where.https.any.html [wpt.fyi]
  • assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator"): FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Throw if the condition data type is not uint8.: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Throw if the data types of input and other do not match: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Throw if the shapes of input and other are not broadcastable: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Throw if the condition shape is not broadcastable: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Test building where with 2-D condition, 2-D input and 2-D other using broadcast: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Test building where with 2-D condition, 2-D input and 3-D other using broadcast: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Test building where with 3-D condition, 3-D input and 2-D other using broadcast: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] Test building where with 4-D condition, 3-D input and 2-D other using broadcast: FAIL (Chrome: PASS, Safari: FAIL)
  • [where] throw if condition is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [where] throw if input is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)
  • [where] throw if other is from another builder: FAIL (Chrome: FAIL, Safari: FAIL)

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/332fc8908550
[wpt PR 45260] - webnn: Remove long timeout for WPT validation_tests, a=testonly
https://hg.mozilla.org/integration/autoland/rev/124724da3c6f
[wpt PR 45260] - Update wpt metadata, a=testonly

Comment 6

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/332fc8908550
https://hg.mozilla.org/mozilla-central/rev/124724da3c6f