Open Bug 1928328 Opened 2 days ago Updated 2 days ago

Intermittent TVw3 /webnn/validation_tests/lstmCell.https.any.html | assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator") - assert_not_equals: ml property is defined on navigator got disallowed value undefined

Categories

(Testing :: web-platform-tests, defect, P5)

Product:
Testing
Component:
web-platform-tests
Type:
defect

Tracking

(firefox-esr128 unaffected, firefox132 unaffected, firefox133 unaffected, firefox134 affected)

Tracking Flags:
Tracking Status
firefox-esr128 --- unaffected
firefox132 --- unaffected
firefox133 --- unaffected
firefox134 --- affected

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Regression)

Details

(Keywords: intermittent-failure, regression, test-verify-fail)

Filed by: amarc [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=480543768&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Uv2P2qseTZyjc6fGGLbiDA/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/Uv2P2qseTZyjc6fGGLbiDA/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2024-10-31T08:10:28.202Z] 08:10:28     INFO - TEST-START | /webnn/validation_tests/lstmCell.https.any.html?cpu
[task 2024-10-31T08:10:28.202Z] 08:10:28     INFO - Run 1/10
[task 2024-10-31T08:10:28.584Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.584Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator") - assert_not_equals: ml property is defined on navigator got disallowed value undefined
[task 2024-10-31T08:10:28.584Z] 08:10:28     INFO - @https://web-platform.test:8443/webnn/resources/utils_validation.js:194:29
[task 2024-10-31T08:10:28.584Z] 08:10:28     INFO - Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2622:25
[task 2024-10-31T08:10:28.584Z] 08:10:28     INFO - test@https://web-platform.test:8443/resources/testharness.js:633:30
[task 2024-10-31T08:10:28.584Z] 08:10:28     INFO - @https://web-platform.test:8443/webnn/resources/utils_validation.js:194:5
[task 2024-10-31T08:10:28.584Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.584Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] throw if input is from another builder - promise_test: Unhandled rejection with value: object "TypeError: can't access property "createContext", navigator.ml is undefined"
[task 2024-10-31T08:10:28.584Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.584Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] throw if weight is from another builder - promise_test: Unhandled rejection with value: object "TypeError: can't access property "createContext", navigator.ml is undefined"
[task 2024-10-31T08:10:28.586Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.587Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] throw if recurrentWeight is from another builder - promise_test: Unhandled rejection with value: object "TypeError: can't access property "createContext", navigator.ml is undefined"
[task 2024-10-31T08:10:28.588Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.589Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] throw if hiddenState is from another builder - promise_test: Unhandled rejection with value: object "TypeError: can't access property "createContext", navigator.ml is undefined"
[task 2024-10-31T08:10:28.590Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.591Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] throw if cellState is from another builder - promise_test: Unhandled rejection with value: object "TypeError: can't access property "createContext", navigator.ml is undefined"
[task 2024-10-31T08:10:28.593Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.594Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] throw if bias option is from another builder - promise_test: Unhandled rejection with value: object "TypeError: can't access property "createContext", navigator.ml is undefined"
[task 2024-10-31T08:10:28.595Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.596Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] throw if recurrentBias option is from another builder - promise_test: Unhandled rejection with value: object "TypeError: can't access property "createContext", navigator.ml is undefined"
[task 2024-10-31T08:10:28.596Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.597Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] throw if peepholeWeight option is from another builder - promise_test: Unhandled rejection with value: object "TypeError: can't access property "createContext", navigator.ml is undefined"
[task 2024-10-31T08:10:28.598Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.598Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Test with default options - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.599Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.600Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Test with given options - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.601Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.601Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if hiddenSize is equal to zero - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.602Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.603Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if hiddenSize is too large - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.603Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.604Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the input data type is not one of the floating point types - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.605Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.605Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the rank of input is not 2 - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.606Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.607Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the shape of input is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.607Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.608Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the data type of weight is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.609Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.609Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the rank of weight is not 2 - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.610Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.610Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the shape of weight is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.611Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.612Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the data type of recurrentWeight is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.612Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.613Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the rank of recurrentWeight is not 2 - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.614Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.614Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the shape of recurrentWeight is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.615Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.615Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the data type of hiddenState is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.616Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.617Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the rank of hiddenState is not 2 - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.617Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.618Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the shape of hiddenState is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.619Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.619Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the data type of cellState is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.620Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.620Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the rank of cellState is not 2 - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.620Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.621Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the shape of cellState is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.622Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.622Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the data type of options.bias is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.622Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.622Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the rank of options.bias is not 1 - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.622Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.622Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the shape of options.bias is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.623Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.623Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the data type of options.recurrentBias is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.623Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.623Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the rank of options.recurrentBias is not 1 - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.623Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.623Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the shape of options.recurrentBias is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.623Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.623Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the data type of options.peepholeWeight is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.623Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.623Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the rank of options.peepholeWeight is not 1 - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.623Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.623Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the shape of options.peepholeWeight is incorrect - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.623Z] 08:10:28     INFO - 
[task 2024-10-31T08:10:28.624Z] 08:10:28     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/lstmCell.https.any.html?cpu | [lstmCell] Throw if the size of options.activations is not 3 - promise_test: Unhandled rejection with value: object "ReferenceError: MLGraphBuilder is not defined"
[task 2024-10-31T08:10:28.624Z] 08:10:28     INFO - TEST-OK | /webnn/validation_tests/lstmCell.https.any.html?cpu | took 388ms

Set release status flags based on info from the regressing bug 1928222

status-firefox132: --- → unaffected
status-firefox133: --- → unaffected
status-firefox134: --- → affected
status-firefox-esr128: --- → unaffected
You need to log in before you can comment on or make changes to this bug.