Open Bug 1894636 Opened 5 months ago Updated 5 months ago

Intermittent TV /webnn/validation_tests/gemm.https.any.html | single tracking bug

Categories

(Testing :: web-platform-tests, defect, P5)

Product:
Testing
Component:
web-platform-tests
Type:
defect

Tracking

(firefox-esr115 unaffected, firefox125 unaffected, firefox126 unaffected, firefox127 affected, firefox128 affected)

Tracking Flags:
Tracking Status
firefox-esr115 --- unaffected
firefox125 --- unaffected
firefox126 --- unaffected
firefox127 --- affected
firefox128 --- affected

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Regression)

Details

(Keywords: intermittent-failure, regression, test-verify-fail)

Filed by: ctuns [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=456640865&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RNpMOdXaTfWyYELmVDM_bg/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/RNpMOdXaTfWyYELmVDM_bg/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2024-05-02T08:05:08.568Z] 08:05:08     INFO - TEST-START | /webnn/validation_tests/gemm.https.any.html
[task 2024-05-02T08:05:08.568Z] 08:05:08     INFO - Run 1/10
[task 2024-05-02T08:05:08.937Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.938Z] 08:05:08     INFO - TEST-FAIL | /webnn/validation_tests/gemm.https.any.html | assert_not_equals(navigator.ml, undefined, "ml property is defined on navigator") - assert_not_equals: ml property is defined on navigator got disallowed value undefined
[task 2024-05-02T08:05:08.938Z] 08:05:08     INFO - @https://web-platform.test:8443/webnn/resources/utils_validation.js:200:29
[task 2024-05-02T08:05:08.938Z] 08:05:08     INFO - Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2622:25
[task 2024-05-02T08:05:08.938Z] 08:05:08     INFO - test@https://web-platform.test:8443/resources/testharness.js:633:30
[task 2024-05-02T08:05:08.938Z] 08:05:08     INFO - @https://web-platform.test:8443/webnn/resources/utils_validation.js:200:5
[task 2024-05-02T08:05:08.938Z] 08:05:08     INFO - TEST-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] throw if first input is from another builder - promise_test: Unhandled rejection with value: object "TypeError: can't access property "createContext", navigator.ml is undefined"
[task 2024-05-02T08:05:08.938Z] 08:05:08     INFO - TEST-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] throw if second input is from another builder - promise_test: Unhandled rejection with value: object "TypeError: can't access property "createContext", navigator.ml is undefined"
[task 2024-05-02T08:05:08.938Z] 08:05:08     INFO - TEST-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] throw if c option is from another builder - promise_test: Unhandled rejection with value: object "TypeError: can't access property "createContext", navigator.ml is undefined"
[task 2024-05-02T08:05:08.939Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Test building gemm with default option. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.939Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.939Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Throw if inputShapeA[1] is not equal to inputShapeB[0] default options. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.939Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.939Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Test building gemm with aTranspose=true. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.939Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.939Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Throw if inputShapeA[0] is not equal to inputShapeB[0] with aTranspose=true. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.939Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.939Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Test building gemm with bTranspose=true. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.939Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.939Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Throw if inputShapeA[0] is not equal to inputShapeB[0] with bTranspose=true. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.940Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.940Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Throw if the rank of inputA is not 2. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.941Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.941Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Throw if the rank of inputB is not 2. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.941Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.941Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Throw if data types of two inputs do not match. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.942Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.942Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Test building gemm with inputC. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.942Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.943Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Test building gemm with scalar inputC. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.943Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.943Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Throw if inputShapeC is not unidirectionally broadcastable to the output shape [inputShapeA[0], inputShapeB[1]]. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.943Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.943Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Throw if the input data type is not floating point. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.944Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.944Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Throw if data type of inputC does not match ones of inputA and inputB. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.944Z] 08:05:08     INFO - 
[task 2024-05-02T08:05:08.944Z] 08:05:08     INFO - TEST-UNEXPECTED-FAIL | /webnn/validation_tests/gemm.https.any.html | [gemm] Throw if the rank of inputC is 3. - promise_test: Unhandled rejection with value: object "TypeError: can't access property "input", builder is undefined"
[task 2024-05-02T08:05:08.945Z] 08:05:08     INFO - TEST-OK | /webnn/validation_tests/gemm.https.any.html | took 370ms
[task 2024-05-02T08:05:08.946Z] 08:05:08     INFO - PID 19759 | 1714637108946	Marionette	INFO	Stopped listening on port 49143
[task 2024-05-02T08:05:09.793Z] 08:05:09     INFO - Browser exited with return code 0
[task 2024-05-02T08:05:09.795Z] 08:05:09     INFO - Closing logging queue
[task 2024-05-02T08:05:09.795Z] 08:05:09     INFO - queue closed
[task 2024-05-02T08:05:09.804Z] 08:05:09     INFO - Application command: /builds/worker/workspace/build/application/firefox/firefox --marionette about:blank -profile /tmp/tmprjq0ofh2
[task 2024-05-02T08:05:09.812Z] 08:05:09     INFO - Starting runner
[task 2024-05-02T08:05:10.248Z] 08:05:10     INFO - PID 20060 | ATTENTION: default value of option mesa_glthread overridden by environment.
[task 2024-05-02T08:05:10.264Z] 08:05:10     INFO - PID 20060 | 1714637110263	Marionette	INFO	Marionette enabled
[task 2024-05-02T08:05:10.314Z] 08:05:10     INFO - PID 20060 | ATTENTION: default value of option mesa_glthread overridden by environment.
[task 2024-05-02T08:05:10.333Z] 08:05:10     INFO - PID 20060 | 1714637110332	Marionette	INFO	Listening on port 41822
[task 2024-05-02T08:05:13.543Z] 08:05:13     INFO - PID 20060 | console.error: ({})
[task 2024-05-02T08:05:14.392Z] 08:05:14     INFO - PID 20060 | [ERROR error_support::handling] suggest-unexpected: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base
[task 2024-05-02T08:05:14.396Z] 08:05:14     INFO - PID 20060 | console.error: URLBar - QuickSuggest.SuggestBackendRust: "Ingest error: Error from Remote Settings: Error parsing URL: relative URL with a cannot-be-a-base base"
[task 2024-05-02T08:05:14.564Z] 08:05:14     INFO - TEST-START | /webnn/validation_tests/gemm.https.any.html
See Also: → 1894637

Set release status flags based on info from the regressing bug 1894276

status-firefox125: --- → unaffected
status-firefox126: --- → unaffected
status-firefox127: --- → affected
status-firefox-esr115: --- → unaffected

Set release status flags based on info from the regressing bug 1894276

status-firefox128: --- → affected
You need to log in before you can comment on or make changes to this bug.