Open Bug 1907815 Opened 1 year ago Updated 1 year ago

Intermittent TVw /webnn/validation_tests/convTranspose2d.https.any.worker.html | single tracking bug

Categories

(Testing :: web-platform-tests, defect, P5)

Product:
Testing
Component:
web-platform-tests
Type:
defect

Tracking

(firefox-esr115 unaffected, firefox-esr128 unaffected, firefox128 unaffected, firefox129 unaffected, firefox130 affected)

Tracking Flags:
Tracking Status
firefox-esr115 --- unaffected
firefox-esr128 --- unaffected
firefox128 --- unaffected
firefox129 --- unaffected
firefox130 --- affected

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Regression)

Details

(Keywords: intermittent-failure, regression, test-verify-fail)

Filed by: sstanca [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=466301570&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YkT_VdJLQm6rHNTHG0XX8A/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YkT_VdJLQm6rHNTHG0XX8A/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

[task 2024-07-15T08:35:59.288Z] 08:35:59     INFO - SUITE-END | took 32s
[task 2024-07-15T08:35:59.289Z] 08:35:59     INFO - Got 0 unexpected results, with 0 unexpected passes
[task 2024-07-15T08:35:59.294Z] 08:35:59     INFO - wptserve Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
[task 2024-07-15T08:35:59.344Z] 08:35:59     INFO - wptserve Stopped http server on 127.0.0.1:8000
[task 2024-07-15T08:35:59.397Z] 08:35:59     INFO - wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
[task 2024-07-15T08:35:59.423Z] 08:35:59     INFO - wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
[task 2024-07-15T08:35:59.424Z] 08:35:59     INFO - wptserve Stopped http server on 127.0.0.1:8003
[task 2024-07-15T08:35:59.424Z] 08:35:59     INFO - wptserve Stopped http server on 127.0.0.1:8445
[task 2024-07-15T08:35:59.424Z] 08:35:59     INFO - wptserve Stopped http server on 127.0.0.1:9000
[task 2024-07-15T08:35:59.424Z] 08:35:59     INFO - wptserve Stopped http server on 127.0.0.1:8443
[task 2024-07-15T08:35:59.424Z] 08:35:59     INFO - wptserve Stopped http server on 127.0.0.1:8444
[task 2024-07-15T08:35:59.425Z] 08:35:59     INFO - wptserve Stopped http server on 127.0.0.1:8002
[task 2024-07-15T08:35:59.425Z] 08:35:59     INFO - wptserve Stopped http server on 127.0.0.1:8446
[task 2024-07-15T08:35:59.425Z] 08:35:59     INFO - wptserve Stopped http server on 127.0.0.1:8001
[task 2024-07-15T08:35:59.678Z] 08:35:59     INFO - Removed font: Ahem.ttf
[task 2024-07-15T08:35:59.767Z] 08:35:59     INFO - Closing logging queue
[task 2024-07-15T08:35:59.768Z] 08:35:59     INFO - queue closed
[task 2024-07-15T08:35:59.820Z] 08:35:59     INFO - ::: Ran 10 of expected 10 iterations.
[task 2024-07-15T08:35:59.822Z] 08:35:59     INFO - ## All results ##
[task 2024-07-15T08:35:59.822Z] 08:35:59     INFO - 
[task 2024-07-15T08:35:59.822Z] 08:35:59     INFO - ### /html/semantics/invokers/invoketarget-on-video-behavior.tentative.html ###
[task 2024-07-15T08:35:59.822Z] 08:35:59     INFO - |                                Subtest                                 |          Results           |                 Messages                |
[task 2024-07-15T08:35:59.822Z] 08:35:59     INFO - |------------------------------------------------------------------------|----------------------------|-----------------------------------------|
[task 2024-07-15T08:35:59.822Z] 08:35:59     INFO - |                                                                        | OK                         |                                         |
[task 2024-07-15T08:35:59.823Z] 08:35:59     INFO - | `invoking video with playpause action makes video play`                | **FAIL: 9/10, PASS: 1/10** | `assert_false: expected false got true` |
[task 2024-07-15T08:35:59.823Z] 08:35:59     INFO - | `invoking video with playpause action and preventDefault is a no-op`   | PASS                       |                                         |
[task 2024-07-15T08:35:59.823Z] 08:35:59     INFO - | `invoking playing video with playpause action pauses it`               | FAIL                       | `assert_true: expected true got false`  |
[task 2024-07-15T08:35:59.823Z] 08:35:59     INFO - | `invoking video with play action makes video play`                     | FAIL                       | `assert_false: expected false got true` |
[task 2024-07-15T08:35:59.824Z] 08:35:59     INFO - | `invoking video with play action and preventDefault is a no-op`        | PASS                       |                                         |
[task 2024-07-15T08:35:59.824Z] 08:35:59     INFO - | `invoking playing video with play action is a no-op`                   | PASS                       |                                         |
[task 2024-07-15T08:35:59.825Z] 08:35:59     INFO - | `invoking video with pause action is a no-op`                          | PASS                       |                                         |
[task 2024-07-15T08:35:59.825Z] 08:35:59     INFO - | `invoking video with pause action and preventDefault is a no-op`       | PASS                       |                                         |
[task 2024-07-15T08:35:59.826Z] 08:35:59     INFO - | `invoking playing video with pause action makes it pause`              | FAIL                       | `assert_true: expected true got false`  |
[task 2024-07-15T08:35:59.826Z] 08:35:59     INFO - | `invoking video with toggleMuted action mutes it`                      | FAIL                       | `assert_true: expected true got false`  |
[task 2024-07-15T08:35:59.827Z] 08:35:59     INFO - | `invoking video with toggleMuted action and preventDefault is a no-op` | PASS                       |                                         |
[task 2024-07-15T08:35:59.827Z] 08:35:59     INFO - | `invoking muted video with toggleMuted action unmutes it`              | FAIL                       | `assert_false: expected false got true` |
[task 2024-07-15T08:35:59.827Z] 08:35:59     INFO - 
[task 2024-07-15T08:35:59.828Z] 08:35:59     INFO - ## Unstable results ##
[task 2024-07-15T08:35:59.828Z] 08:35:59     INFO - 
[task 2024-07-15T08:35:59.828Z] 08:35:59     INFO - |                                   Test                                   |                         Subtest                         |          Results           |                 Messages                |
[task 2024-07-15T08:35:59.829Z] 08:35:59     INFO - |--------------------------------------------------------------------------|---------------------------------------------------------|----------------------------|-----------------------------------------|
[task 2024-07-15T08:35:59.829Z] 08:35:59     INFO - | `/html/semantics/invokers/invoketarget-on-video-behavior.tentative.html` | `invoking video with playpause action makes video play` | **FAIL: 9/10, PASS: 1/10** | `assert_false: expected false got true` |
[task 2024-07-15T08:35:59.829Z] 08:35:59     INFO - 
[task 2024-07-15T08:35:59.830Z] 08:35:59     INFO - ::: Running tests in a loop 10 times : FAIL
[task 2024-07-15T08:35:59.830Z] 08:35:59     INFO - :::
[task 2024-07-15T08:35:59.830Z] 08:35:59    ERROR - ::: Test verification FAIL
[task 2024-07-15T08:35:59.831Z] 08:35:59     INFO - :::
[task 2024-07-15T08:36:00.517Z] 08:36:00     INFO - Return code: 1
[task 2024-07-15T08:36:00.518Z] 08:36:00  WARNING - setting return code to 2
[task 2024-07-15T08:36:00.518Z] 08:36:00    ERROR - TinderboxPrint: Per-test run of .../invoketarget-on-video-behavior.tentative.html<br/>: FAILURE
[task 2024-07-15T08:36:00.519Z] 08:36:00     INFO - Running command: ['/builds/worker/workspace/build/venv/bin/python', '-u', '/builds/worker/workspace/build/tests/web-platform/runtests.py', '--log-raw=-', '--log-wptreport=/builds/worker/workspace/build/blobber_upload_dir/wptreport.json', '--log-errorsummary=/builds/worker/workspace/build/blobber_upload_dir/wpt-test5_errorsummary.log', '--symbols-path=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XYd3uIumRrmXgcv08dwUNg/artifacts/public/build/target.crashreporter-symbols.zip', '--stackwalk-binary=/builds/worker/fetches/minidump-stackwalk/minidump-stackwalk', '--stackfix-dir=/builds/worker/workspace/build/tests/bin', '--no-pause-after-test', '--instrument-to-file=/builds/worker/workspace/build/blobber_upload_dir/wpt_instruments.txt', '--specialpowers-path=/builds/worker/workspace/build/tests/extensions/specialpowers@mozilla.org.xpi', '--suppress-handler-traceback', '--processes=1', '--binary=/builds/worker/workspace/build/application/firefox/firefox', '--product=firefox', '--install-fonts', '--test-type=testharness', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--setpref=layers.d3d11.enable-blacklist=false', '--prefs-root=/builds/worker/workspace/build/tests/web-platform/prefs', '--config=/builds/worker/workspace/build/tests/web-platform/wptrunner.ini', '--ca-cert-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/cacert.pem', '--host-key-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/web-platform.test.key', '--host-cert-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/web-platform.test.pem', '--certutil-binary=/builds/worker/workspace/build/tests/bin/certutil', '--verify-log-full', '--verify', 'tests/web-platform/tests/long-animation-frame/tentative/loaf-pointer-without-render-iframe.html'] in /builds/worker/workspace/build
[task 2024-07-15T08:36:00.520Z] 08:36:00     INFO - Copy/paste: /builds/worker/workspace/build/venv/bin/python -u /builds/worker/workspace/build/tests/web-platform/runtests.py --log-raw=- --log-wptreport=/builds/worker/workspace/build/blobber_upload_dir/wptreport.json --log-errorsummary=/builds/worker/workspace/build/blobber_upload_dir/wpt-test5_errorsummary.log --symbols-path=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XYd3uIumRrmXgcv08dwUNg/artifacts/public/build/target.crashreporter-symbols.zip --stackwalk-binary=/builds/worker/fetches/minidump-stackwalk/minidump-stackwalk --stackfix-dir=/builds/worker/workspace/build/tests/bin --no-pause-after-test --instrument-to-file=/builds/worker/workspace/build/blobber_upload_dir/wpt_instruments.txt --specialpowers-path=/builds/worker/workspace/build/tests/extensions/specialpowers@mozilla.org.xpi --suppress-handler-traceback --processes=1 --binary=/builds/worker/workspace/build/application/firefox/firefox --product=firefox --install-fonts --test-type=testharness --setpref=media.peerconnection.mtransport_process=false --setpref=network.process.enabled=false --setpref=layers.d3d11.enable-blacklist=false --prefs-root=/builds/worker/workspace/build/tests/web-platform/prefs --config=/builds/worker/workspace/build/tests/web-platform/wptrunner.ini --ca-cert-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/cacert.pem --host-key-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/web-platform.test.key --host-cert-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/web-platform.test.pem --certutil-binary=/builds/worker/workspace/build/tests/bin/certutil --verify-log-full --verify tests/web-platform/tests/long-animation-frame/tentative/loaf-pointer-without-render-iframe.html
[task 2024-07-15T08:36:00.520Z] 08:36:00     INFO - Using env: (same as previous command)
[task 2024-07-15T08:36:00.524Z] 08:36:00     INFO - Calling ['/builds/worker/workspace/build/venv/bin/python', '-u', '/builds/worker/workspace/build/tests/web-platform/runtests.py', '--log-raw=-', '--log-wptreport=/builds/worker/workspace/build/blobber_upload_dir/wptreport.json', '--log-errorsummary=/builds/worker/workspace/build/blobber_upload_dir/wpt-test5_errorsummary.log', '--symbols-path=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/XYd3uIumRrmXgcv08dwUNg/artifacts/public/build/target.crashreporter-symbols.zip', '--stackwalk-binary=/builds/worker/fetches/minidump-stackwalk/minidump-stackwalk', '--stackfix-dir=/builds/worker/workspace/build/tests/bin', '--no-pause-after-test', '--instrument-to-file=/builds/worker/workspace/build/blobber_upload_dir/wpt_instruments.txt', '--specialpowers-path=/builds/worker/workspace/build/tests/extensions/specialpowers@mozilla.org.xpi', '--suppress-handler-traceback', '--processes=1', '--binary=/builds/worker/workspace/build/application/firefox/firefox', '--product=firefox', '--install-fonts', '--test-type=testharness', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--setpref=layers.d3d11.enable-blacklist=false', '--prefs-root=/builds/worker/workspace/build/tests/web-platform/prefs', '--config=/builds/worker/workspace/build/tests/web-platform/wptrunner.ini', '--ca-cert-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/cacert.pem', '--host-key-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/web-platform.test.key', '--host-cert-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/web-platform.test.pem', '--certutil-binary=/builds/worker/workspace/build/tests/bin/certutil', '--verify-log-full', '--verify', 'tests/web-platform/tests/long-animation-frame/tentative/loaf-pointer-without-render-iframe.html'] with output_timeout 1000
[task 2024-07-15T08:36:00.894Z] 08:36:00     INFO - :::
[task 2024-07-15T08:36:00.894Z] 08:36:00     INFO - ::: Running test verification step "Running tests in a loop 10 times"...
[task 2024-07-15T08:36:00.894Z] 08:36:00     INFO - :::
[task 2024-07-15T08:36:00.954Z] 08:36:00     INFO - mozversion application_buildid: 20240715080450
[task 2024-07-15T08:36:00.955Z] 08:36:00     INFO - mozversion application_changeset: e9e3a3e9127051c61912e9cf7718b0d809024588
[task 2024-07-15T08:36:00.955Z] 08:36:00     INFO - mozversion application_display_name: Firefox Nightly
[task 2024-07-15T08:36:00.957Z] 08:36:00     INFO - mozversion application_id: {ec8030f7-c20a-464f-9b0e-13a3a9e97384}
[task 2024-07-15T08:36:00.958Z] 08:36:00     INFO - mozversion application_name: Firefox
[task 2024-07-15T08:36:00.959Z] 08:36:00     INFO - mozversion application_remotingname: firefox-default
[task 2024-07-15T08:36:00.960Z] 08:36:00     INFO - mozversion application_repository: https://hg.mozilla.org/integration/autoland
[task 2024-07-15T08:36:00.960Z] 08:36:00     INFO - mozversion application_vendor: Mozilla
[task 2024-07-15T08:36:00.961Z] 08:36:00     INFO - mozversion application_version: 130.0a1
[task 2024-07-15T08:36:00.962Z] 08:36:00     INFO - mozversion platform_buildid: 20240715080450
[task 2024-07-15T08:36:00.962Z] 08:36:00     INFO - mozversion platform_changeset: e9e3a3e9127051c61912e9cf7718b0d809024588
[task 2024-07-15T08:36:00.962Z] 08:36:00     INFO - mozversion platform_repository: https://hg.mozilla.org/integration/autoland
[task 2024-07-15T08:36:00.963Z] 08:36:00     INFO - mozversion platform_version: 130.0a1
[task 2024-07-15T08:36:04.037Z] 08:36:04     INFO - Installed font: Ahem.ttf
[task 2024-07-15T08:36:05.415Z] 08:36:05     INFO - wptserve Starting http server on http://127.0.0.1:8001
[task 2024-07-15T08:36:05.420Z] 08:36:05     INFO - wptserve Starting http server on http://127.0.0.1:8002
[task 2024-07-15T08:36:05.471Z] 08:36:05     INFO - wptserve Starting https server on https://127.0.0.1:8443
[task 2024-07-15T08:36:05.491Z] 08:36:05     INFO - wptserve Starting http server on http://127.0.0.1:8000
[task 2024-07-15T08:36:05.496Z] 08:36:05     INFO - wptserve Starting https server on https://127.0.0.1:8444
[task 2024-07-15T08:36:05.514Z] 08:36:05     INFO - wptserve Starting http server on http://127.0.0.1:8003
[task 2024-07-15T08:36:05.545Z] 08:36:05     INFO - wptserve Starting https server on https://127.0.0.1:8445
[task 2024-07-15T08:36:05.549Z] 08:36:05     INFO - wptserve Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
[task 2024-07-15T08:36:05.552Z] 08:36:05     INFO - wptserve Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
[task 2024-07-15T08:36:05.552Z] 08:36:05     INFO - wptserve Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
[task 2024-07-15T08:36:05.552Z] 08:36:05     INFO - wptserve Starting https server on https://127.0.0.1:8446
[task 2024-07-15T08:36:05.555Z] 08:36:05     INFO - wptserve Create socket on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
[task 2024-07-15T08:36:05.558Z] 08:36:05     INFO - wptserve Bind on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
[task 2024-07-15T08:36:05.559Z] 08:36:05     INFO - wptserve Listen on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
[task 2024-07-15T08:36:05.572Z] 08:36:05     INFO - wptserve Starting http2 server on https://127.0.0.1:9000
[task 2024-07-15T08:36:05.593Z] 08:36:05     INFO - wptserve Starting WebTransport over HTTP/3 server on 127.0.0.1:11000
[task 2024-07-15T08:36:06.075Z] 08:36:06     INFO - SUITE-START | Running 1 tests
You need to log in before you can comment on or make changes to this bug.