Closed Bug 1760927 Opened 4 years ago Closed 4 years ago

Intermittent [TVw] TinderboxPrint: Per-test run of .../animation-play-state-005.tentative.html<br/>: FAILURE

Categories

(Core :: DOM: Animation, defect, P5)

Product:
Core
Component:
DOM: Animation
Type:
defect

Tracking

()

Status:
RESOLVED INCOMPLETE
Tracking Flags:
Tracking Status
firefox-esr91 --- unaffected
firefox98 --- unaffected
firefox99 --- unaffected
firefox100 --- affected

People

(Reporter: intermittent-bug-filer, Assigned: boris)

References

(Regression)

Details

(Keywords: intermittent-failure, regression)

Filed by: smolnar [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=372006655&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HOmOXtjLRImAT5eoakJrMQ/runs/1/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HOmOXtjLRImAT5eoakJrMQ/runs/1/artifacts/public/logs/live_backing.log&only_show_unexpected=1

INFO - TEST-START | /css/css-animations/animation-play-state-005.tentative.html
[task 2022-03-23T02:06:34.787Z] 02:06:34     INFO - Run 9/10
[task 2022-03-23T02:06:34.791Z] 02:06:34     INFO - Closing window 6c541cd7-fc22-4e50-ba25-76c9f4817b8a
[task 2022-03-23T02:06:35.091Z] 02:06:35     INFO - .
[task 2022-03-23T02:06:35.091Z] 02:06:35     INFO - TEST-OK | /css/css-animations/animation-play-state-005.tentative.html | took 304ms
[task 2022-03-23T02:06:35.091Z] 02:06:35     INFO - No more tests
[task 2022-03-23T02:06:35.093Z] 02:06:35     INFO - PID 1286 | 1648001195092	Marionette	INFO	Stopped listening on port 38494
[task 2022-03-23T02:06:35.577Z] 02:06:35     INFO - Browser exited with return code 0
[task 2022-03-23T02:06:35.579Z] 02:06:35     INFO - Closing logging queue
[task 2022-03-23T02:06:35.579Z] 02:06:35     INFO - queue closed
[task 2022-03-23T02:06:35.594Z] 02:06:35     INFO - Got 0 unexpected results, with 0 unexpected passes
[task 2022-03-23T02:06:35.595Z] 02:06:35     INFO - SUITE-END | took 8s
[task 2022-03-23T02:06:35.880Z] 02:06:35     INFO - wptserve Stopped http server on 127.0.0.1:8000
[task 2022-03-23T02:06:35.956Z] 02:06:35     INFO - wptserve Stopped http server on 127.0.0.1:8443
[task 2022-03-23T02:06:35.969Z] 02:06:35     INFO - wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
[task 2022-03-23T02:06:35.969Z] 02:06:35     INFO - wptserve Stopped http server on 127.0.0.1:8003
[task 2022-03-23T02:06:35.969Z] 02:06:35     INFO - wptserve Stopped http server on 127.0.0.1:9000
[task 2022-03-23T02:06:35.969Z] 02:06:35     INFO - wptserve Stopped http server on 127.0.0.1:8002
[task 2022-03-23T02:06:35.969Z] 02:06:35     INFO - wptserve Stopped http server on 127.0.0.1:8446
[task 2022-03-23T02:06:35.969Z] 02:06:35     INFO - wptserve Stopped http server on 127.0.0.1:8444
[task 2022-03-23T02:06:35.969Z] 02:06:35     INFO - wptserve Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
[task 2022-03-23T02:06:35.969Z] 02:06:35     INFO - wptserve Stopped http server on 127.0.0.1:8445
[task 2022-03-23T02:06:35.969Z] 02:06:35     INFO - wptserve Stopped http server on 127.0.0.1:8001
[task 2022-03-23T02:06:36.127Z] 02:06:36     INFO - Removed font: Ahem.ttf
[task 2022-03-23T02:06:36.188Z] 02:06:36     INFO - Closing logging queue
[task 2022-03-23T02:06:36.188Z] 02:06:36     INFO - queue closed
[task 2022-03-23T02:06:36.221Z] 02:06:36     INFO - ::: Ran 1 of expected 10 iterations.
[task 2022-03-23T02:06:36.223Z] 02:06:36     INFO - ::: Reached iteration timeout before finishing 2 or more repeat runs.
[task 2022-03-23T02:06:36.223Z] 02:06:36     INFO - ::: At least 2 successful repeat runs are required to validate stability.
[task 2022-03-23T02:06:36.224Z] 02:06:36     INFO - ::: Running tests in a loop 10 times : FAIL
[task 2022-03-23T02:06:36.225Z] 02:06:36     INFO - :::
[task 2022-03-23T02:06:36.225Z] 02:06:36  WARNING - ::: Test verification TIMEOUT
[task 2022-03-23T02:06:36.225Z] 02:06:36     INFO - :::
[task 2022-03-23T02:06:36.486Z] 02:06:36    ERROR - Return code: 1
[task 2022-03-23T02:06:36.487Z] 02:06:36    ERROR - # TBPL FAILURE #
[task 2022-03-23T02:06:36.487Z] 02:06:36  WARNING - setting return code to 2
[task 2022-03-23T02:06:36.487Z] 02:06:36    ERROR - TinderboxPrint: Per-test run of .../animation-play-state-005.tentative.html<br/>: FAILURE
[task 2022-03-23T02:06:36.489Z] 02:06:36     INFO - Running command: ['/builds/worker/workspace/build/venv/bin/python', '-u', '/builds/worker/workspace/build/tests/web-platform/runtests.py', '--log-raw=-', '--log-raw=/builds/worker/workspace/build/blobber_upload_dir/wpt-test2_raw.log', '--log-wptreport=/builds/worker/workspace/build/blobber_upload_dir/wptreport.json', '--log-errorsummary=/builds/worker/workspace/build/blobber_upload_dir/wpt-test2_errorsummary.log', '--symbols-path=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/b2wxhW-PQByjD5D0-xiStQ/artifacts/public/build/target.crashreporter-symbols.zip', '--stackwalk-binary=/builds/worker/fetches/minidump-stackwalk/minidump-stackwalk', '--stackfix-dir=/builds/worker/workspace/build/tests/bin', '--no-pause-after-test', '--instrument-to-file=/builds/worker/workspace/build/blobber_upload_dir/wpt_instruments.txt', '--specialpowers-path=/builds/worker/workspace/build/tests/extensions/specialpowers@mozilla.org.xpi', '--processes=1', '--binary=/builds/worker/workspace/build/application/firefox/firefox', '--install-fonts', '--test-type=testharness', '--setpref=fission.autostart=true', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--setpref=layers.d3d11.enable-blacklist=false', '--prefs-root=/builds/worker/workspace/build/tests/web-platform/prefs', '--config=/builds/worker/workspace/build/tests/web-platform/wptrunner.ini', '--ca-cert-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/cacert.pem', '--host-key-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/web-platform.test.key', '--host-cert-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/web-platform.test.pem', '--certutil-binary=/builds/worker/workspace/build/tests/bin/certutil', '--verify-log-full', '--verify', 'tests/web-platform/tests/web-animations/timing-model/animations/seamlessly-updating-the-playback-rate-of-an-animation.html'] in /builds/worker/workspace/build
[task 2022-03-23T02:06:36.489Z] 02:06:36     INFO - Copy/paste: /builds/worker/workspace/build/venv/bin/python -u /builds/worker/workspace/build/tests/web-platform/runtests.py --log-raw=- --log-raw=/builds/worker/workspace/build/blobber_upload_dir/wpt-test2_raw.log --log-wptreport=/builds/worker/workspace/build/blobber_upload_dir/wptreport.json --log-errorsummary=/builds/worker/workspace/build/blobber_upload_dir/wpt-test2_errorsummary.log --symbols-path=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/b2wxhW-PQByjD5D0-xiStQ/artifacts/public/build/target.crashreporter-symbols.zip --stackwalk-binary=/builds/worker/fetches/minidump-stackwalk/minidump-stackwalk --stackfix-dir=/builds/worker/workspace/build/tests/bin --no-pause-after-test --instrument-to-file=/builds/worker/workspace/build/blobber_upload_dir/wpt_instruments.txt --specialpowers-path=/builds/worker/workspace/build/tests/extensions/specialpowers@mozilla.org.xpi --processes=1 --binary=/builds/worker/workspace/build/application/firefox/firefox --install-fonts --test-type=testharness --setpref=fission.autostart=true --setpref=media.peerconnection.mtransport_process=false --setpref=network.process.enabled=false --setpref=layers.d3d11.enable-blacklist=false --prefs-root=/builds/worker/workspace/build/tests/web-platform/prefs --config=/builds/worker/workspace/build/tests/web-platform/wptrunner.ini --ca-cert-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/cacert.pem --host-key-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/web-platform.test.key --host-cert-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/web-platform.test.pem --certutil-binary=/builds/worker/workspace/build/tests/bin/certutil --verify-log-full --verify tests/web-platform/tests/web-animations/timing-model/animations/seamlessly-updating-the-playback-rate-of-an-animation.html
[task 2022-03-23T02:06:36.489Z] 02:06:36     INFO - Using env: (same as previous command)
INFO - Calling ['/builds/worker/workspace/build/venv/bin/python', '-u', '/builds/worker/workspace/build/tests/web-platform/runtests.py', '--log-raw=-', '--log-raw=/builds/worker/workspace/build/blobber_upload_dir/wpt-test2_raw.log', '--log-wptreport=/builds/worker/workspace/build/blobber_upload_dir/wptreport.json', '--log-errorsummary=/builds/worker/workspace/build/blobber_upload_dir/wpt-test2_errorsummary.log', '--symbols-path=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/b2wxhW-PQByjD5D0-xiStQ/artifacts/public/build/target.crashreporter-symbols.zip', '--stackwalk-binary=/builds/worker/fetches/minidump-stackwalk/minidump-stackwalk', '--stackfix-dir=/builds/worker/workspace/build/tests/bin', '--no-pause-after-test', '--instrument-to-file=/builds/worker/workspace/build/blobber_upload_dir/wpt_instruments.txt', '--specialpowers-path=/builds/worker/workspace/build/tests/extensions/specialpowers@mozilla.org.xpi', '--processes=1', '--binary=/builds/worker/workspace/build/application/firefox/firefox', '--install-fonts', '--test-type=testharness', '--setpref=fission.autostart=true', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--setpref=layers.d3d11.enable-blacklist=false', '--prefs-root=/builds/worker/workspace/build/tests/web-platform/prefs', '--config=/builds/worker/workspace/build/tests/web-platform/wptrunner.ini', '--ca-cert-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/cacert.pem', '--host-key-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/web-platform.test.key', '--host-cert-path=/builds/worker/workspace/build/tests/web-platform/tests/tools/certs/web-platform.test.pem', '--certutil-binary=/builds/worker/workspace/build/tests/bin/certutil', '--verify-log-full', '--verify', 'tests/web-platform/tests/web-animations/timing-model/animations/seamlessly-updating-the-playback-rate-of-an-animation.html'] with output_timeout 1000
[task 2022-03-23T02:06:36.698Z] 02:06:36     INFO - :::
[task 2022-03-23T02:06:36.698Z] 02:06:36     INFO - ::: Running test verification step "Running tests in a loop 10 times"...
[task 2022-03-23T02:06:36.699Z] 02:06:36     INFO - :::
[task 2022-03-23T02:06:36.947Z] 02:06:36     INFO - mozversion application_buildid: 20220323013314

:boris, since you are the author of the regressor, bug 1758527, could you take a look?
For more information, please visit auto_nag documentation.

Flags: needinfo?(boris.chiou)

Set release status flags based on info from the regressing bug 1758527

status-firefox100: --- → affected
status-firefox98: --- → unaffected
status-firefox99: --- → unaffected
status-firefox-esr91: --- → unaffected

I guess the reason is: we have to wait 100ms for each test, and so 10 tests may cause the timeout. Perhaps we have to reduce the animation duration, or increase the timeout to avoid this issue.

Assignee: nobody → boris.chiou
Flags: needinfo?(boris.chiou)

So I'd like to add this meta into this test file: <meta name="timeout" content="long"> to avoid this timeout error.

Oh, I think we can also add animation.finish() too.

e.g.

  await new Promise(function (resolve) {
    div.addEventListener('animationend', () => {
      // After the animation ends, change animation-play-state to paused, flush,
      // then change it back to running to trigger the re-start.
      div.style.animationPlayState = 'paused';
      getComputedStyle(div).animationPlayState;
      div.style.animationPlayState = 'running';
      getComputedStyle(div).animationPlayState;
      resolve();
    });
    div.getAnimations()[0].finish(); // <-- Add this line?
  });

?

Has Regression Range: --- → yes

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.

Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.