1746882 - High frequency TEST-UNEXPECTED-TIMEOUT | /css/css-backgrounds/animations/background-color-animation.html | expected PASS

Status: RESOLVED FIXED

(Core :: Layout: Images, Video, and HTML Frames, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ccozmuta [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=361884471&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/WVBhKCLLQIOVS7OACuonug/runs/0/artifacts/public/logs/live_backing.log
Reftest URL: https://hg.mozilla.org/mozilla-central/raw-file/tip/layout/tools/reftest/reftest-analyzer.xhtml#logurl=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/WVBhKCLLQIOVS7OACuonug/runs/0/artifacts/public/logs/live_backing.log&only_show_unexpected=1

---

[task 2021-12-20T14:36:45.604Z] 14:36:45     INFO - TEST-START | /css/css-backgrounds/animations/background-color-animation.html
[task 2021-12-20T14:37:05.719Z] 14:37:05     INFO - TEST-UNEXPECTED-TIMEOUT | /css/css-backgrounds/animations/background-color-animation.html | expected PASS
[task 2021-12-20T14:37:05.719Z] 14:37:05     INFO - TEST-INFO took 20115ms
[task 2021-12-20T14:37:06.525Z] 14:37:06     INFO - STDOUT: cleanup aborted: args: /builds/worker/fetches/android-sdk-linux/platform-tools/adb wait-for-device shell rm /data/data/org.mozilla.geckoview.test_runner/files/mozilla/profiles.ini; echo adb_returncode=$?, exitcode: 1, stdout: rm: /data/data/org.mozilla.geckoview.test_runner/files/mozilla/profiles.ini: No such file or directory
[task 2021-12-20T14:37:06.527Z] 14:37:06     INFO - Closing logging queue
[task 2021-12-20T14:37:06.527Z] 14:37:06     INFO - queue closed
[task 2021-12-20T14:37:06.548Z] 14:37:06     INFO - Setting android reftest preferences
[task 2021-12-20T14:37:06.549Z] 14:37:06     INFO - Setting up ssl
[task 2021-12-20T14:37:06.568Z] 14:37:06     INFO - certutil | b''
[task 2021-12-20T14:37:06.592Z] 14:37:06     INFO - certutil | b''
[task 2021-12-20T14:37:06.610Z] 14:37:06     INFO - certutil | b'\nCertificate Nickname                                         Trust Attributes\n                                                             SSL,S/MIME,JAR/XPI\n\nweb-platform-tests                                           CT,, \n'
[task 2021-12-20T14:37:12.044Z] 14:37:12     INFO - STDOUT: timed out waiting for profiles.ini
[task 2021-12-20T14:37:12.239Z] 14:37:12     INFO - adb Granting important runtime permissions to org.mozilla.geckoview.test_runner
[task 2021-12-20T14:37:13.709Z] 14:37:13     INFO - adb launch_application: am start -W -n org.mozilla.geckoview.test_runner/org.mozilla.geckoview.test_runner.TestRunnerActivity -a android.intent.action.MAIN --es env0 MOZ_CRASHREPORTER=1 --es env1 MOZ_CRASHREPORTER_NO_REPORT=1 --es env2 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env3 MOZ_HIDE_RESULTS_TABLE=1 --es env4 MOZ_IN_AUTOMATION=1 --es env5 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --es env6 R_LOG_LEVEL=6 --es env7 R_LOG_DESTINATION=stderr --es env8 R_LOG_VERBOSE=1 --es env9 MOZ_PROCESS_LOG=/tmp/tmpgvukzzo9pidlog --es env10 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env11 STYLO_THREADS=1 --es env12 MOZ_WEBRENDER=1 --es arg0 -no-remote --es arg1 -profile --es arg2 /data/local/tmp/test_root/profile --es arg3 --marionette --es arg4 about:blank --ez use_multiprocess True
[task 2021-12-20T14:37:14.765Z] 14:37:14     INFO - Starting runner
[task 2021-12-20T14:37:15.389Z] 14:37:15     INFO - TEST-START | /css/css-backgrounds/animations/background-color-transition.html

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1745199

Comment 2

[James Graham [:jgraham]]

Attachment: Bug 1746882 - Mark animations test as intermittent on android,

Comment 3

[James Graham [:jgraham]]

I've put up a patch to mark this as intermittent, but someone working on animations might want to figure out why this is timing out on android; presumably it means we don't ever resolve document.getAnimations()[0].ready.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/3a73f7529437
Mark animations test as intermittent on android, r=aryx DONTBUILD

Comment 5

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/3a73f7529437

Comment 6

[Intermittent Failures Robot]

30 failures in 2286 pushes (0.013 failures/push) were associated with this bug in the last 7 days.

This is the #22 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 30

Platform and build breakdown:

• android-em-7-0-x86_64-lite-qr: 27
  • opt: 27
• android-em-7-0-x86_64-qr: 3
  • opt: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1746882&startday=2021-12-20&endday=2021-12-26&tree=all

Comment 7

[Brian Birtles (:birtles, Feb 26~ parental leave)]

(In reply to James Graham [:jgraham] from comment #3)

I've put up a patch to mark this as intermittent, but someone working on animations might want to figure out why this is timing out on android; presumably it means we don't ever resolve document.getAnimations()[0].ready.

I'm not really sure. Hiro, any ideas?

Comment 8

[Hiroyuki Ikezoe (:hiro)]

(In reply to James Graham [:jgraham] from comment #3)

I've put up a patch to mark this as intermittent, but someone working on animations might want to figure out why this is timing out on android; presumably it means we don't ever resolve document.getAnimations()[0].ready.

It unlikely happens. Though I am not able to reproduce the failure locally (since --repeat-until-unexpected fails for mobile for some reasons), when I tried a single run, I saw a "flushRendering ignoreThrottledAnimations:false" in the log I got by setting "--setpref marionette.log.level=Trace".

Leaving NI to jgraham for the above log.

Comment 9

[James Graham [:jgraham]]

Looking at https://searchfox.org/mozilla-central/source/remote/marionette/actors/MarionetteReftestChild.jsm#85, if there's a reftest-wait class we assume that after the reftest-wait is removed all animations will have stopped and therefore it's safe to pass ignoreThrottledAnimations: false down to flushRendering which ends up affecting which option we choose here: https://searchfox.org/mozilla-central/source/remote/marionette/actors/MarionetteReftestChild.jsm#85

So, looking at the test, it looks like the intent is that the animation never actually completes, but should be effectively static. Maybe this doesn't quite hold true on android in all cases?

Comment 10

[Hiroyuki Ikezoe (:hiro)]

(In reply to James Graham [:jgraham] from comment #9)

Looking at https://searchfox.org/mozilla-central/source/remote/marionette/actors/MarionetteReftestChild.jsm#85, if there's a reftest-wait class we assume that after the reftest-wait is removed all animations will have stopped and therefore it's safe to pass ignoreThrottledAnimations: false down to flushRendering which ends up affecting which option we choose here: https://searchfox.org/mozilla-central/source/remote/marionette/actors/MarionetteReftestChild.jsm#85

Thank for the clarification, James. In normal animation tests, the tests expect that animations in question keep running, so using ignoreThrottledAnimations: true even after reftest-wait was removed would be safer, and I believe the change would fix this intermittent. That said, the change might also introduce new intermittents which, I believe, written in bad manner.