1560466 - Intermittent TEST-UNEXPECTED-PASS | /css/css-transitions/CSSTransition-startTime.tentative.html | The start time of transitions is based on when they are generated - expected FAIL

Status: NEW

(Core :: CSS Transitions and Animations, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nerli [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=252734370&repo=autoland
Full log: https://queue.taskcluster.net/v1/task/JcVFJvyTSPaxODJ5UuB5pw/runs/0/artifacts/public/logs/live_backing.log

---

[task 2019-06-21T02:56:47.075Z] 02:56:47 INFO - TEST-START | /css/css-transitions/CSSTransition-startTime.tentative.html
[task 2019-06-21T02:56:47.075Z] 02:56:47 INFO - Closing window 2147483671
[task 2019-06-21T02:56:47.624Z] 02:56:47 INFO -
[task 2019-06-21T02:56:47.624Z] 02:56:47 INFO - TEST-PASS | /css/css-transitions/CSSTransition-startTime.tentative.html | The start time of a newly-created transition is unresolved
[task 2019-06-21T02:56:47.624Z] 02:56:47 INFO - TEST-UNEXPECTED-PASS | /css/css-transitions/CSSTransition-startTime.tentative.html | The start time of transitions is based on when they are generated - expected FAIL
[task 2019-06-21T02:56:47.624Z] 02:56:47 INFO - TEST-INFO | expected FAIL
[task 2019-06-21T02:56:47.841Z] 02:56:47 INFO - ...
[task 2019-06-21T02:56:47.841Z] 02:56:47 INFO - TEST-OK | /css/css-transitions/CSSTransition-startTime.tentative.html | took 770ms
[task 2019-06-21T02:56:48.489Z] 02:56:48 INFO - Closing logging queue
[task 2019-06-21T02:56:48.489Z] 02:56:48 INFO - queue closed
[task 2019-06-21T02:56:48.506Z] 02:56:48 INFO - Setting up ssl
[task 2019-06-21T02:56:48.521Z] 02:56:48 INFO - certutil |
[task 2019-06-21T02:56:48.542Z] 02:56:48 INFO - certutil |
[task 2019-06-21T02:56:48.557Z] 02:56:48 INFO - certutil |
[task 2019-06-21T02:56:48.558Z] 02:56:48 INFO - Certificate Nickname Trust Attributes
[task 2019-06-21T02:56:48.558Z] 02:56:48 INFO - SSL,S/MIME,JAR/XPI
[task 2019-06-21T02:56:48.558Z] 02:56:48 INFO -
[task 2019-06-21T02:56:48.558Z] 02:56:48 INFO - web-platform-tests CT,,
[task 2019-06-21T02:56:48.558Z] 02:56:48 INFO -
[task 2019-06-21T02:56:50.299Z] 02:56:50 INFO - adb Granting important runtime permissions to org.mozilla.geckoview.test
[task 2019-06-21T02:56:51.552Z] 02:56:51 INFO - adb launch_application: am start -W -n org.mozilla.geckoview.test/org.mozilla.geckoview.test.TestRunnerActivity -a android.intent.action.MAIN --es env9 MOZ_PROCESS_LOG=/tmp/tmp49Qddqpidlog --es env8 MOZ_CRASHREPORTER_NO_REPORT=1 --es args "-no-remote -profile /sdcard/tests/profile --marionette about:blank" --es env3 STYLO_THREADS=4 --es env2 MOZ_HIDE_RESULTS_TABLE=1 --es env1 R_LOG_VERBOSE=1 --es env0 MOZ_CRASHREPORTER=1 --es env7 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env6 R_LOG_DESTINATION=stderr --es env5 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env4 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --ez use_multiprocess True --es env10 R_LOG_LEVEL=6
[task 2019-06-21T02:56:53.091Z] 02:56:53 INFO - Starting runner

Comment 1

[Noemi Erli[:noemi_erli]]

This seems to have started from https://hg.mozilla.org/integration/mozilla-inbound/rev/a91b29ff03f9\

Comment 2

[Brian Birtles (:birtles, Feb 26~ parental leave)]

I guess that means it should have been marked as random instead of FAIL.

Comment 3

[Intermittent Failures Robot]

22 failures in 515 pushes (0.043 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• mozilla-central: 6
• mozilla-inbound: 3

Platform breakdown:

• android-em-7-0-x86_64: 22

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1560466&startday=2019-06-21&endday=2019-06-21&tree=all

Comment 4

[Andreea Pavel [:apavel]]

I do we mark that as random instead of FAIL?

Comment 5

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

I don't think WPT has the concept of "random". I think you can use "disabled" on specific subtests, which will ignore the results of those specific subtests, which is basically the same thing as marking a test as random.

Comment 6

[Intermittent Failures Robot]

19 failures in 168 pushes (0.113 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-inbound: 5
• autoland: 10
• mozilla-central: 4

Platform breakdown:

• android-em-7-0-x86_64: 19

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1560466&startday=2019-06-22&endday=2019-06-22&tree=all

Comment 7

[Intermittent Failures Robot]

69 failures in 2581 pushes (0.027 failures/push) were associated with this bug in the last 7 days.

This is the #25 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 42
• mozilla-central: 13
• mozilla-inbound: 12
• try: 2

Platform breakdown:

• android-em-7-0-x86_64: 69

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1560466&startday=2019-06-17&endday=2019-06-23&tree=all

Comment 8

[James Graham [:jgraham]]

Yes, we are working on support for multiple allowed statuses, but in the meantime we should just disable intermittnent tests.

Comment 9

[Intermittent Failures Robot]

26 failures in 625 pushes (0.042 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• mozilla-central: 5
• mozilla-inbound: 5
• try: 3

Platform breakdown:

• android-em-7-0-x86_64: 26

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1560466&startday=2019-06-24&endday=2019-06-24&tree=all

Comment 10

[Razvan Maries]

Attachment: Bug 1560466 - disabled CSSTransition-startTime.tentative.html on Android debug. r=jmaher

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/099695187f6d
disabled CSSTransition-startTime.tentative.html on Android debug. r=jmaher

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/38aa0201f645
disabled CSSTransition-startTime.tentative.html on Android debug. r=jmaher

Comment 13

[Andrei Ciure[:aciure]]

https://hg.mozilla.org/mozilla-central/rev/099695187f6d
https://hg.mozilla.org/mozilla-central/rev/38aa0201f645

Comment 14

[Intermittent Failures Robot]

18 failures in 847 pushes (0.021 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 11
• mozilla-inbound: 3
• mozilla-central: 3
• try: 1

Platform breakdown:

• android-em-7-0-x86_64: 18

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1560466&startday=2019-06-25&endday=2019-06-25&tree=all

Comment 15

[Intermittent Failures Robot]

44 failures in 4409 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 24
• mozilla-inbound: 8
• mozilla-central: 8
• try: 4

Platform breakdown:

• android-em-7-0-x86_64: 44

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1560466&startday=2019-06-24&endday=2019-06-30&tree=all