1478106 - Intermittent /css/css-transitions/properties-value-001.html | outline-color color(rgba) / events - assert_equals: Expected TransitionEnd events triggered on .transition expected "outline-color:0.5s" but got ""

Status: RESOLVED FIXED

(Core :: CSS Parsing and Computation, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nbeleuzu [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=189877636&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/TxEJ-1taQgWQiGq1Psvc7Q/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Intermittent Failures Robot]

29 failures in 760 pushes (0.038 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 18
* mozilla-inbound: 10
* mozilla-central: 1

Platform breakdown:
* linux64: 29

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1478106&startday=2018-07-23&endday=2018-07-29&tree=trunk

Comment 2

[Stefan Hindli [:stefan_hindli]]

Over the last 7 days there are 30 failures on this bug. These happen on linux64.

Here is the most recent log example: https://treeherder.mozilla.org/logviewer.html#?job_id=191055916&repo=mozilla-inbound&lineNumber=2104

[task 2018-07-31T07:16:03.194Z] 07:16:03     INFO - TEST-PASS | /css/css-transitions/properties-value-001.html | outline-offset length(cm) / values 
[task 2018-07-31T07:16:03.194Z] 07:16:03     INFO - TEST-UNEXPECTED-FAIL | /css/css-transitions/properties-value-001.html | outline-offset length(cm) / events - assert_equals: Expected TransitionEnd events triggered on .transition expected "outline-offset:0.5s" but got ""
[task 2018-07-31T07:16:03.194Z] 07:16:03     INFO - assertExpectedEventsFunc/<@http://web-platform.test:8000/css/css-transitions/support/generalParallelTest.js:207:13
[task 2018-07-31T07:16:03.195Z] 07:16:03     INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1538:20

Comment 4

[Maire Reavy [:mreavy]]

Hi Sean -- Was anything new landed in the last 2 weeks to trigger this?  Thanks.

Comment 5

[Sean Voisen (:svoisen)]

Hiro - Do you possibly have any insight here?

Comment 6

[Hiroyuki Ikezoe (:hiro)]

I know this test is originally flaky. :/  But interesting, there is no suspicious changes making this failure more frequent, AFAICT.  Now it's time to investigate what's going on there.

Keep NI to me, CCing Brian since, as far as I know, he has been rewriting these test cases.

Comment 7

[Hiroyuki Ikezoe (:hiro)]

The reason why the test is originally flaky is that the test uses setTimeout() [1] to tell the transitions in question finished.  I wonder other UAs are not suffering from this kind of failures?

The reason why the test started failing frequently is that, given that all failures on ASAN build (as per the link in comment 1), we started doing something heavy load on ASAN build, I guess.

We should just skip this test on ASAN too until Brian makes the test more sane.  (We've already skipped on debug build)

[1] https://hg.mozilla.org/mozilla-central/file/937c64cef999/testing/web-platform/tests/css/css-transitions/support/runParallelAsyncHarness.js#l117

Comment 8

[Brian Birtles (:birtles)]

(In reply to Hiroyuki Ikezoe (:hiro) (PTO on Aug 20) from comment #6)
> Keep NI to me, CCing Brian since, as far as I know, he has been rewriting
> these test cases.

Yeah, I haven't rewritten this one yet. I wouldn't waste time debugging it and would just disable the test for now.

Comment 9

[Brian Birtles (:birtles)]

(Sorry, wrote that comment before I saw yours.)

Comment 10

[Hiroyuki Ikezoe (:hiro)]

Attachment: Bug 1478106 - Skip properties-value-001.html on ASAN build. r?birtles

Skip properties-value-001.html on ASAN build.

I'd like to change the link in properties-value-001.html.ini to a bug for
fixing this test.  Do we already have a bug for that?

Comment 11

[Hiroyuki Ikezoe (:hiro)]

Attachment: Bug 1478106 - Skip properties-value-001.html on ASAN build. r?birtles

Skip properties-value-001.html on ASAN build

Comment 12

[Brian Birtles (:birtles)]

Comment on attachment 8999039 [details]
Bug 1478106 - Skip properties-value-001.html on ASAN build. r?birtles

Brian Birtles (:birtles) has approved the revision.

Comment 13

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ab427e770c87
Skip properties-value-001.html on ASAN build. r=birtles

Comment 14

[Eliza Balazs [:ebalazs_]]

https://hg.mozilla.org/mozilla-central/rev/ab427e770c87

Comment 15

[Intermittent Failures Robot]

25 failures in 2579 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 11
* mozilla-inbound: 9
* mozilla-central: 5

Platform breakdown:
* linux64: 25

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1478106&startday=2018-08-06&endday=2018-08-12&tree=all