1583969 - Intermittent /svg/animations/scripted/onhover-syncbases.html | Check if onhover events reset correctly when triggered multiple times - assert_equals: expected "rgb(255, 0, 0)" but got "rgb(0, 255, 0)"

Status: RESOLVED FIXED

(Core :: SVG, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=268411107&repo=mozilla-central
Full log: https://queue.taskcluster.net/v1/task/R3FxDHmVTfiXqHkm-HVigg/runs/0/artifacts/public/logs/live_backing.log

---

[task 2019-09-25T18:28:26.226Z] 18:28:26 INFO - TEST-START | /svg/animations/scripted/onhover-syncbases.html
[task 2019-09-25T18:28:26.231Z] 18:28:26 INFO - Closing window 29
[task 2019-09-25T18:28:26.269Z] 18:28:26 INFO - PID 6932 | [Parent 9252, Gecko_IOThread] WARNING: pipe error: 109: file z:/task_1569425148/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
[task 2019-09-25T18:28:26.269Z] 18:28:26 INFO - PID 6932 | [Child 4980, Chrome_ChildThread] WARNING: pipe error: 109: file z:/task_1569425148/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 341
[task 2019-09-25T18:28:26.522Z] 18:28:26 INFO -
[task 2019-09-25T18:28:26.522Z] 18:28:26 INFO - TEST-UNEXPECTED-FAIL | /svg/animations/scripted/onhover-syncbases.html | Check if onhover events reset correctly when triggered multiple times - assert_equals: expected "rgb(255, 0, 0)" but got "rgb(0, 255, 0)"
[task 2019-09-25T18:28:26.522Z] 18:28:26 INFO - f@http://web-platform.test:8000/svg/animations/scripted/onhover-syncbases.html:24:18
[task 2019-09-25T18:28:26.522Z] 18:28:26 INFO - Test.prototype.step_timeout/<@http://web-platform.test:8000/resources/testharness.js:1963:22
[task 2019-09-25T18:28:26.522Z] 18:28:26 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1905:25
[task 2019-09-25T18:28:26.522Z] 18:28:26 INFO - Test.prototype.step_func/<@http://web-platform.test:8000/resources/testharness.js:1929:35
[task 2019-09-25T18:28:26.522Z] 18:28:26 INFO - setTimeout handlerTest.prototype.step_timeout@http://web-platform.test:8000/resources/testharness.js:1962:16
[task 2019-09-25T18:28:26.522Z] 18:28:26 INFO - f/<@http://web-platform.test:8000/svg/animations/scripted/onhover-syncbases.html:36:11
[task 2019-09-25T18:28:26.522Z] 18:28:26 INFO - Test.prototype.step_timeout/<@http://web-platform.test:8000/resources/testharness.js:1963:22
[task 2019-09-25T18:28:26.522Z] 18:28:26 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1905:25
[task 2019-09-25T18:28:26.522Z] 18:28:26 INFO - Test.prototype.step_func/<@http://web-platform.test:8000/resources/testharness.js:1929:35
[task 2019-09-25T18:28:26.522Z] 18:28:26 INFO - setTimeout handlerTest.prototype.step_timeout@http://web-platform.test:8000/resources/testharness.js:1962:16
[task 2019-09-25T18:28:26.522Z] 18:28:26 INFO - f@http://web-platform.test:8000/svg/animations/scripted/onhover-syncbases.html:32:7
[task 2019-09-25T18:28:26.522Z] 18:28:26 INFO - Test.prototype.step_timeout/<@http://web-platform.test:8000/resources/testharness.js:1963:22
[task 2019-09-25T18:28:26.523Z] 18:28:26 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1905:25
[task 2019-09-25T18:28:26.523Z] 18:28:26 INFO - Test.prototype.step_func/<@http://web-platform.test:8000/resources/testharness.js:1929:35
[task 2019-09-25T18:28:26.523Z] 18:28:26 INFO - setTimeout handler*Test.prototype.step_timeout@http://web-platform.test:8000/resources/testharness.js:1962:16
[task 2019-09-25T18:28:26.523Z] 18:28:26 INFO - @http://web-platform.test:8000/svg/animations/scripted/onhover-syncbases.html:39:5
[task 2019-09-25T18:28:26.523Z] 18:28:26 INFO - Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:1905:25
[task 2019-09-25T18:28:26.523Z] 18:28:26 INFO - async_test@http://web-platform.test:8000/resources/testharness.js:576:22
[task 2019-09-25T18:28:26.523Z] 18:28:26 INFO - @http://web-platform.test:8000/svg/animations/scripted/onhover-syncbases.html:19:11
[task 2019-09-25T18:28:26.523Z] 18:28:26 INFO - TEST-OK | /svg/animations/scripted/onhover-syncbases.html | took 295ms

Comment 1

[Daniel Holbert [:dholbert]]

FWIW, this test already has a complex constellation of known-failure annotations at
https://searchfox.org/mozilla-central/rev/f43ae7e1c43a4a940b658381157a6ea6c5a185c1/testing/web-platform/meta/svg/animations/scripted/onhover-syncbases.html.ini

In fact, it looks like we initially tried to disable this failing check entirely ("disabled: true" in that .ini file), but we had a typo in the log-matching-string ("triggred", which is misspelled in that .ini file -- it's missing the "e" after "gg"), so it probably doesn't ever take effect.

There's another less-generous set of annotations further down (which are active due to having the correctly-spelled log message), and that lower section has some known-failures annotated for WebRender configurations. But this particular failure in comment 0 was on a platform that did not have webrender, I think (at least, no "qr" in the jobname), which is why it was expected to pass.

We probably need to update the expectations, and perhaps remove the webrender check in the Windows annotation here.

Comment 2

[Andreea Pavel [:apavel]]

Hi Daniel, is that something you are working on or who can I ni?

Comment 3

[Daniel Holbert [:dholbert]]

For now, I think we need to just fix the failure annotation to reflect the reality of where this test fails.

I don't have cycles to investigate the test failure itself - as I recall, it was already failing when we imported it from upstream WPT. I can take a lok at fixing the annotations sometime early this week, though.

Comment 4

[Intermittent Failures Robot]

17 failures in 4530 pushes (0.004 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3
• autoland: 14

Platform breakdown:

• android-em-7-0-x86_64: 11
• windows10-64-shippable: 5
• macosx1014-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583969&startday=2019-09-23&endday=2019-09-29&tree=all

Comment 5

[Andreea Pavel [:apavel]]

(In reply to Daniel Holbert [:dholbert] from comment #3)

For now, I think we need to just fix the failure annotation to reflect the reality of where this test fails.

I don't have cycles to investigate the test failure itself - as I recall, it was already failing when we imported it from upstream WPT. I can take a lok at fixing the annotations sometime early this week, though.

Sounds good, thank you.

Comment 6

[Daniel Holbert [:dholbert]]

Sure! Try run with one possible approach:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=3a76a7e7b0feaebf60f9a17f363be8c436abb2da

Comment 7

[Daniel Holbert [:dholbert]]

Attachment: Bug 1583969: Simplify annotations for flaky web-platform test onhover-syncbases.html (test-annotation only)

Until now, it's had a bunch of annotations that were inadvertantly inactive due to a typo in the test-output-matching string, and then it's got a pile of different annotations with the correctly-spelled string (but those annotations are insufficient, because we're still getting intermittent failures).

Let's just fix the typo and leave it annotated as random (passing & failing).

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/b3f6625f82ab
Simplify annotations for flaky web-platform test onhover-syncbases.html (test-annotation only)

Comment 9

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/b3f6625f82ab

Comment 10

[Intermittent Failures Robot]

21 failures in 4292 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 2
• autoland: 17
• try: 2

Platform breakdown:

• android-em-7-0-x86_64: 17
• windows10-64-shippable: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1583969&startday=2019-09-30&endday=2019-10-06&tree=all