1376430 - Intermittent /2dcontext/path-objects/2d.path.stroke.prune.arc.html | Zero-length line segments from arcTo and arc are removed before stroking - assert_equals: Red channel of the pixel at (50, 25) expected 0 but got 255

Status: RESOLVED INCOMPLETE

(Core :: Graphics: Canvas2D, defect, P3)

Description

[Treeherder Bug Filer]

Filed by: cbook [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=109978366&repo=mozilla-central

https://queue.taskcluster.net/v1/task/ITRkhYmEQIa7VO0ByX78Yw/runs/0/artifacts/public/logs/live_backing.log

Comment 1

[Geoff Brown [:gbrown]]

This bug (and bug 1376273) happen only on Windows 10, where wpt is tier 2, and seems to only run on mozilla-central.

On central, this started with https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&revision=42593af5ec7ec9d5a07c9c0e899ac99244d15ae6&filter-searchStr=windows+web-platform-tests. Perhaps a consequence of bug 1363428?

Comment 2

[Intermittent Failures Robot]

36 failures in 718 pushes (0.05 failures/push) were associated with this bug in the last 7 days. 

This is the #46 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-central: 36

Platform breakdown:
* windows10-64-vm: 36

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1376430&startday=2017-06-26&endday=2017-07-02&tree=all

Comment 3

[Geoff Brown [:gbrown]]

:milan - This bug and bug 1376273 are on track for 100+ failures / week. Can you find someone to look into it, or can we disable this test on Windows?

Comment 4

[Intermittent Failures Robot]

57 failures in 656 pushes (0.087 failures/push) were associated with this bug in the last 7 days. 

This is the #18 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-central: 57

Platform breakdown:
* windows10-64-vm: 57

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1376430&startday=2017-07-03&endday=2017-07-09&tree=all

Comment 5

[Milan Sreckovic [:milan] (needinfo for best results)]

This test is confusing me, at a first glance it seems to be asking for the wrong value.

Comment 6

[Milan Sreckovic [:milan] (needinfo for best results)]

(In reply to Geoff Brown [:gbrown] from comment #3)
> :milan - This bug and bug 1376273 are on track for 100+ failures / week. Can
> you find someone to look into it, or can we disable this test on Windows?

Does it ever succeed?

Comment 7

[Geoff Brown [:gbrown]]

I'm sorry :milan, I think I see where this has gone wrong now. This test always fails (at least on windows and linux), as you say. The test is marked as failing for many platforms:

https://dxr.mozilla.org/mozilla-central/rev/b07db5d650b7056c78ba0dbc409d060ec4e922cd/testing/web-platform/meta/2dcontext/path-objects/2d.path.stroke.prune.arc.html.ini#1

and that explains why those test jobs are green for other platforms. I think the annotation for Windows 10 is wrong, and that's why this test is perma-fail on Windows.

:jgraham -- What's the best way to mark this as failing on all Windows?

Comment 8

[Geoff Brown [:gbrown]]

Well, obviously that would be os == 'win'. I guess I'm wondering, why are we testing for all these windows versions, and can we collapse those to os == 'win'?

Comment 9

[Geoff Brown [:gbrown]]

Attachment: simplify some windows test expectations

I am still not sure what was wrong with the existing annotations, but "collapsing" them to (os == "win") seems to work well:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=937dc2aedb7881b0c65f5b733a633edba565e80e

Comment 10

[Intermittent Failures Robot]

27 failures in 106 pushes (0.255 failures/push) were associated with this bug yesterday.   

Repository breakdown:
* mozilla-central: 23
* try: 4

Platform breakdown:
* windows10-64: 27

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1376430&startday=2017-07-13&endday=2017-07-13&tree=all

Comment 11

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 8885986 [details] [diff] [review]
simplify some windows test expectations

Review of attachment 8885986 [details] [diff] [review]:
-----------------------------------------------------------------

so much simpler!

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/91f429bd8dc0
Modify test expectations for some wpt 2dcontext/path-objects tests, on Windows; r=jmaher

Comment 13

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/91f429bd8dc0

Comment 14

[Intermittent Failures Robot]

74 failures in 720 pushes (0.103 failures/push) were associated with this bug in the last 7 days. 

This is the #13 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. ** 

Repository breakdown:
* mozilla-central: 49
* try: 25

Platform breakdown:
* windows10-64: 50
* windows10-64-vm: 24

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1376430&startday=2017-07-10&endday=2017-07-16&tree=all

Comment 15

[James Graham [:jgraham]]

FYI the reason they aren't collapsed by default is just that the script for updating the metadata isn't clever enough to work out it can do that (partially because it's just not that good and partially because it doesn't know what the full range of possible values is). I will try to work on that as part of the wpt sync improvements this quater.

Comment 16

[Intermittent Failures Robot]

18 failures in 822 pushes (0.022 failures/push) were associated with this bug in the last 7 days.   

Repository breakdown:
* try: 18

Platform breakdown:
* windows10-64-vm: 14
* windows10-64: 4

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1376430&startday=2017-07-17&endday=2017-07-23&tree=all

Comment 17

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit BugBot documentation.