1438851 - 10 tests in layout/reftests/bugs/ fail to pass on new windows 10 hardware

Status: NEW

(Core :: Layout, defect, P3)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

you can see many failures when on try:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=38d33764c8fcb54a270518d63f2b596a4f4dde30&filter-searchStr=reftest

we are getting new hardware to run windows 10 tests on and the tests are failing.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: add fuzzy-if to get reftests green

456219-1a.html
456219-1b.html
456219-1c.html
718521.html
991046-1.html
1116480-1-fakeitalic-overflow.html
1316719-1a.html
1316719-1b.html
1316719-1c.html

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

found one more in a recent test:
1425243-2.html

https://treeherder.mozilla.org/#/jobs?repo=try&revision=331f5dc8e73abae7ba5af373c359d8f9ddd52d9a

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: add fuzzy-if to get reftests green

Comment 4

[Jet Villegas (inactive)]

[ Triage 2017/02/20: P3 ]

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 8952404 [details] [diff] [review]
add fuzzy-if to get reftests green

I would like to fuzzy-if and leave this open until there are dev cycles to look into this

Comment 6

[Geoff Brown [:gbrown]]

Comment on attachment 8952404 [details] [diff] [review]
add fuzzy-if to get reftests green

Review of attachment 8952404 [details] [diff] [review]:
-----------------------------------------------------------------

::: layout/reftests/bugs/reftest.list
@@ +1992,5 @@
>  fuzzy(2,20000) == 1315113-2.html 1315113-2-ref.html
>  == 1315632-1.html 1315632-1-ref.html
> +fuzzy(13,40000) fails-if(webrender) == 1316719-1a.html 1316719-1-ref.html
> +fuzzy(13,40000) fails-if(webrender) == 1316719-1b.html 1316719-1-ref.html
> +fuzzy(13,40000) == 1316719-1c.html 1316719-1-ref.html

I'm a little uneasy about expanding the fuzzy scope that much...but who knows if it is important? Consider adding a Windows 10-specific fuzzy-if instead.

Comment 7

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: add fuzzy-if to get reftests green

updated patch with review suggestions.

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/bba8187c791f
9 tests in layout/reftests/bugs/ fail to pass on new windows 10 hardware. r=gbrown

Comment 9

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/mozilla-central/rev/bba8187c791f

Comment 10

[BugBot [:suhaib / :marco]]

The leave-open keyword is there and there is no activity for 6 months.
:svoisen, maybe it's time to close this bug?

Comment 11

[BugBot [:suhaib / :marco]]

The leave-open keyword is there and there is no activity for 6 months.
:svoisen, maybe it's time to close this bug?

Comment 12

[BugBot [:suhaib / :marco]]

The leave-open keyword is there and there is no activity for 6 months.
:svoisen, maybe it's time to close this bug?