1660625 - adjust expectations of tests to work on windows10 hardware

Status: RESOLVED FIXED

(Testing :: web-platform-tests, task)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

running tests on windows10 hardware has different expectations than a virtual machine. Primarily here we are dealing with a GPU (not necessarily the same as we have at AWS).

I found only a few web-platform-tests which need updating to account for this.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: Bug 1660625 - adjust web-platform-tests expectations to work on windows 10 hardware. r=bc

adjust web-platform-tests expectations to work on windows 10 hardware

Comment 2

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/f4fb0206a994
adjust web-platform-tests expectations to work on windows 10 hardware. r=bc

Comment 3

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/f4fb0206a994

Comment 4

[Cosmin Sabou [:CosminS]]

Some of the tests have turned into UNEXPECTED-PASS/OK on win ccov. Treeherder link.

Failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=313909496&repo=mozilla-central
Joel, could you have a second go at these? Thank you.

Comment 5

[Joel Maher ( :jmaher ) (UTC -8)]

thanks for mentioning this; I am working on this and waiting on try results, most likely will be fixed tomorrow.

Comment 6

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: hardware Bug 1660625 - fix wpt expectations for windows 10 on hardware to pass on ccov. r=bc

fix wpt expectations for window 10 on hardware to pass on ccov.

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/ed08d4951af0
hardware Bug 1660625 - fix wpt expectations for windows 10 on hardware to pass on ccov. r=bc

Comment 8

[Narcis Beleuzu [:NarcisB]]

Backed out for wpt failure on report-only-from-unsafe-none.https.html

Backout link: https://hg.mozilla.org/integration/autoland/rev/24377f212a3299438f45b0887b85dc27913c3320
Log link: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=314139783&repo=autoland&lineNumber=4389

Comment 9

[Joel Maher ( :jmaher ) (UTC -8)]

thanks; these conditions are near impossible to get right editing them by hand, I think this was messed up with the rebase. testing new versions now.

Comment 10

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: Bug 1660625 - fix wpt expectations for windows 10 on hardware to pass on ccov. r=bc

fix wpt expectations for windows 10 on hardware to pass on ccov.

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/86d6c4ecc6c0
fix wpt expectations for windows 10 on hardware to pass on ccov. r=bc

Comment 12

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/86d6c4ecc6c0

Comment 13

[Intermittent Failures Robot]

1 failures in 4046 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1660625&startday=2020-08-24&endday=2020-08-30&tree=all