1548066 - adjust test expectations to keep web-platform-tests on win/aarch64 green

Status: RESOLVED FIXED

(Testing :: web-platform-tests, defect)

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

you can see the failures here:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&revision=eb1856c0dc21b8c431818b09ed7628702e3679d5

Comment 2

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: Bug 1548066 - Fix web-platform-tests on windows/aarch64. r=egao

Fix web-platform-tests on windows/aarch64

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

most of the fixes here are removing known crashes, but adding 2 files and a couple other disabled or expected fail.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/8cd6ecc6fc39
Fix web-platform-tests on windows/aarch64. r=egao

Comment 5

[Byron Campen [:bwc]]

Why was RTCRtpTransceiver.https.html disabled here?

Comment 6

[Joel Maher ( :jmaher ) (UTC -8)]

of course I linked to the one m-c revision where it didn't show that test failing:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&searchStr=win%2Cweb-platform%2Caarch64%2Cwpt10

it fails >50% of the time:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&searchStr=win%2Cweb-platform%2Caarch64%2Cwpt10&selectedJob=243534528

here is a snippet from the log:
09:56:47 INFO - TEST-PASS | /webrtc/RTCRtpTransceiver.https.html | checkAddTrackPairs
09:56:47 INFO - TEST-PASS | /webrtc/RTCRtpTransceiver.https.html | checkReplaceTrackNullDoesntPreventPairing
09:56:47 INFO - TEST-PASS | /webrtc/RTCRtpTransceiver.https.html | checkRemoveAndReadd
09:56:47 INFO - TEST-PASS | /webrtc/RTCRtpTransceiver.https.html | checkAddTrackExistingTransceiverThenRemove
09:56:47 INFO - TEST-PASS | /webrtc/RTCRtpTransceiver.https.html | checkRemoveTrackNegotiation
09:56:47 INFO - TEST-UNEXPECTED-TIMEOUT | /webrtc/RTCRtpTransceiver.https.html | checkMute - Test timed out

could it be that since these laptops are slower than other tests that we just need to extend the timeout a bit?

Comment 7

[Byron Campen [:bwc]]

So those logs look like a legitimate problem. I have filed bug 1548124 for this.

Comment 8

[Cristina Coroiu [:ccoroiu]]

https://hg.mozilla.org/mozilla-central/rev/8cd6ecc6fc39