Closed Bug 1548066 Opened 7 months ago Closed 7 months ago

adjust test expectations to keep web-platform-tests on win/aarch64 green

Categories

(Testing :: web-platform-tests, defect)

Version 3
defect
Not set

Tracking

(firefox68 fixed)

RESOLVED FIXED
mozilla68
Tracking Status
firefox68 --- fixed

People

(Reporter: jmaher, Assigned: jmaher)

Details

Attachments

(1 file)

No description provided.

Fix web-platform-tests on windows/aarch64

most of the fixes here are removing known crashes, but adding 2 files and a couple other disabled or expected fail.

Pushed by jmaher@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/8cd6ecc6fc39
Fix web-platform-tests on windows/aarch64. r=egao

Why was RTCRtpTransceiver.https.html disabled here?

Flags: needinfo?(jmaher)

of course I linked to the one m-c revision where it didn't show that test failing:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&searchStr=win%2Cweb-platform%2Caarch64%2Cwpt10

it fails >50% of the time:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-central&searchStr=win%2Cweb-platform%2Caarch64%2Cwpt10&selectedJob=243534528

here is a snippet from the log:
09:56:47 INFO - TEST-PASS | /webrtc/RTCRtpTransceiver.https.html | checkAddTrackPairs
09:56:47 INFO - TEST-PASS | /webrtc/RTCRtpTransceiver.https.html | checkReplaceTrackNullDoesntPreventPairing
09:56:47 INFO - TEST-PASS | /webrtc/RTCRtpTransceiver.https.html | checkRemoveAndReadd
09:56:47 INFO - TEST-PASS | /webrtc/RTCRtpTransceiver.https.html | checkAddTrackExistingTransceiverThenRemove
09:56:47 INFO - TEST-PASS | /webrtc/RTCRtpTransceiver.https.html | checkRemoveTrackNegotiation
09:56:47 INFO - TEST-UNEXPECTED-TIMEOUT | /webrtc/RTCRtpTransceiver.https.html | checkMute - Test timed out

could it be that since these laptops are slower than other tests that we just need to extend the timeout a bit?

Flags: needinfo?(jmaher) → needinfo?(docfaraday)

So those logs look like a legitimate problem. I have filed bug 1548124 for this.

Flags: needinfo?(docfaraday)
Status: NEW → RESOLVED
Closed: 7 months ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla68
Assignee: nobody → jmaher
You need to log in before you can comment on or make changes to this bug.