Open Bug 1426406 Opened 6 years ago Updated 2 years ago

mach wpt exits with 0 when webrtc web-platform-tests encounter unexpected results

Categories

(Testing :: web-platform-tests, defect)

Product:
Testing
Component:
web-platform-tests
Version:
Version 3
Type:
defect

Tracking

(Not tracked)

People

(Reporter: bwc, Unassigned)

Details

Here's what I ran:

./mach wpt testing/web-platform/tests/webrtc &> test.out

This exited 0 even though the following failures were in the logging:

web-platform-test
~~~~~~~~~~~~~~~~~
Ran 1087 checks (76 tests, 1011 subtests)
Expected results: 1081
Skipped: 3 tests 
Unexpected results: 3
  subtest: 3 (3 pass)
    
Unexpected Logs
---------------
/webrtc/RTCPeerConnection-addTransceiver.html
  PASS expected FAIL addTransceiver('audio') should return an audio transceiver
  PASS expected FAIL addTransceiver('video') should return a video transceiver
  PASS expected FAIL addTransceiver(track) should have result with sender.track be given track
 6:04.24 LOG: MainThread INFO Closing logging queue
 6:04.24 LOG: MainThread INFO queue closed
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.