1713444 - Permanent TEST-UNEXPECTED-PASS | /webrtc/RTCRtpSender-replaceTrack.https.html | ReplaceTrack transmits the new track not the old track - expected TIMEOUT when Gecko 90 merges to Beta on 2021-05-31

Status: VERIFIED FIXED

(Core :: WebRTC, defect)

Description

[Iulian Moraru]

Central-as-beta simulation: https://treeherder.mozilla.org/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=0d3c85be4604dd47871c15b90af95e978486000a&selectedTaskRun=CCesIYbyS_SHgbjTsRkOJw.0

How to run these simulations: https://wiki.mozilla.org/Sheriffing/How_To/Beta_simulations#TRUNK_AS_EARLY_BETA

Failure Summary: https://treeherder.mozilla.org/logviewer?job_id=341149666&repo=try&lineNumber=6642

[task 2021-05-29T12:04:03.873Z] 12:04:03 INFO - TEST-START | /webrtc/RTCRtpSender-replaceTrack.https.html
[task 2021-05-29T12:04:03.901Z] 12:04:03 INFO - Closing window 70e442b0-4572-4b58-971a-1f2cab421e09
[task 2021-05-29T12:04:05.068Z] 12:04:05 INFO -
[task 2021-05-29T12:04:05.068Z] 12:04:05 INFO - TEST-FAIL | /webrtc/RTCRtpSender-getStats.https.html | sender.getStats() via addTrack should return stats report containing outbound-rtp stats - assert_equals: Expect dictionary.transportId to be string expected "string" but got "undefined"
[task 2021-05-29T12:04:05.068Z] 12:04:05 INFO - assert_string_field@https://web-platform.test:8443/webrtc/dictionary-helper.js:20:16
[task 2021-05-29T12:04:05.068Z] 12:04:05 INFO - validateIdField@https://web-platform.test:8443/webrtc/RTCStats-helper.js:121:22
[task 2021-05-29T12:04:05.068Z] 12:04:05 INFO - validateIceCandidateStats@https://web-platform.test:8443/webrtc/RTCStats-helper.js:915:18
[task 2021-05-29T12:04:05.068Z] 12:04:05 INFO - validateStatsReport@https://web-platform.test:8443/webrtc/RTCStats-helper.js:64:16
[task 2021-05-29T12:04:05.068Z] 12:04:05 INFO - @https://web-platform.test:8443/webrtc/RTCRtpSender-getStats.https.html:71:24
[task 2021-05-29T12:04:05.068Z] 12:04:05 INFO - TEST-PASS | /webrtc/RTCRtpSender-replaceTrack.https.html | Calling replaceTrack on closed connection should reject with InvalidStateError
[task 2021-05-29T12:04:05.068Z] 12:04:05 INFO - TEST-PASS | /webrtc/RTCRtpSender-replaceTrack.https.html | Calling replaceTrack with track of different kind should reject with TypeError
[task 2021-05-29T12:04:05.068Z] 12:04:05 INFO - TEST-PASS | /webrtc/RTCRtpSender-replaceTrack.https.html | Calling replaceTrack on stopped sender should reject with InvalidStateError
[task 2021-05-29T12:04:05.068Z] 12:04:05 INFO - TEST-PASS | /webrtc/RTCRtpSender-replaceTrack.https.html | Calling replaceTrack on sender with null track and not set to session description should resolve with sender.track set to given track
[task 2021-05-29T12:04:05.068Z] 12:04:05 INFO - TEST-PASS | /webrtc/RTCRtpSender-replaceTrack.https.html | Calling replaceTrack on sender not set to session description should resolve with sender.track set to given track
[task 2021-05-29T12:04:05.068Z] 12:04:05 INFO - TEST-PASS | /webrtc/RTCRtpSender-replaceTrack.https.html | Calling replaceTrack(null) on sender not set to session description should resolve with sender.track set to null
[task 2021-05-29T12:04:05.068Z] 12:04:05 INFO - TEST-PASS | /webrtc/RTCRtpSender-replaceTrack.https.html | Calling replaceTrack(null) on sender set to session description should resolve with sender.track set to null
[task 2021-05-29T12:04:05.069Z] 12:04:05 INFO - TEST-PASS | /webrtc/RTCRtpSender-replaceTrack.https.html | Calling replaceTrack on sender with stopped track and and set to session description should resolve with sender.track set to given track
[task 2021-05-29T12:04:05.069Z] 12:04:05 INFO - TEST-PASS | /webrtc/RTCRtpSender-replaceTrack.https.html | Calling replaceTrack on sender with similar track and and set to session description should resolve with sender.track set to new track
[task 2021-05-29T12:04:05.069Z] 12:04:05 INFO - TEST-UNEXPECTED-PASS | /webrtc/RTCRtpSender-replaceTrack.https.html | ReplaceTrack transmits the new track not the old track - expected TIMEOUT
[task 2021-05-29T12:04:05.069Z] 12:04:05 INFO - TEST-INFO | expected TIMEOUT
[task 2021-05-29T12:04:05.184Z] 12:04:05 INFO - TEST-KNOWN-INTERMITTENT-OK | /webrtc/RTCRtpSender-replaceTrack.https.html | took 1310ms
[task 2021-05-29T12:04:05.512Z] 12:04:05 INFO - STDOUT: cleanup aborted: Unable to remount device
[task 2021-05-29T12:04:05.624Z] 12:04:05 INFO - STDOUT: cleanup aborted: Unable to remount device
[task 2021-05-29T12:04:05.626Z] 12:04:05 INFO - Closing logging queue
[task 2021-05-29T12:04:05.626Z] 12:04:05 INFO - queue closed
[task 2021-05-29T12:04:05.648Z] 12:04:05 INFO - Setting up ssl
[task 2021-05-29T12:04:05.668Z] 12:04:05 INFO - certutil | b''
[task 2021-05-29T12:04:05.682Z] 12:04:05 INFO - certutil | b''
[task 2021-05-29T12:04:05.694Z] 12:04:05 INFO - certutil | b'\nCertificate Nickname Trust Attributes\n SSL,S/MIME,JAR/XPI\n\nweb-platform-tests CT,, \n'
[task 2021-05-29T12:04:06.550Z] 12:04:06 INFO - adb Granting important runtime permissions to org.mozilla.geckoview.test
[task 2021-05-29T12:04:07.810Z] 12:04:07 INFO - adb launch_application: am start -W -n org.mozilla.geckoview.test/org.mozilla.geckoview.test.TestRunnerActivity -a android.intent.action.MAIN --es env0 MOZ_CRASHREPORTER=1 --es env1 MOZ_CRASHREPORTER_NO_REPORT=1 --es env2 MOZ_CRASHREPORTER_SHUTDOWN=1 --es env3 MOZ_HIDE_RESULTS_TABLE=1 --es env4 MOZ_IN_AUTOMATION=1 --es env5 MOZ_LOG=signaling:3,mtransport:4,DataChannel:4,jsep:4 --es env6 R_LOG_LEVEL=6 --es env7 R_LOG_DESTINATION=stderr --es env8 R_LOG_VERBOSE=1 --es env9 MOZ_PROCESS_LOG=/tmp/tmp8ytwr367pidlog --es env10 MOZ_DISABLE_NONLOCAL_CONNECTIONS=1 --es env11 STYLO_THREADS=1 --es env12 MOZ_WEBRENDER=1 --es arg0 -no-remote --es arg1 -profile --es arg2 /data/local/tmp/test_root/profile --es arg3 --marionette --es arg4 about:blank --ez use_multiprocess True
[task 2021-05-29T12:04:08.666Z] 12:04:08 INFO - Starting runner
[task 2021-05-29T12:04:09.249Z] 12:04:09 INFO - TEST-START | /webrtc/RTCRtpSender-setParameters.html

Comment 1

[Intermittent Failures Robot]

7 failures in 2908 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 7

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 1
  • opt: 1
• android-em-7-0-x86_64-shippable-qr: 6
  • opt: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1713444&startday=2021-05-24&endday=2021-05-30&tree=all

Comment 2

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 1713444 - Set test step in RTCRtpSender-replaceTrack.https.html back to passing outside Nightly. r=jgraham DONTBUILD

The test got set to the failing expectation by the expectation update in
bug 1712994.

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/c0b1985bdd8c
Set test step in RTCRtpSender-replaceTrack.https.html back to passing outside Nightly. r=jgraham DONTBUILD

Comment 4

[Atila Butkovits]

https://hg.mozilla.org/mozilla-central/rev/c0b1985bdd8c

Comment 5

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/releases/mozilla-beta/rev/a12bf87074ff

Comment 6

[Andreea Pavel [:apavel]]

Verified fixed in latest beta sim: https://treeherder.mozilla.org/jobs?repo=try&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunning%2Cpending%2Crunnable&revision=5380b05e2dff2ca0546324451b7dee804f81771d

Comment 7

[Intermittent Failures Robot]

8 failures in 3065 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 8

Platform and build breakdown:

• android-em-7-0-x86_64-shippable: 4
  • opt: 4
• android-em-7-0-x86_64-shippable-qr: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1713444&startday=2021-05-31&endday=2021-06-06&tree=all