1680528 - Perma central-as-beta wpt unexpected passes and oks e.g. TEST-UNEXPECTED-PASS | /webrtc/RTCPeerConnection-videoDetectorTest.html | Signal detector detects track change within reasonable time when Gecko 85 merges to Beta on 2020-12-14

Status: VERIFIED FIXED

(Core :: WebRTC, defect)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Likely from bug 1680313, only affecting Android.

central-as-beta simulation
Failure Log wpt2
Failure Log wpt4

Nils, is it sufficient to update the test expectations or does anything else need to be done here?

Comment 1

[Intermittent Failures Robot]

12 failures in 3712 pushes (0.003 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 12

Platform breakdown:

• android-em-7-0-x86_64-qr: 4
• android-em-7-0-x86_64-shippable-qr: 4
• android-em-7-0-x86_64-shippable: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1680528&startday=2020-11-30&endday=2020-12-06&tree=all

Comment 2

[Nils Ohlmeier [:drno]]

Yes adjusting the test expectations for now appears to be the right thing.
Looks like the main discussion on why is happening in https://bugzilla.mozilla.org/show_bug.cgi?id=1526207

Comment 3

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 1680528 - set several webrtc/mediacapturing test as passing on beta and release. r=drno DONTBUILD

More details about the underlying issue in bug 1526207.

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/df528e4618e4
set several webrtc/mediacapturing test as passing on beta and release. r=drno DONTBUILD

Comment 5

[Dorel Luca [:dluca]]

https://hg.mozilla.org/mozilla-central/rev/df528e4618e4

Comment 6

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Will need a follow-up fix, is in testing.

Comment 7

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Attachment: Bug 1680528 - two corrections to webrtc/mediacapturing expectations on beta and release. r=drno DONTBUILD

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/bd7df75fb798
two corrections to webrtc/mediacapturing expectations on beta and release. r=drno DONTBUILD

Comment 9

[Razvan Maries]

https://hg.mozilla.org/mozilla-central/rev/bd7df75fb798

Comment 10

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Verified fixed in today's [central-as-beta simulation}(https://treeherder.mozilla.org/jobs?repo=try&group_state=expanded&resultStatus=testfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel%2Crunnable&revision=7733a076014924cd4185ff42b7554e371910e20e).

Comment 11

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

https://hg.mozilla.org/releases/mozilla-release/rev/e55ab18f3df3

Comment 12

[Intermittent Failures Robot]

20 failures in 4060 pushes (0.005 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-beta: 3
• mozilla-release: 17

Platform breakdown:

• android-em-7-0-x86_64-qr: 8
• android-em-7-0-x86_64-shippable: 6
• android-em-7-0-x86_64-shippable-qr: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1680528&startday=2020-12-07&endday=2020-12-13&tree=all