1323775 - gUM video freezes upon opening other app accessing camera in different aspect on OSX

Status: RESOLVED DUPLICATE of bug 1297029

(Core :: WebRTC: Audio/Video, defect)

Description

[Jan-Ivar Bruaroey [:jib] (needinfo? me)]

STR:
1. Open https://jsfiddle.net/srn9db4h/ and share camera.
2. Wave and keep waving
3. Open Photo Booth

Expected result:
- Still waving in the browser (albeit squished as Photo Booth uses different-aspect >640 resolution).

Actual result: gUM video freezes

Also happens with other apps, like Chrome or a different version Firefox. They key seems to a forced aspect change.

Workaround:
- Freezing only happens when aspect changes. So getUserMedia({ video: 1280 }) appears unaffected (keeps waving), as that's presumably the same aspect as what Photo Booth uses.

Regression range:

38:18.03 INFO: Last good revision: 8e697c3542ffbe810d6ecc9912a510216471e99b
38:18.03 INFO: First bad revision: 9fa7e2a17ee96abc884352ec5482642b5da30a57
38:18.03 INFO: Pushlog:
https://hg.mozilla.org/integration/mozilla-inbound/pushloghtml?fromchange=8e697c3542ffbe810d6ecc9912a510216471e99b&tochange=9fa7e2a17ee96abc884352ec5482642b5da30a57

i.e. Bug 1180725 - use AVFoundation for camera capture on OSX. r=jib

Comment 1

[Jan-Ivar Bruaroey [:jib] (needinfo? me)]

[Tracking Requested - why for this release]:

Comment 2

[Jan-Ivar Bruaroey [:jib] (needinfo? me)]

(In reply to Jan-Ivar Bruaroey [:jib] from comment #0)
> Workaround:
> - Freezing only happens when aspect changes. So getUserMedia({ video: 1280 }) appears unaffected

Uh, I meant getUserMedia({ video: { width: 1280 }}) here of course.

Comment 3

[Munro Mengjue Chiang [:mchiang] Be Mozillian since 1/19/2018]

I can reproduce the problem in chrome with below page
https://jsfiddle.net/mezjonmg/

When the issue occurs, we keep receiving the didDropSampleBuffer callback from avfoundation.

https://developer.apple.com/reference/avfoundation/avcapturevideodataoutputsamplebufferdelegate/1388468-captureoutput?language=objc

I guess avfoundation drop the frame when it cannot fulfill the requirement from two different clients.

Comment 4

[Gerry Chang [:gchang]]

Track 51+ as regression.

Comment 5

[Munro Mengjue Chiang [:mchiang] Be Mozillian since 1/19/2018]

This bug should be a duplicate of bug 1297029.

Comment 7

[Marcia Knous [:marcia]]

Updating tracking flags so this falls off the release health dashboard.

Comment 8

[Munro Mengjue Chiang [:mchiang] Be Mozillian since 1/19/2018]

I am not working on this bug.