1914925 - Apple Studio Display Microphone Not Working

Status: RESOLVED FIXED

(Core :: Audio/Video: cubeb, defect, P2)

Description

[James McKenzie]

Steps to reproduce:

User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:129.0) Gecko/20100101 Firefox/129.0.

Using a MacBook Pro (macOS 14.5) with an Apple Studio Display connected, visit a website that requires microphone access and that gives you a choice of which microphone to use. For example, https://codepen.io/eddch/pen/ZMOjPL or https://online-voice-recorder.com.

Give the website permission to use the Apple Studio Display Microphone (or all microphones). Use the website's UI to ensure you have selected Apple Studio Display Microphone as your selected microphone.

Try to record some sound and see that you either receive an error or record silence.

By contrast, select the MacBook Pro Microphone instead. Ensure the MacBook Pro lid is open. Try recording again and confirm it is successfully able to capture sound.

Actual results:

You either receive an error or record silence.

Expected results:

The website should have successfully captured sound from the Apple Studio Display Microphone.

Comment 1

[James McKenzie]

Note that the Apple Studio Display Microphone is functioning normally when doing these same steps in Chrome.

Comment 2

[Francesco Lodolo [:flod]]

Please move if there is a better product/component for this bug.

Comment 3

[John Lin [:jhlin][:jolin]]

Moving to WebRTC: Audio/Video.

Comment 4

[Andreas Pehrson [:pehrsons]]

Does this happen only when the Studio Display is also default speaker on your system?
If so, a known issue with VPIO, happens in Safari as well, and reported to Apple.
The symptoms I've seen is that sometimes (not 0% and not 100%, but the rate may vary between Firefox and Safari) it works as expected, other times the input audio we receive from the Studio Display Mic is actually the output audio from the Studio Display Speakers. I.e. it appears to be an AEC reference stream mixup.

We have a block list for this particular case though, so I wonder why that is not working.

I might see a bug here. Could you confirm whether input audio starts working 10 seconds into the capture, when it starts out broken? Also, on about:config, does setting the pref media.getusermedia.microphone.voice_stream_priming.enabled to false prior to starting the capture help?

Tentatively marking the regression on this assumption.

Comment 5

[James McKenzie]

Thank you Andreas, you're onto something!

• This does happen only when the Studio Display is also default speaker on your system.
• Waiting for 10 seconds does not help.
• Setting media.getusermedia.microphone.voice_stream_priming.enabled to false does overcome the issue. However, on https://codepen.io/eddch/pen/ZMOjPL, if I initially select Studio Display Mic and then switch to a different mic and then reselect the Studio Display Mic, then it no longer works.

Comment 6

[Andreas Pehrson [:pehrsons]]

(In reply to James McKenzie from comment #5)

Thank you Andreas, you're onto something!

• This does happen only when the Studio Display is also default speaker on your system.
• Waiting for 10 seconds does not help.
• Setting media.getusermedia.microphone.voice_stream_priming.enabled to false does overcome the issue. However, on https://codepen.io/eddch/pen/ZMOjPL, if I initially select Studio Display Mic and then switch to a different mic and then reselect the Studio Display Mic, then it no longer works.

Ok, thanks. I might be able to improve this, but I'm not sure I can fix it entirely. Please also file with Apple through Feedback Assistant on SDKs/Core Audio that the VoiceProcessingIO audio unit frequently doesn't provide the correct input stream when Studio Display is used for both input and output.

Comment 7

[Andreas Pehrson [:pehrsons]]

Tested and confirmed.

Comment 8

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1903002

Comment 9

[Andreas Pehrson [:pehrsons]]

Looks like a 1-liner will do: https://github.com/mozilla/cubeb-coreaudio-rs/pull/235

Hopefully this issue is not triggered for non-VPIO units using the Studio Display devices when setting up VPIO for other devices. I haven't tested that thoroughly. That wouldn't be an issue we can address anyway, and it is much more of a corner case than the reported issue.

Comment 10

[Andreas Pehrson [:pehrsons]]

The priming pref wasn't re-enabled until 129.

Comment 11

[Andreas Pehrson [:pehrsons]]

Attachment: Bug 1914925 - Update cubeb-coreaudio-rs to revision 2407441a2f. r?#cubeb-reviewers

Comment 12

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/d80f46ac8396
Update cubeb-coreaudio-rs to revision 2407441a2f. r=cubeb-reviewers,padenot

Comment 13

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/d80f46ac8396

Comment 14

[Andreas Pehrson [:pehrsons]]

Attachment: Bug 1914925 - Update cubeb-coreaudio-rs to revision 2407441a2f. r?#cubeb-reviewers

Original Revision: https://phabricator.services.mozilla.com/D222293

Comment 15

[Phabricator Automation]

beta Uplift Approval Request

• User impact if declined: Apple Studio Display microphone doesn't work in some situations
• Code covered by automated testing: no
• Fix verified in Nightly: no
• Needs manual QE test: no
• Steps to reproduce for manual QE testing: None
• Risk associated with taking this patch: Very low
• Explanation of risk level: Trivial change, blocking the macOS voice processing audio unit for the Studio Display in input-only cases
• String changes made/needed: None
• Is Android affected?: no

Comment 16

[Dianna Smith [:diannaS]]

Comment on attachment 9425194 [details]
Bug 1914925 - Update cubeb-coreaudio-rs to revision 2407441a2f. r?#cubeb-reviewers

Approved for 131.0b8

Comment 17

[Pulsebot]

https://hg.mozilla.org/releases/mozilla-beta/rev/0cd3b933e87a

Comment 18

[Dianna Smith [:diannaS]]

Comment on attachment 9425194 [details]
Bug 1914925 - Update cubeb-coreaudio-rs to revision 2407441a2f. r?#cubeb-reviewers

Backed out of beta for causing lint failures
try build
Back out link: https://hg.mozilla.org/releases/mozilla-beta/rev/cde74cd18107f85b974bfafb94e7868b24a87e22
Failure push
Failure log

Comment 19

[Pulsebot]

https://hg.mozilla.org/releases/mozilla-beta/rev/d2c130d79fa0

Comment 20

[James McKenzie]

I tried this out using Firefox 131 today, and it is working when you select Apple Studio Display Microphone as your initial microphone choice when first visiting https://codepen.io/eddch/pen/ZMOjPL.

However, if I then choose a different microphone, and then switch back to Apple Studio Display Microphone, it no longer picks up any sound.

Comment 21

[Andreas Pehrson [:pehrsons]]

Let's continue in bug 1922588.