1842237 - Consider using macOS Ventura's integrated screen-sharing picker (SCContentSharingPicker)

Status: NEW

(Firefox :: Site Permissions, enhancement, P3)

Description

[Jan-Ivar Bruaroey [:jib] (needinfo? me)]

Attachment: image.png

+++ This bug was initially created as a clone of Bug #1637791 +++

Consider using macOS Ventura's built-in OS screen-sharing picker for a more integrated user experience on macOS.

STRs to show off the feature in Safari:

1. Open https://jan-ivar.github.io/dummy/gdm.html in Safari in macOS Ventura 13 or newer
2. Click the User gesture button on the page
3. In the OS picker, choose e.g. "Allow to Share Window"

This shows macOS Ventura's built-in window picker where the user sees an OS highlight over any window they hover over, and a "Share This Window" button centered on the window (see screenshot). There's also other ways to select or even switch which window is being shared from an added OS button with a dropdown on the window itself.

Apparently, this UX experience is available to third party apps starting with macOS 14 beta.

SCContentSharingPicker is described in https://developer.apple.com/documentation/screencapturekit/sccontentsharingpicker

See also video https://developer.apple.com/videos/play/wwdc2023/10136/?time=309

Comment 1

[Jan-Ivar Bruaroey [:jib] (needinfo? me)]

Attachment: image.png

There's also other ways to select or even switch which window is being shared from an added OS button with a dropdown on the window itself.

It looks like this.

Comment 2

[Jim Mathies [:jimm]]

(In reply to Jan-Ivar Bruaroey [:jib] (needinfo? me) from comment #1)

Created attachment 9343782 [details]
image.png

There's also other ways to select or even switch which window is being shared from an added OS button with a dropdown on the window itself.

It looks like this.

Does the OS notify us when these menu items are selected such that we can change what we capture?

Comment 3

[Jim Mathies [:jimm]]

Through this work, we may be able to remove the double camera icons by moving our options into the os drop down.

Comment 4

[Andreas Pehrson [:pehrsons]]

This work could possibly also go into the ScreenCaptureKit capture backend, with our UI showing screen and window placeholders. It would be similar to Safari and Chrome (the latter needs a feature flag set right now, so could perhaps change) in the sense that the user first gets a browser dialog to choose whether to share a window or a screen, then that is used to configure SCContentSharingPicker.

Comment 5

[Andreas Pehrson [:pehrsons]]

We now use SCContentSharingPicker on macOS 15, landed in Firefox 132.

Comment 6

[Jim Mathies [:jimm]]

Release Note Request (optional, but appreciated)
[Why is this notable]: Adding support for newer built-in Mac screen and window sharing features.
[Affects Firefox for Android]: No
[Suggested wording]:
Firefox 132 adds support for Mac's new screen and window sharing selection features.
[Links (documentation, blog post, etc)]: N/A

Comment 7

[Ryan VanderMeulen [:RyanVM]]

Moving the relnote request over to bug 1918996.