1710666 - Offer screenshot API to Gecko

Status: NEW

(GeckoView :: General, task, P3)

Description

[[ex-Mozilla] Agi Sferro | :agi]

Web Driver / Marionette take periodic screnshots of the browser when running tests. Today these screenshots are taken from the Gecko side so they don't include any of the browser UI. We should provide a hook to Gecko to take a screenshot of the entire Android screen from the java side so that it includes the App UI.

Something like @WrapForJNI GeckoAppShell::screenshot or whatever should be enough.

Comment 1

[Henrik Skupin [:whimboo][⌚️UTC+1]]

Note that Marionette works with two contexts. By default content scope is active, which only allows screenshots from the current content browser and should actually work. But when switching to chrome scope, which interacts with the Firefox ui, this specific requirement will be necessary.

Comment 2

[[ex-Mozilla] Agi Sferro | :agi]

Hey Henrik, Olivia and I were looking into this and we have a question, would you call this method from C++ or JS? could you link to the code that would call this (if it exists).

Comment 3

[Henrik Skupin [:whimboo][⌚️UTC+1]]

All Marionette is written in JS, so nothing would be called from the C++/Rust side. Capturing the browser for both content or chrome is currently done via browsingContext.currentWindowGlobal.drawSnapshot(). It would be great if that could be the same for Android. If not, we would have to adjust the code.

Comment 4

[Olivia Hall [:olivia]]

Attachment: WIP: Bug 1710666 - Added screenshot feature to capture entire Android screen for testing.

Existing screenshot features capture GeckoView portion without UI elements.
This feature also captures the UI elements.

Comment 5

[Emily Toop (:fluffyemily)]

Removed from release. Java side is done, needs integration into Gecko. We will come back to this at a later date as other work has greater priority.

Comment 6

[Chris Peterson [:cpeterson]]

Tasks should have severity N/A.