1911609 - AI shortcut doesn't appear near the selected text when the page is zoomed

Status: ASSIGNED

(Core :: Machine Learning, defect)

Description

[Chris Peterson [:cpeterson]]

Attachment: screenshot.png

Steps to reproduce

1. Enable the AI shortcut and set page zoom to 100% (default).
2. Load a page (such as https://example.com) and double-click to select some text on a web page.
3. See that the AI shortcut is displayed below and to the right of the selected text.
4. Increase page zoom to 200% (using Ctrl + +)
5. Double-click to select some text on the page again.

Expected result

The AI shortcut should still be displayed below and to the right of the selected text.

Actual result

The AI shortcut is display far above and to the left of the selected text. The more you zoom the page, the farther above and to the left the AI shortcut is displayed. See the attached screenshot.

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

The severity field is not set for this bug.
:tarek, could you have a look please?

For more information, please visit BugBot documentation.

Comment 2

[Ed Lee :Mardak]

https://phabricator.services.mozilla.com/D226847#inline-1266845
review comment in bug 1922623 suggests this might want to be scaled with * this.contentWindow.devicePixelRatio

https://searchfox.org/mozilla-central/rev/fcf53e1685bfb990b5abc7312ac1daf617f0991f/browser/actors/ContextMenuChild.sys.mjs#764-765

Comment 3

[Emilio Cobos Álvarez (:emilio)]

Attachment: Bug 1911609 - Fix zoom handling in GenAI shortcuts. r=ngrato