Open Bug 1946998 Opened 1 month ago Updated 29 days ago

Translate text contained into images

Categories

(Firefox :: Translations, enhancement)

Product:
Firefox
Component:
Translations
Version:
Firefox 135
Type:
enhancement

Tracking

()

People

(Reporter: cafxx, Unassigned)

Details

User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:135.0) Gecko/20100101 Firefox/135.0

Steps to reproduce:

Visited a page with text in Japanese and images containing text in Japanese (most websites in Japan do this).

Actual results:

Text is translated, but text contained in images is not translated.

Expected results:

If an image contains text, the text should be extracted, translated, and overlaid on the original image. This is similar to how live translation happens e.g. in Google Lens. It is important to note that this should happen regardless of writing direction (e.g., for Japanese: left-right-then-top-to-bottom, top-to-bottom-then-right-to-left, etc.) and angle.

While this example uses Japanese, the same should happen for any language supported by Firefox Translations.

The Bugbug bot thinks this bug should belong to the 'Firefox::Translations' component, and is moving the bug to that component. Please correct in case you think the bot is wrong.

Component: Untriaged → Translations

Hello! Thank you for submitting this issue I will mark it as NEW in order to get our developers involved and provide a solution in further releases.

Have a nice day!

Flags: needinfo?(cafxx)
Status: UNCONFIRMED → NEW
Ever confirmed: true

Is the needinfo flag deliberate? If so please let me know which information I should provide and I will try to send it ASAP. Thanks!

Flags: needinfo?(cafxx)
You need to log in before you can comment on or make changes to this bug.