1864472 - Translations feature displays Umlauts as Question Marks

Status: RESOLVED MOVED

(Firefox :: Translations, defect, P3)

Description

[Johannes Neumann]

User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:109.0) Gecko/20100101 Firefox/119.0

Steps to reproduce:

1. Visit https://www.gov.br/mre/pt-br/embaixada-berlim/de/kultur/event/201ebatismo201c-gleeson-paulino

2. Use offline translator to translate from Portuguese to German

Note: the main content is already German but the same can be seen here https://www.gov.br/mre/pt-br/embaixada-berlim/OndEstmecontat e.g. with the phrase "Märkisches Museum" which becomes "M?rkisches Museum".

Actual results:

All Umlauts ("Ä", "Ö", "Ü") as well as "ß" are displayed as "?" while the untranslated version displays it just fine.

Expected results:

Umlauts present in the original should be retained in the translation

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

The Bugbug bot thinks this bug should belong to the 'Firefox::Translation' component, and is moving the bug to that component. Please correct in case you think the bot is wrong.

Comment 2

[Dana Lucaci, Desktop QA]

Reproduced the issue with Firefox 119.0 (2023-10-19) and Firefox 120.0 (2023-11-13) on Win 10 and macOS 12 ARM . Indeed when I translate the page ( step 1) from Portuguese to German the "Ä", "Ö", "Ü" characters are displayed as "?".
Marking issue as new for engineering input. Thank you.

Comment 3

[Greg Tatum [:gregtatum] (REO Fx132)]

This is a quality issue in the models, and it's probably made worse by the pivot translation.

Comment 4

[Greg Tatum [:gregtatum] (REO Fx132)]

This should be fixed by retraining the models with robustness fixes: https://github.com/mozilla/firefox-translations-training/issues/757

I can't reproduce currently because the website is down at the moment.