Closed Bug 1843184 Opened 2 years ago Closed 1 years ago

Ensure random whitespaces between characters don't trigger wrong translations

Categories

(Firefox :: Translations, enhancement)

Product:
Firefox
Component:
Translations
Type:
enhancement

Tracking

()

Status:
RESOLVED MOVED

People

(Reporter: marco, Unassigned)

References

Details

E.g. Chute de la Silicon Valley Bank : les leçons d’une faillite bancaire translates badly, Chute de la Silicon Valley Bank: les leçons d’une faillite bancaire translates correctly.

This might be an issue related to tokenization (see also https://github.com/google/sentencepiece#whitespace-is-treated-as-a-basic-symbol).

No longer depends on: 1842780

Moved to https://github.com/mozilla/firefox-translations-training/issues/176.

No longer blocks: 1842762
Status: NEW → RESOLVED
Closed: 1 years ago
Resolution: --- → MOVED
You need to log in before you can comment on or make changes to this bug.