1904628 - Investigate making language detection cheap enough to run on every page load

Status: NEW

(Firefox :: Translations, enhancement)

Description

[Greg Tatum [:gregtatum] (REO Fx132)]

Currently we don't run language detection on every page load, but maybe we should. It's really hard to get translations correct with just the language tag. I think the solution would be to integrate some kind of ML solution in the C++ side of things to make it cheap enough not to keep some big wasm thing around in the background. This bug is a central place to collect that work, and decision. We have Bug 1842777 to switch to fastText, but I'm skeptical it will be fast enough. CLD3 can be run from the C++ side, we have onnx runtime in Nightly through Wasm, and onnx runtime runs in C++ as well. We shouldlook at all of these options and figure out how best to solve this language ID problem.