1924192 - Set up infrastructure for Translations end-to-end testing in Firefox CI

Status: RESOLVED FIXED

(Firefox :: Translations, task, P2)

Description

[Erik Nordin [:nordzilla]]

Description

With upcoming modifications to the Translations inference engine and WASM bindings to support CJK translations, there is a stronger need to have end-to-end testing in Firefox CI to ensure that our latest inference-engine WASM binary runs successfully.

We should implement a way to run the actual inference engine in some CI tests, rather than just a mocked engine.

---

Steps to implement

• Split Translations tests into their own test group.
• Fetch Translations artifacts from Remote Settings for use in CI.
• Define a new end-to-end test that utilizes the real inference engine.

Comment 1

[Erik Nordin [:nordzilla]]

Attachment: Bug 1924192 - Create mochitest-browser-translations test definition

Comment 2

[Erik Nordin [:nordzilla]]

Attachment: Bug 1924192 - Define fetch task for Translations e2e tests

Depends on D225414

Comment 3

[Erik Nordin [:nordzilla]]

Attachment: Bug 1924192 - Translations e2e test infrastructure

Depends on D225415

Comment 4

[Erik Nordin [:nordzilla]]

Attachment: WIP: Bug 1924192 - Try to fix fetches

Depends on D225415

Comment 5

[Erik Nordin [:nordzilla]]

Attachment: Bug 1924192 - Vendor taskcluster_taskgraph v11.2.3

Comment 6

[Erik Nordin [:nordzilla]]

Attachment: Bug 1924192 - Vendor taskcluster_taskgragph v11.2.4

Comment 7

[Erik Nordin [:nordzilla]]

Attachment: Bug 1924192 - Refactor assertPageIsTranslated args

Refactors the assertPageIsTranslated function to take
an object with named entries, rather than taking several
order-dependent parameters.

Depends on D225415

Comment 8

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/a46b6607f18f
Vendor taskcluster_taskgragph v11.2.4 r=mach-reviewers,ahal,ahochheiden
https://hg.mozilla.org/integration/autoland/rev/7161afe20737
Create mochitest-browser-translations test definition r=translations-reviewers,jmaher,sparky,gregtatum
https://hg.mozilla.org/integration/autoland/rev/da8005f82550
Define fetch task for Translations e2e tests r=jmaher,sparky
https://hg.mozilla.org/integration/autoland/rev/e263a298d0ce
Refactor assertPageIsTranslated args r=translations-reviewers,gregtatum
https://hg.mozilla.org/integration/autoland/rev/f3e13ae5c26f
Translations e2e test infrastructure r=translations-reviewers,gregtatum

Comment 9

[Sandor Molnar[:smolnar]]

https://hg.mozilla.org/mozilla-central/rev/a46b6607f18f
https://hg.mozilla.org/mozilla-central/rev/7161afe20737
https://hg.mozilla.org/mozilla-central/rev/da8005f82550
https://hg.mozilla.org/mozilla-central/rev/e263a298d0ce
https://hg.mozilla.org/mozilla-central/rev/f3e13ae5c26f