1698849 - Avoid mochitest chrome/a11y in TV with Fission

Status: RESOLVED FIXED

(Testing :: General, defect, P2)

Description

[Andrew Halberstadt [:ahal]]

In bug 1689061 we stood up some fission test-verify tasks. However, when a mochitest chrome or a11y task is modified, TV will automatically disable e10s (as those suites don't support e10s). However fission requires e10s, so we get failures like the one in bug 1698008.

It looks like mozharness is responsible for selecting TV suites here:
https://searchfox.org/mozilla-central/source/testing/mozharness/mozharness/mozilla/testing/per_test_base.py#454

So I guess we need some logic there to avoid mochitest-a11y and mochitest-chrome when the task will be running with Fission

Comment 1

[Geoff Brown [:gbrown]]

In the past I have tried to keep to the strategy: "Only enable TV on a platform when all TV-supported suites are supported on that platform." But this seems like a reasonable exception.

If possible, I would like to avoid selecting chrome/a11y tests during find_misc_tests(), when running against fission; I can have a look at that.

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1689061

Comment 3

[Geoff Brown [:gbrown]]

Attachment: Bug 1698849 - Avoid TV-fis failure for mochitest-chrome/a11y; r=

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/3d3c707bc200
Avoid TV-fis failure for mochitest-chrome/a11y; r=jmaher

Comment 5

[Bogdan Tara[:bogdan_tara | bogdant]]

https://hg.mozilla.org/mozilla-central/rev/3d3c707bc200