1694836 - Enable Fission mochitest-remote tests on more platforms

Status: RESOLVED INCOMPLETE

(Firefox Build System :: Task Configuration, task, P3)

Description

[Chris Peterson [:cpeterson]]

Our testing strategy and list of tests we'd like to enable on which platforms:

https://docs.google.com/document/d/19MergQfMob2mdb_s7hlz5Ilj7Bn-Bbi324r6d2bZfxw/edit

We want to run these tests on:

• debug and opt builds
  • Where “shippable” opt builds available, we prefer to test shippable opt builds on central and plain opt builds on autoland.
• autoland and central
• We prefer to run tests with Fission + WebRender (“qr”) for tests already running with WebRender enabled: so enabling Fission with WebRender on linux1804-64-qr but Fission without WebRender on linux1804-64-asan and Windows.

Add platforms:

• linux1804-64-qr/debug
• linux1804-64-qr/opt on autoland, shippable/opt on central
• linux1804-64-asan/opt
• windows10-64/debug
• windows10-64/opt on autoland, shippable/opt on central

Comment 1

[Chris Peterson [:cpeterson]]

Assigning remaining "Enable Fission tests on more platforms" bugs to ahal.

Comment 3

[Andrew Halberstadt [:ahal]]

According to :whimboo remote agent does not support Fission and these tests would all fail. So unassigning for now.

Comment 4

[Chris Peterson [:cpeterson]]

TBD. If running mochitest-remote tests with Fission doesn't block Fission (bug 1601245), then we can defer this bug to Fission Future. I am waiting to hear from :whimboo in bug 1601245.

Comment 5

[Neha Kochar [:neha]]

Chris, is this accurate for M8? There is no triage owner and no one seems to be looking into this.

Comment 6

[Neha Kochar [:neha]]

I don't think we require mochitest-remote on all platfoms for Fission M8, or even MVP.

Comment 7

[Chris Peterson [:cpeterson]]

(In reply to Neha Kochar [:neha] from comment #6)

I don't think we require mochitest-remote on all platfoms for Fission M8, or even MVP.

We are not currently running mochitest-remote tests with Fission on any platform. I think we should run every test on at least one platform before experimenting on Release.

(In reply to Neha Kochar [:neha] from comment #5)

Chris, is this accurate for M8? There is no triage owner and no one seems to be looking into this.

These "Enable Fission tests on more platforms" bugs are on Andrew Halberstadt's radar, so I'll assign them all to him.

Comment 9

[Andrew Halberstadt [:ahal]]

According to https://bugzilla.mozilla.org/show_bug.cgi?id=1601245#c8 the remote agent (on which these tests depend) is not fission compatible (and there's apparently even question as to whether they want it to be compatible). So this appears to be blocked until that's resolved.

Comment 10

[Chris Peterson [:cpeterson]]

(In reply to Andrew Halberstadt [:ahal] from comment #9)

According to https://bugzilla.mozilla.org/show_bug.cgi?id=1601245#c8 the remote agent (on which these tests depend) is not fission compatible (and there's apparently even question as to whether they want it to be compatible). So this appears to be blocked until that's resolved.

I still don't fully understand the difference between bug 1601245 and this bug. They sound like duplicates to me, but keeping this bug open is not a big deal.

For now, since bug 1601245 has Fission Milestone "Future" (not a blocker for Fission MVP), then I will defer this bug to Fission Milestone "Future".

Comment 11

[Chris Peterson [:cpeterson]]

Closing this bug as unnecessary because this future test work will be fixed when we enable Fission by default in Nightly 96 and switch all tests from e10s to Fission.