Closed Bug 1693935 Opened 5 years ago Closed 4 years ago

Enable Fission firefox-ui-functional-local and firefox-ui-functional-remote tests

Categories

(Testing :: Firefox UI Tests, task, P2)

task

Tracking

(Fission Milestone:M8)

RESOLVED DUPLICATE of bug 1694823
Fission Milestone M8

People

(Reporter: cpeterson, Unassigned)

References

(Blocks 1 open bug)

Details

Our testing strategy and list of tests we'd like to enable on which platforms:

https://docs.google.com/document/d/19MergQfMob2mdb_s7hlz5Ilj7Bn-Bbi324r6d2bZfxw/edit

We want to run these tests on:

  • debug and opt builds
    • Where “shippable” opt builds available, we prefer to test shippable opt builds on central and plain opt builds on autoland.
  • autoland and central
  • We prefer to run tests with Fission + WebRender (“qr”) where available.

Add platforms:

  • linux1804-64-qr/debug
  • linux1804-64-qr/opt on autoland, shippable-qr/shippable opt on central
  • linux1804-64-asan/opt
  • windows10-64-qr/debug
  • windows10-64-qr/opt on autoland, shippable-qr/shippable opt on central

This should not block Beta (M7).

Fission Milestone: M7 → M8
Component: DOM: Content Processes → Firefox UI Tests
Product: Core → Testing
QA Contact: hskupin

Chris those tests should basically get moved to Marionette unit tests, and the test jobs will be removed (bug 1573410). Not sure when exactly I will find the time for that. Chris what exactly does M8 mean? Maybe it will be possible to make it happen until that milestone.

Flags: needinfo?(cpeterson)

(In reply to Henrik Skupin (:whimboo) [⌚️UTC+1] from comment #2)

Chris those tests should basically get moved to Marionette unit tests, and the test jobs will be removed (bug 1573410). Not sure when exactly I will find the time for that.

In that case, I will close this bug in favor of bug 1694823 ("Enable Fission Marionette tests on more platforms").

Chris what exactly does M8 mean? Maybe it will be possible to make it happen until that milestone.

Fission's M7 milestone is "Launch an experiment for 1% of Windows and macOS Beta users." M8 is "Launch an experiment for 1% of Release channel users." M8 is basically the last milestone for finishing all the work we know about.

We will be adding a new sub-milestone (tentatively called "M7a") between M7 and M8 for work that doesn't block launching our 1% Beta experiment, but that we would like to fix sooner than our Release experiment. For example, we will move Linux bugs from M7 to M7a.

Most bugs to enable more Fission tests are in M7, but bugs for tests that are less likely to be impacted by Fission (such as this bug for Firefox UI tests) can be M7a or M8.

Status: NEW → RESOLVED
Closed: 4 years ago
Flags: needinfo?(cpeterson)
Resolution: --- → DUPLICATE
You need to log in before you can comment on or make changes to this bug.