1972647 - Enable Firefox Labs when Telemetry or Studies are Disabled

Status: RESOLVED FIXED

(Firefox :: Nimbus Desktop Client, enhancement, P3)

Description

[Beth Rennie [:beth] (she/her)]

In bug 1937147 we ported Firefox Labs to be powered by Nimbus, our A/B testing and feature delivery platform, which (as its configured) requires both telemetry and studies to be enabled in order to function. Nimbus was originally designed to be an A/B test platform and so it made sense at the time that if telemetry was disabled that Nimbus should be disabled because there if you need to collect data in order to do quantatative experimentation. However, as Nimbus has grown into more of a feature delivery platform, it no longer makes sense to gate everything behind having telemetry or even studies enabled. We should add a new preference toggle that enables/disables Firefox Labs and update the Nimbus logic as follows:

1. Telemetry disabled -> Experiments and rollouts are disabled except for Firefox Labs opt-ins(i.e., when recipe.isFirefoxLabsOptIn = true)
2. Studies disabled -> Experiments and rollouts are disabled EXCEPT for Firefox Labs opt-ins (i.e., when recipe.isFirefoxLabsOptIn = true)
3. Firefox Labs disabled -> Firefox Labs is disabled and experiments and rollouts work as normal

To implement this, we need to:

• Add a new pref to enable/disable Firefox Labs;
• Expose said pref on the Firefox Labs page;
• Update the Firefox labs page to not be hidden if there are no studies. Instead, it should say there are no available opt-ins / Firefox Labs is disabled;
• Update ExperimentManager._handleStudiesOptOut to exclude Firefox Labs opt-ins (unless they are also disabled);
• Update RemoteSettingsExperimentLoader.onEnabledPrefChanged to disable the itself if both Firefox Labs and either studies or telemetry is disabled;
• Add new MatchStatus entries for studies being disabled and Firefox Labs being disabled;
• Update EnrollmentsContext.checkRecipe to add additional checks for:
  • Firefox Labs being disabled if the recipe is a Firefox Labs Opt-In
  • Studies/telemetry being disabled if the recipe is a traditional experiment/rollout

Comment 1

[Beth Rennie [:beth] (she/her)]

Attachment: Bug 1972647 - Hide Firefox Labs opt-ins from about:studies r?#nimbus-reviewers!

We do not want users to confuse these opt-ins with regular studies,
especially when studies are disabled, as that may lead them to believe
that we are running studies without their consent.

Comment 2

[Beth Rennie [:beth] (she/her)]

Attachment: Bug 1972647 - Make ExperimentAPI a singleton instance of a class r?#nimbus-reviewers

We have been accruing internal state inside ExperimentAPI.sys.mjs that
we do not want to expose as mutable to outside of the module. That state
is now bundled into the ExperimentAPI object itself as private
elements.

Comment 3

[Beth Rennie [:beth] (she/her)]

Attachment: Bug 1972647 - Allow Firefox Labs to be enabled even if studies or telemetry are disabled r?#nimbus-reviewers!,mkaply!

Both Firefox Labs and one of either studies or telemetry must now be
disabled to fully disable Nimbus.

Comment 4

[Beth Rennie [:beth] (she/her)]

Attachment: Bug 1972647 - Unenroll from Firefox labs opt-ins during Nimbus initialization if Labs is disabled by policy r?#nimbus-reviewers!

Comment 5

[Beth Rennie [:beth] (she/her)]

Attachment: Bug 1972647 - Don't hide Firefox Labs when studies or telemetry are disabled r?#settings-reviewers!,mkaply!

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/b1f97661fdcf
https://hg.mozilla.org/integration/autoland/rev/fb50c9cf745e
Hide Firefox Labs opt-ins from about:studies r=nimbus-reviewers,relud
https://github.com/mozilla-firefox/firefox/commit/39384659753b
https://hg.mozilla.org/integration/autoland/rev/be407b666f7b
Make ExperimentAPI a singleton instance of a class r=nimbus-reviewers,relud
https://github.com/mozilla-firefox/firefox/commit/7addb3e10953
https://hg.mozilla.org/integration/autoland/rev/fbf6a8f79f54
Allow Firefox Labs to be enabled even if studies or telemetry are disabled r=mkaply,nimbus-reviewers,relud
https://github.com/mozilla-firefox/firefox/commit/b8c619fb2ad8
https://hg.mozilla.org/integration/autoland/rev/9d251c1e5552
Unenroll from Firefox labs opt-ins during Nimbus initialization if Labs is disabled by policy r=nimbus-reviewers,relud
https://github.com/mozilla-firefox/firefox/commit/e47c8a978817
https://hg.mozilla.org/integration/autoland/rev/db42513c804c
Don't hide Firefox Labs when studies or telemetry are disabled r=mkaply,akulyk

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/b944a731f26e
https://hg.mozilla.org/integration/autoland/rev/f4619d5b7b93
Revert "Bug 1972647 - Don't hide Firefox Labs when studies or telemetry are disabled r=mkaply,akulyk" for causing bc failures.

Comment 8

[agoloman]

Backed out for causing bc failures.

• Backout link
• Push with failures
• Failure Log bc failures
• Failure Log mochitest failures

Comment 9

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/8f71edffd048
https://hg.mozilla.org/integration/autoland/rev/2072c2682f45
Hide Firefox Labs opt-ins from about:studies r=nimbus-reviewers,relud
https://github.com/mozilla-firefox/firefox/commit/626cbe672edf
https://hg.mozilla.org/integration/autoland/rev/438f125a207a
Make ExperimentAPI a singleton instance of a class r=nimbus-reviewers,relud
https://github.com/mozilla-firefox/firefox/commit/eb3f9ea0ff5e
https://hg.mozilla.org/integration/autoland/rev/778ac7df0b03
Allow Firefox Labs to be enabled even if studies or telemetry are disabled r=mkaply,nimbus-reviewers,relud
https://github.com/mozilla-firefox/firefox/commit/8f2ec3f7c783
https://hg.mozilla.org/integration/autoland/rev/feb4f1cc77f5
Unenroll from Firefox labs opt-ins during Nimbus initialization if Labs is disabled by policy r=nimbus-reviewers,relud
https://github.com/mozilla-firefox/firefox/commit/444d4fbc9d66
https://hg.mozilla.org/integration/autoland/rev/949c38eb8430
Don't hide Firefox Labs when studies or telemetry are disabled r=mkaply,akulyk

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/34f255aa3378
https://hg.mozilla.org/integration/autoland/rev/9126b83a2a85
Revert "Bug 1972647 - Don't hide Firefox Labs when studies or telemetry are disabled r=mkaply,akulyk" for causing marionette failures @ test_no_errors_clean_profile.py

Comment 11

[amarc]

Backed out for causing marionette failures @ test_no_errors_clean_profile.py

• Backout link
• Push with failures
• Failure Log

Comment 12

[Beth Rennie [:beth] (she/her)]

Attachment: Bug 1972647 - Suppress log spam when the RS collections have not yet synced r?#nimbus-reviewers!

Comment 13

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/763a6cc91007
https://hg.mozilla.org/integration/autoland/rev/a9b317048a30
Hide Firefox Labs opt-ins from about:studies r=nimbus-reviewers,relud
https://github.com/mozilla-firefox/firefox/commit/da83c7501282
https://hg.mozilla.org/integration/autoland/rev/b43818080a5e
Make ExperimentAPI a singleton instance of a class r=nimbus-reviewers,relud
https://github.com/mozilla-firefox/firefox/commit/73fb4a228ffb
https://hg.mozilla.org/integration/autoland/rev/ca7925e6e415
Allow Firefox Labs to be enabled even if studies or telemetry are disabled r=mkaply,nimbus-reviewers,relud
https://github.com/mozilla-firefox/firefox/commit/cd1586e5cf72
https://hg.mozilla.org/integration/autoland/rev/65bd329624d3
Unenroll from Firefox labs opt-ins during Nimbus initialization if Labs is disabled by policy r=nimbus-reviewers,relud
https://github.com/mozilla-firefox/firefox/commit/43c55af65c60
https://hg.mozilla.org/integration/autoland/rev/733ee3e7e1b1
Don't hide Firefox Labs when studies or telemetry are disabled r=mkaply,akulyk
https://github.com/mozilla-firefox/firefox/commit/7f239a90c986
https://hg.mozilla.org/integration/autoland/rev/efb03dd2507e
Suppress log spam when the RS collections have not yet synced r=nimbus-reviewers,relud

Comment 14

[Cristian Tuns]

https://hg.mozilla.org/mozilla-central/rev/a9b317048a30
https://hg.mozilla.org/mozilla-central/rev/b43818080a5e
https://hg.mozilla.org/mozilla-central/rev/ca7925e6e415
https://hg.mozilla.org/mozilla-central/rev/65bd329624d3
https://hg.mozilla.org/mozilla-central/rev/733ee3e7e1b1
https://hg.mozilla.org/mozilla-central/rev/efb03dd2507e

Comment 15

[Dianna Smith [:diannaS]]

:beth does this need a relnote for 146? Please nominate if so.

Comment 16

[Beth Rennie [:beth] (she/her)]

Release Note Request (optional, but appreciated)
[Why is this notable]: Firefox Labs is now available to all users, regardless of whether or not they choose to participate in studies or submit telemetry. That means we have more features in the hands of more people.
[Affects Firefox for Android]: No
[Suggested wording]:
[Links (documentation, blog post, etc)]:

Comment 17

[Dianna Smith [:diannaS]]

Added to Fx146 release notes
https://www.firefox.com/en-US/firefox/146.0a1/releasenotes/