1816560 - Introduce a pref for experimentation to allow showing the not_configured state of the FxA toolbar button

Status: RESOLVED FIXED

(Firefox :: Toolbars and Customization, task)

Description

[Mike Conley (:mconley) (:⚙️)]

This button was hidden in toolbars by default when in the not_configured state in bug 1686521 to reduce noise in the toolbars and promote a sense of calm.

We'd like to introduce a pref to reverse that decision and run an experiment on it to see if users actually do find value in the button in the not_configured state.

Comment 1

[Mike Conley (:mconley) (:⚙️)]

Attachment: Bug 1816560 - Introduce a pref to control the visibility of the not_configured FxA toolbar button for experimentation. r?markh!

Comment 2

[Alex Davis [:adavis]]

Thanks Mike for opening this.

It's been observed a few times lately that even employees think they're signed in. It is not intuitive to know that when the avatar icon is present that you're signed in and when it is gone, you're not.

Metrics-wise, before this was removed, we were observing that 25% of all account registrations happened through this surface and about 1/3 of all logins happened through this surface.

Due to the fact that fewer people are authenticated in the browser, we believe there's a higher risk of them losing their data when they get a new device because they don't have an account from which they can restore their data. This could also result in user churn when users refresh their devices.

Through experimentation, we'd like to see if user behavior has changed and whether or not we can expect to see similar proportions of logins and registration happening on this surface. Given the high confidence we have and the overall volume, this could be something along the lines of a 50/50 experiment for just a week.

Comment 3

[Alex Davis [:adavis]]

Here's a link to the original PRD dating back to 2019 (for reference).
https://docs.google.com/document/d/1UUskDzY9xM-UySU9y-w7n30DpJl64IUENxIf50qc4YM/edit

I've started an experiment brief here (WIP):
https://docs.google.com/document/d/1TVjTLzPpb4uGiLsNtEcp1uDNJIGLRtpihM_jhi244rs/edit#

The experiment would be tracked in Jira here:
https://mozilla-hub.atlassian.net/browse/FXE-183

Open question:
Do any of the creatives need to be refreshed to align to the current design style? TBH, I'm not sure what it looks like if we just turn it back on. It might not look like the PRD.

Comment 4

[Mike Conley (:mconley) (:⚙️)]

Attachment: image.png

Here's a screenshot of the button made visible on macOS. Windows and Linux will appear very similar.

Comment 5

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/58530f873d9e
Introduce a pref to control the visibility of the not_configured FxA toolbar button for experimentation. r=markh,desktop-theme-reviewers,dao

Comment 6

[Cristina Horotan [:chorotan]]

https://hg.mozilla.org/mozilla-central/rev/58530f873d9e

Comment 7

[Mike Conley (:mconley) (:⚙️)]

Comment on attachment 9317652 [details]
Bug 1816560 - Introduce a pref to control the visibility of the not_configured FxA toolbar button for experimentation. r?markh!

Beta/Release Uplift Approval Request

• User impact if declined: None.
• Is this code covered by automated tests?: No
• Has the fix been verified in Nightly?: Yes
• Needs manual test from QE?: No
• If yes, steps to reproduce:
• List of other uplifts needed: None
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky): This adds a pref and guards some existing CSS behind it, but because the pref check evaluates to true, the CSS still runs like it always has. What this does is give us the ability to experiment with this chunk of CSS (the visibility of the FxA toolbar button when not signed in to a Firefox Account), and we'd like to be able to test that on the release population.
• String changes made/needed: None.
• Is Android affected?: No

Comment 8

[Donal Meehan [:dmeehan]]

Comment on attachment 9317652 [details]
Bug 1816560 - Introduce a pref to control the visibility of the not_configured FxA toolbar button for experimentation. r?markh!

Approved for 111.0b2

Comment 9

[Donal Meehan [:dmeehan]]

https://hg.mozilla.org/releases/mozilla-beta/rev/1f7dcff2877b