Closed Bug 1617735 Opened 5 years ago Closed 5 years ago

[Experiment] Pref-Flip Experiment: activity-stream password import cfr Fx 74.0 to 74.0 Release

Categories

(Shield :: Shield Study, task, P3)

Product:
Shield
Component:
Shield Study
Type:
task

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: experimenter, Assigned: tspurway)

References

(
URL
)

Details

User Story

Delivery Type: Pref Flip Experiment

    What is the preference we will be changing

browser.newtabpage.activity-stream.asrouter.providers.cfr

    What are the branches of the experiment and what values should
    each branch be set to?

- Control no-password-cfr 50%:

Value: {"id":"cfr","enabled":true,"type":"remote-settings","bucket":"cfr","frequency":{"custom":[{"period":"daily","cap":1}]},"categories":["cfrAddons","cfrFeatures"],"updateCycleInMs":3600000}

The users do not get the recommendation
        
- Treatment password-cfr 50%:

Value: {"id":"cfr","enabled":true,"type":"remote-settings","bucket":"cfr","frequency":{"custom":[{"period":"daily","cap":1}]},"categories":["cfrAddons","cfrFeatures"],"updateCycleInMs":3600000,"cohort":"import_password_treatment"}

These users will be eligible to get a password recommendation
        

    What version and channel do you intend to ship to?

34% of Release Firefox 74.0 to 74.0

    Are there specific criteria for participants?

Prefs:

Experiments:

Any additional filters:

normandy.attribution.ua in ["chrome", "edge"]
&& normandy.telemetry.main.environment.profile.creationDate >= ("2020-03-10"|date / 1000 / 60 / 60 / 24)
Countries: all

Locales: English (US) (en-US) 

    What is your intended go live date and how long will the experiment run?

Mar 10, 2020 - Apr 07, 2020 (28 days)

    What is the main effect you are looking for and what data will you use to
    make these decisions?

What is the primary success metric to confirm hypothesis?
D7 retention after import

Secondary metrics:
Impressions of the blue CFR button
Clicks on the blue CFR button
Clicks on CTA in CFR window
Imports from other browsers


Do you plan on surveying users at the end of the delivery? No.

    Who is the owner of the data analysis for this experiment?

loines@mozilla.com

    Will this experiment require uplift?

False

    QA Status of your code:

PI request has been filed: https://jira.mozilla.com/browse/PI-503

Sent a GREEN sign-of as per comment https://experimenter.services.mozilla.com/experiments/activity-stream-password-import-cfr/#comment676.

    Link to more information about this experiment:

https://experimenter.services.mozilla.com/experiments/activity-stream-password-import-cfr/

activity-stream password import cfr

If we offer new desktop browser users the opportunity to import their passwords when visiting a site that requires logins, then we will see less users returning to their former browser because we have observed that missing features are a push force on users. The hypothesis is that users who are given the opportunity to import passwords from the browser they used to install Firefox will keep using Firefox.

Experimenter is the source of truth for details and delivery. Changes to Bugzilla are not reflected in Experimenter and will not change delivery configuration.

More information: https://experimenter.services.mozilla.com/experiments/activity-stream-password-import-cfr/

User Story: (updated)
Summary: [Experiment]: Pref-Flip Experiment: activity-stream password import cfr → [Experiment] Pref-Flip Experiment: activity-stream password import cfr Fx 74.0 to 74.0 Release
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.