Closed Bug 1570184 Opened 5 years ago Closed 5 years ago

[Experiment] Pref-Flip: Heuristics Study for Permissions Notifications Fx 68.0 Release

Categories

(Shield :: Shield Study, task, P3)

Product:
Shield
Component:
Shield Study
Type:
task

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: experimenter, Assigned: chsiang)

References

(
URL
)

Details

User Story

Experiment Type: Pref Flip Experiment

    What is the preference we will be changing

permissions.eventTelemetry.enabled

    What are the branches of the experiment and what values should
    each branch be set to?

- Treatment control 100%:

Value: true

There is only one branch in this study as we are doing temporary data collection.
        

    What version and channel do you intend to ship to?

0.1% of Release Firefox 68.0

    Are there specific criteria for participants?

Prefs:

Studies:

Any additional filters:
Countries: 

Locales: 

    What is your intended go live date and how long will the experiment run?

Aug 06, 2019 - Sep 10, 2019 (35 days)

    What is the main effect you are looking for and what data will you use to
    make these decisions?

> What is the main effect you are looking for and what data will you use to make these decisions? What metrics are you using to measure success

We want to repeat the analysis in https://docs.google.com/document/d/1hgcQp7gxh1YnkMVlZBHkdhL4HtVCIGKGLEvRvvLdYYE . If we get similar results, we will proceed. If we get radically different results and find that release users actually accept many of these prompts, even after repeatedly ignoring them, then we will have to go back to the drawing board.

> Do you plan on surveying users at the end of the study? Yes/No.

No.

We are asking for 0.1% of the release population; we think this will get us roughly 4x as much data as we got from Nightly users. This is erring on the side of more data than we need.

    Who is the owner of the data analysis for this experiment?

Felix

    Will this experiment require uplift?

False

    QA Status of your code:

Refer to the test instructions

    Link to more information about this experiment:

https://experimenter.services.mozilla.com/experiments/heuristics-study-1-new-user-profile/

Heuristics Study for Permissions Notifications

We want to collect heuristics to inform our implementation to reduce websites spamming users with requests to send notifications.

Experimenter is the source of truth for details and delivery. Changes to Bugzilla are not reflected in Experimenter and will not change delivery configuration.

More information: https://experimenter.services.mozilla.com/experiments/heuristics-study-1-new-user-profile/

User Story: (updated)
Summary: [Experiment]: Pref-Flip: Heuristics Study for Permissions Notifications → [Experiment] Pref-Flip: Heuristics Study for Permissions Notifications Fx 68.0 Release
Start Date: 2019-08-06 End Date: 2019-09-10
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.