Closed Bug 1893049 Opened 2 years ago Closed 2 years ago

[Experiment] Pref-Flip Experiment: Normandy Diagnostic v125 Fx 124.0 to 124.0 Release

Categories

(Shield :: Shield Study, task, P3)

Product:
Shield
Component:
Shield Study
Type:
task

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: experimenter, Assigned: jlockhart)

References

(
URL
)

Details

User Story

Delivery Type: Pref Flip Experiment

    What is the preference we will be changing

app.normandy.test-prefs.string

    What are the branches of the experiment and what values should
    each branch be set to?

- Control Control String 100%:

Value: normandy-diagnostic-125

Control String
        

    What version and channel do you intend to ship to?

0.5% of Release Firefox 124.0 to 124.0

    Are there specific criteria for participants?

None
Countries: all

Locales: all

    What is your intended go live date and how long will the experiment run?

Apr 23, 2024 - May 23, 2024 (30 days)

    What is the main effect you are looking for and what data will you use to
    make these decisions?

Query for the value of `app.normandy.test-prefs.string` to show that it is set with the value in this Normandy recipe.

SELECT 
  COUNT(DISTINCT client_id) AS client_count, 
  DATE(submission_timestamp) AS date,
  user_pref.value AS value
FROM 
  telemetry.main 
CROSS JOIN
  UNNEST(environment.settings.user_prefs) AS user_pref
WHERE
  DATE(submission_timestamp) >= DATE_SUB(CURRENT_DATE(), INTERVAL 30 DAY)
  AND user_pref.key = 'app.normandy.test-prefs.string'
GROUP BY
    date, value

    Who is the owner of the data analysis for this experiment?

jkerim@mozilla.com

    Will this experiment require uplift?

False

    QA Status of your code:

QA bypassed, only using existing functionality

    Link to more information about this experiment:

https://experimenter.services.mozilla.com/experiments/normandy-diagnostic-v125/

Normandy Diagnostic v125

Diagnostic verification of pref setting

Experimenter is the source of truth for details and delivery. Changes to Bugzilla are not reflected in Experimenter and will not change delivery configuration.

Data Science Issue: https://mozilla-hub.atlassian.net/browse/DO-352
More information: https://experimenter.services.mozilla.com/experiments/normandy-diagnostic-v125/

User Story: (updated)
Summary: [Experiment]: Pref-Flip Experiment: Normandy Diagnostic v125 → [Experiment] Pref-Flip Experiment: Normandy Diagnostic v125 Fx 124.0 to 124.0 Release
Start Date: 2024-04-23 End Date: 2024-05-23
Start Date: 2024-04-23 End Date: 2024-05-23
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.