Closed Bug 1699267 Opened 5 years ago Closed 5 years ago

[Experiment] Pref-Flip Experiment: DNS Over HTTPS: Relaxed TRR Confirmation Experiment Fx 88.0 to 88.0 Beta

Categories

(Shield :: Shield Study, task, P3)

Product:
Shield
Component:
Shield Study
Type:
task

Tracking

(firefox88+ fixed)

Status:
RESOLVED FIXED
Tracking Flags:
Tracking Status
firefox88 + fixed

People

(Reporter: experimenter, Assigned: nhnt11)

References

(
URL
)

Details

User Story

Delivery Type: Pref Flip Experiment

    What is the preference we will be changing

network.trr.wait-for-confirmation

    What are the branches of the experiment and what values should
    each branch be set to?

- Treatment default 50%:

Value: true

Aggressive confirmation flow
        
- Control relaxed 50%:

Value: false

Relaxed confirmation flow enabled
        

    What version and channel do you intend to ship to?

20% of Beta Firefox 88.0 to 88.0

    Are there specific criteria for participants?

Prefs:

Experiments:

Any additional filters:  users in this 100% rollout on Beta - as they need to have DoH turned on - https://experimenter.services.mozilla.com/experiments/doh-beta-rollout-to-all-us-desktop-users-v2/
Countries: United States of America (US) 

Locales: all

    What is your intended go live date and how long will the experiment run?

Mar 30, 2021 - Apr 20, 2021 (21 days)

    What is the main effect you are looking for and what data will you use to
    make these decisions?

See https://docs.google.com/document/d/1P9cI5UmNSIA9sLL9bm9s7YIwrHDkCrkL6ixmoTlxT9A/edit#

    Who is the owner of the data analysis for this experiment?

None

    Will this experiment require uplift?

False

    QA Status of your code:

Not started
This is hard to QA.  It's to mitigate an issue if an endpoint is down.  testing won't likely increase our confidence in shipping.  
The way to see if it's working correctly is looking at data from the population more than one machine.

    Link to more information about this experiment:

https://experimenter.services.mozilla.com/experiments/dns-over-https-relaxed-trr-confirmation-flow-performance-study/

DNS Over HTTPS: Relaxed TRR Confirmation Flow Performance Study

A study to measure the performance impact of an enhancement to the DNS over HTTPS feature.

Experimenter is the source of truth for details and delivery. Changes to Bugzilla are not reflected in Experimenter and will not change delivery configuration.

Data Science Issue: https://jira.mozilla.com/browse/DS-1502
More information: https://experimenter.services.mozilla.com/experiments/dns-over-https-relaxed-trr-confirmation-flow-performance-study/

[Tracking Requested - why for this release]: experiment on Beta

status-firefox88: --- → affected
tracking-firefox88: --- → ?
User Story: (updated)
Summary: [Experiment]: Pref-Flip Experiment: DNS Over HTTPS: Relaxed TRR Confirmation Flow Performance Study → [Experiment] Pref-Flip Experiment: DNS Over HTTPS: Relaxed TRR Confirmation Experiment Fx 88.0 to 88.0 Beta
User Story: (updated)
Start Date: 2021-03-30 End Date: 2021-04-20
Assignee: nobody → nhnt11
User Story: (updated)
Status: NEW → RESOLVED
Closed: 5 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.