Closed Bug 1789381 Opened 2 years ago Closed 2 years ago

[Experiment] Pref-Flip Experiment: ECH - US & CA Interoperability Experiment Fx 105.0 to 106.0 Beta

Categories

(Shield :: Shield Study, task, P3)

Product:
Shield
Component:
Shield Study
Type:
task

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: experimenter, Assigned: djackson)

References

(
URL
)

Details

User Story

Delivery Type: Pref Flip Experiment

    What is the preference we will be changing

network.dns.echconfig.enabled

    What are the branches of the experiment and what values should
    each branch be set to?

- Control Enable ECH 100%:

Value: true

All enrolled users will have ECH enabled.
        

    What version and channel do you intend to ship to?

25% of Beta Firefox 105.0 to 106.0

    Are there specific criteria for participants?

Experiments: 
Exclude clients enrolled in 'Pref-Flip Experiment: Investigating network tolerance for new TLS extensions'
Prefs:
Include only clients with either network.trr.mode=2 OR network.trr.mode=3 set.
Countries: Canada (CA) United States of America (US) 

Locales: all

    What is your intended go live date and how long will the experiment run?

Sep 12, 2022 - Oct 10, 2022 (28 days)

    What is the main effect you are looking for and what data will you use to
    make these decisions?

We will  monitor the specific telemetry: `SSL_HANDSHAKE_RESULT_FIRST_TRY` and `SSL_HANDSHAKE_RESULT_ECH` which record the success or failures of their respective TLS connections. Plus the timing information recorded in `SSL_TIME_UNTIL_READY_ECH` and `SSL_TIME_UNTIL_READY_FIRST_TRY`. 

As only a small fraction of each user's connections will use ECH, we can investigate how the success probability of ECH and non-ECH connections compare for an individual user as well as across the entire sample.

    Who is the owner of the data analysis for this experiment?

None

    Will this experiment require uplift?

False

    QA Status of your code:

Not Started.

    Link to more information about this experiment:

https://experimenter.services.mozilla.com/experiments/ech-us-ca-interoperability-experiment/

ECH - US & CA Interoperability Experiment

This experiment will measure whether Firefox's implementation of ECH can successfully interoperate with experimental server-side ECH implementations. This experiment will run in North America only for users which are using DoH.

Experimenter is the source of truth for details and delivery. Changes to Bugzilla are not reflected in Experimenter and will not change delivery configuration.

Data Science Issue: https://mozilla-hub.atlassian.net/browse/DO-831
More information: https://experimenter.services.mozilla.com/experiments/ech-us-ca-interoperability-experiment/

No longer blocks: ech

We have finished testing the experiment and sent a GREEN sign off. You can find it here.

User Story: (updated)
Summary: [Experiment]: Pref-Flip Experiment: ECH - US & CA Interoperability Experiment → [Experiment] Pref-Flip Experiment: ECH - US & CA Interoperability Experiment Fx 105.0 to 106.0 Beta
Start Date: 2022-09-13 End Date: 2022-10-11
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.