Closed Bug 1790801 Opened 2 years ago Closed 1 year ago

[Experiment] Pref-Flip Experiment: ECH - US & CA Interoperability Experiment V2 Fx 106.0 to 108.0 Beta

Categories

(Shield :: Shield Study, task, P3)

Product:
Shield
Component:
Shield Study
Type:
task

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: experimenter, Assigned: shell)

References

(Blocks 1 open bug,
URL
)

Details

User Story

Delivery Type: Pref Flip Experiment

    What is the preference we will be changing

network.dns.echconfig.enabled

    What are the branches of the experiment and what values should
    each branch be set to?

- Control Enable ECH 100%:

Value: true

All enrolled users will have ECH enabled.
        

    What version and channel do you intend to ship to?

25% of Beta Firefox 106.0 to 108.0

    Are there specific criteria for participants?

Experiments: 
Exclude clients enrolled in 'Pref-Flip Experiment: Investigating network tolerance for new TLS extensions'. https://experimenter.services.mozilla.com/experiments/investigating-network-tolerance-for-new-tls-extensions/

Prefs:
Include only clients with either network.trr.mode=2 OR network.trr.mode=3 set OR network.trr.mode=0

This is a relaunch of this experiment with 2 changes.  1) adding avoidance of the experiment 2) adding '0" to trr values original : https://experimenter.services.mozilla.com/experiments/ech-us-ca-interoperability-experiment/
Countries: Canada (CA) United States of America (US) 

Locales: all

    What is your intended go live date and how long will the experiment run?

Oct 18, 2022 - Nov 15, 2022 (28 days)

    What is the main effect you are looking for and what data will you use to
    make these decisions?

We will  monitor the specific telemetry: `SSL_HANDSHAKE_RESULT_FIRST_TRY` and `SSL_HANDSHAKE_RESULT_ECH` which record the success or failures of their respective TLS connections. Plus the timing information recorded in `SSL_TIME_UNTIL_READY_ECH` and `SSL_TIME_UNTIL_READY_FIRST_TRY`. 

As only a small fraction of each user's connections will use ECH, we can investigate how the success probability of ECH and non-ECH connections compare for an individual user as well as across the entire sample.

    Who is the owner of the data analysis for this experiment?

None

    Will this experiment require uplift?

False

    QA Status of your code:

Not Started.

    Link to more information about this experiment:

https://experimenter.services.mozilla.com/experiments/ech-us-ca-interoperability-experiment-v2/

ECH - US & CA Interoperability Experiment V2

This experiment will measure whether Firefox's implementation of Encrypted Client Hello (ECH) can successfully interoperate with experimental server-side ECH implementations. This experiment will only run in North America for users who are using DNS-over-HTTPS.

Experimenter is the source of truth for details and delivery. Changes to Bugzilla are not reflected in Experimenter and will not change delivery configuration.

Data Science Issue: https://mozilla-hub.atlassian.net/browse/DO-831
More information: https://experimenter.services.mozilla.com/experiments/ech-us-ca-interoperability-experiment-v2/

User Story: (updated)
Summary: [Experiment]: Pref-Flip Experiment: ECH - US & CA Interoperability Experiment V2 → [Experiment] Pref-Flip Experiment: ECH - US & CA Interoperability Experiment V2 Fx 105.0 to 106.0 Beta
User Story: (updated)
Summary: [Experiment] Pref-Flip Experiment: ECH - US & CA Interoperability Experiment V2 Fx 105.0 to 106.0 Beta → [Experiment] Pref-Flip Experiment: ECH - US & CA Interoperability Experiment V2 Fx 106.0 to 108.0 Beta
Start Date: 2022-10-18 End Date: 2022-11-15
Status: NEW → RESOLVED
Closed: 1 year ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.