1628012 - [Experiment]: Generic Experiment: Delegated Credentials Nightly Breakage Study V2

Status: RESOLVED WONTFIX

(Shield :: Shield Study, task, P3)

Description

[Experimenter Bot]

Delegated Credentials Nightly Breakage Study V2

The Crypto Engineering team will run a test of Delegated Credentials for TLS in partnership with Cloudflare. The test will be conducted from an add-on shipped in the Nightly 77 tree that "runs" once, connects to a specially configured website, sends some telemetry, and disables itself.

This experiment has already been run in Nightly 73 (see: https://experimenter.services.mozilla.com/experiments/delegated-credentials-nightly-breakage-study/), but the underlying TLS implementation has since been updated to match the latest draft. As this includes wire format changes, we would like to run a shortened version of the same test before enabling Delegated Credentials by default in Nightly (https://bugzilla.mozilla.org/show_bug.cgi?id=1624378). There will be no change to the addon code itself, nor the telemetry collected.

Experimenter is the source of truth for details and delivery. Changes to Bugzilla are not reflected in Experimenter and will not change delivery configuration.

Data Science Issue: https://jira.mozilla.com/browse/DS-12345
More information: https://experimenter.services.mozilla.com/experiments/delegated-credentials-nightly-breakage-study-v2/

Comment 1

[:shell escalante]

[Tracking Requested - why for this release]:

Comment 2

[Carmen Fat [:cfat] - Ecosystem QA]

Delegated Credentials Experiment Add-on (V2 study)
Firefox Nightly 77.0a1
Firefox Nightly 78.0a1

We have finished testing the [PI-559] - Delegated Credentials Experiment Add-on (V2 study) experiment.

Quality status: GREEN - SHIP IT

Why is this experiment green?

• We haven’t found any issues during testing.

Testing Summary:

• TestRail: Test Suite

Tested Platforms:

• Windows 10 x64, v.1909 (OS build 18363.720)
• Ubuntu 18.04.3 LTS, x64 (GNOME 3.28.2)
• macOS 10.15

Untested Platforms:

• Windows 10 x64, v.1903 (OS build 18362.720)
• Ubuntu 16.04 LTS, x64

Tested browser versions:

• Firefox Nightly try-build

Comment 3

[Kevin Jacobs [:kjacobs]]

Attachment: Bug 1628012 - Land Delegated Credentials experiment script

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/001a5750e276
Land Delegated Credentials experiment script r=jcj

Comment 5

[Stefan Hindli [:stefan_hindli]]

https://hg.mozilla.org/mozilla-central/rev/001a5750e276

Comment 6

[Kevin Jacobs [:kjacobs]]

Attachment: Bug 1628012 - Backed out changeset 001a5750e276

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/005046ac7cf6
Backed out changeset 001a5750e276 r=jcj

Comment 8

[Stefan Hindli [:stefan_hindli]]

https://hg.mozilla.org/mozilla-central/rev/005046ac7cf6