Closed Bug 1626481 Opened 4 years ago Closed 3 years ago

[Experiment]: Pref-Flip Experiment: Feature Impact study for Enhanced Tracking Protection Level 2 V2

Categories

(Shield :: Shield Study, task, P3)

Product:
Shield
Component:
Shield Study
Type:
task

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: experimenter, Unassigned)

References

(
URL
)

Details

Feature Impact study for Enhanced Tracking Protection Level 2 V2

Note: This is the second attempt at this experiment. For simplicity, will no longer be distinguishing new and existing users.

In Firefox we are planning to upgrade our default Enhanced Tracking Protection feature with a bigger list of domains for blocking third-party tracking cookies. This new list, known as Level 2, may have an impact on search revenue. We want to test the revenue impact of this feature to inform a final ship decision for shipping the feature.

Due to concerns about the long term (vs. immediate) revenue impact of the feature, we would like to run this experiment for as long as 180 days to ensure we continue to monitor the impact even if we choose to deploy more broadly. This may require special handling.

Experimenter is the source of truth for details and delivery. Changes to Bugzilla are not reflected in Experimenter and will not change delivery configuration.

Data Science Issue: https://jira.mozilla.com/browse/DS-99999
More information: https://experimenter.services.mozilla.com/experiments/feature-impact-study-for-enhanced-tracking-protection-level-2-v2/

Start Date: 2020-04-02 End Date: 2020-09-29

Feature Impact study for Enhanced Tracking Protection Level 2 V2
Firefox Release 76.x

We have finished testing the Feature Impact study for Enhanced Tracking Protection Level 2 V2 experiment for Firefox 76.
The study is already live, but since it's running for more than 180 days (until Firefox 80), we are running our test suite on the latest builds of each Beta cycle to make sure that there are no new issues between Firefox versions.

Quality status: GREEN

Why is this feature green?

  • During testing we haven’t found any issues.

Testing Summary:

Tested Platforms:

  • Windows 10 x64;
  • Mac 10.14.6;
  • Ubuntu 18.04 x64;

Tested Firefox versions:

  • Firefox 76.0b8 en-US;
  • Firefox 76.0b8 de;
  • Firefox 76.0b8 es-ES;

Feature Impact study for Enhanced Tracking Protection Level 2 V2
Firefox Release 77.x

We have finished testing the Feature Impact study for Enhanced Tracking Protection Level 2 V2 experiment for Firefox 77.

The study is already live, but since it's running for more than 180 days (until Firefox 80), we are running our test suite on the latest builds of each Beta cycle to make sure that there are no new issues between Firefox versions.

Quality status: GREEN

Why is this feature green?

  • During testing we haven’t found any issues.

Testing Summary:

Tested Platforms:

  • Windows 10 x64;
  • Mac 10.14.6;
  • Ubuntu 18.04 x64;

Tested Firefox versions:

  • Firefox 77.0b8 en-US;
  • Firefox 77.0b8 de;
  • Firefox 77.0b8 es-ES;

Feature Impact study for Enhanced Tracking Protection Level 2 V2
Firefox Release 78.x

We have finished testing the Feature Impact study for Enhanced Tracking Protection Level 2 V2 experiment for Firefox 78.

The study is already live, but since it's running for more than 180 days (until Firefox 80), we are running our test suite on the latest builds of each Beta cycle to make sure that there are no new issues between Firefox versions.

Quality status: GREEN

Why is this feature green?

  • During testing we haven’t found any issues.

Testing Summary:

Tested Platforms:

  • Windows 10 x64;
  • Mac 10.14.6;
  • Ubuntu 18.04 x64;

Tested Firefox versions:

  • Firefox 78.0b9 en-US;
  • Firefox 78.0b9 de;
  • Firefox 78.0b9 es-ES;
Status: NEW → RESOLVED
Closed: 3 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.