[Experiment] Pref-Flip Experiment: Fingerprinting Protections Retention Study V2 Fx 70.0 Release
Categories
(Shield :: Shield Study, task, P3)
Tracking
(firefox70+ fixed)
People
(Reporter: experimenter, Unassigned)
References
()
Details
User Story
Experiment Type: Pref Flip Experiment
What is the preference we will be changing
privacy.trackingprotection.fingerprinting.enabled
What are the branches of the experiment and what values should
each branch be set to?
- Treatment treatment 50%:
Value: true
Fingerprinting is blocked
- Treatment control 50%:
Value: false
Fingerprinting is not blocked
What version and channel do you intend to ship to?
0.9% of Release Firefox 70.0
Are there specific criteria for participants?
None
Countries: all
Locales: all
What is your intended go live date and how long will the experiment run?
Oct 29, 2019 - Nov 19, 2019 (21 days)
What is the main effect you are looking for and what data will you use to
make these decisions?
This is a very similar study to the previous fingerprinting study [1] - the main difference being that we we will be testing with a smaller list to see if we can exclude domains that aren't.
Check for churn, reduced usage over time, or a reduction in the number of search ad clicks over time.
Specifically, for various values of `n`, analyze per-user data for between `n` and `n+1` weeks after the user enrolled, and estimate the relative uplift (with uncertainties) in the % of users with >x active hours, uri count, search count, or search ad click count, for enough values of x to cover the vast majority of users.
The data will be taken from the following probes, none of which are custom to this experiment:
browser.engagement.total_uri_count
browser.engagement.active_ticks
[1] https://experimenter.services.mozilla.com/experiments/fingerprinting-protections-retention-study/
Who is the owner of the data analysis for this experiment?
flawrence@mozilla.com
Will this experiment require uplift?
False
QA Status of your code:
Sign off as YELLOW as per comment https://experimenter.services.mozilla.com/experiments/fingerprinting-protections-retention-study-v2/#comment503
Link to more information about this experiment:
https://experimenter.services.mozilla.com/experiments/fingerprinting-protections-retention-study-v2/
Fingerprinting Protections Retention Study V2
We plan to study the effect of limited fingerprinting protections for 0.9% of users. Churn will be monitored during the study to inform a decision whether to move fingerprinting protections to Standard tracking Protection in Firefox 72.
Experimenter is the source of truth for details and delivery. Changes to Bugzilla are not reflected in Experimenter and will not change delivery configuration.
More information: https://experimenter.services.mozilla.com/experiments/fingerprinting-protections-retention-study-v2/
|
||
Comment 1•5 years ago
|
||
Pref-Flip: Fingerprinting Protections Retention Study V2
Firefox 70 Release
We have finished testing the Pref-Flip: Fingerprinting Protections Retention Study V2 experiment.
QA’s recommendation: YELLOW - SHIP IT CONDITIONALLY
Reasoning:
- We haven’t found any new issues during testing the experiment besides the one that affects the “browser.search.ad_clicks" telemetry probe which is no longer registered (Bug 1589972). We are unsure how/if this probe affects the needed data collection for the experiment.
Testing Summary:
- Full Functional test suite: Test Rail.
Tested Platforms:
- Windows 10 x64;
- Mac OS 10.14;
- Mint 19.1;
Tested Firefox versions:
- Firefox Release 70.0 “en-US” build;
- Firefox Release 70.0 “de” build;
- Firefox Release 70.0 “es-ES” build;
|
||
Comment 2•5 years ago
•
|
||
[Tracking Requested - why for this release]: Will go out to Fx70 users to help us understand if we can release by default in fx72.
|
||
Updated•5 years ago
|
|
Reporter | |
Updated•5 years ago
|
|
|
||
Comment 3•5 years ago
|
||
This launched as planned and we don't need to track the bug. Tracking in Experimenter instead.
Description
•