[Experiment] Pref-Flip Experiment: TopSites Launch Phase3 Group2- AU Fx 84.0 to 86.0 Release
Categories
(Shield :: Shield Study, task, P3)
Tracking
(firefox84+ fixed, firefox85+ fixed, firefox86+ fixed)
People
(Reporter: experimenter, Assigned: mikedeboer)
References
(Blocks 1 open bug, )
Details
(Whiteboard: [no-nag])
User Story
Delivery Type: Pref Flip Experiment
What is the preference we will be changing
browser.topsites.useRemoteSetting
What are the branches of the experiment and what values should
each branch be set to?
- Control Control 50%:
Value: None
Don't use Remote Settings to power the Top Sites
- Treatment Treatment-admarketplace 50%:
Value: None
Changes Amazon tile to a URL and sends a background request to ad market place
What version and channel do you intend to ship to?
40% of Release Firefox 84.0 to 86.0
Are there specific criteria for participants?
Prefs:
Experiments:
Any additional filters:
Countries: Australia (AU)
Locales: all
What is your intended go live date and how long will the experiment run?
Dec 17, 2020 - Mar 19, 2021 (92 days)
What is the main effect you are looking for and what data will you use to
make these decisions?
Our partner (AdMarketplace) is monitoring the traffic we send their way with the ‘amazon.attributionURL’.
They’ve contacted us right away before when they saw something strange.
Their internal contacts are Mike DeBoer, Dao, and JimT.
Who is the owner of the data analysis for this experiment?
tbrooks@mozilla.com
Will this experiment require uplift?
False
QA Status of your code:
https://jira.mozilla.com/browse/PI-893
Link to more information about this experiment:
https://experimenter.services.mozilla.com/experiments/topsites-launch-phase3-group2-au/
TopSites Launch Phase3 Group2- AU
Sponsored Top Site - Amazon
Experimenter is the source of truth for details and delivery. Changes to Bugzilla are not reflected in Experimenter and will not change delivery configuration.
Data Science Issue: https://jira.mozilla.com/browse/DS-1356
More information: https://experimenter.services.mozilla.com/experiments/topsites-launch-phase3-group2-au/
|
||
Comment 1•3 years ago
|
||
TopSites Launch Phase3 Group2- AU
Release Firefox 84.0 to 86.0
We have finished testing the [PI-893] TopSites: AU-CA-FR - AU experiment on Fx 84. Considering the fact that the experiment will be live until Firefox 86, for a more accurate assessment, we will retest the experiment on Firefox 85 and 86 builds closest to RC / Firefox Release RC build and send a new sign off email for each version.
Quality status: GREEN - SHIP IT
Why is this experiment green?
-
Delivery mechanism:
- No issues found.
-
Product specific:
-
We found 1 new normal issue which does not greatly affect user experience.
-
We encountered 1 known issue which doesn’t affect user experience.
-
Testing Summary:
-
Test runs: TestRail.
-
Exploratory testing performed on Firefox 84.0 zh-CN build on Windows 10 x64 related to functionality.
Tested Platforms:
-
Ubuntu 20.04 x64
-
Windows 10 (exploratory)
Tested Firefox versions:
-
Firefox 84.0 (Build ID: 20201211215739)
-
Firefox Beta 85.01 (Build ID: 20201214185926) (update scenario)
|
||
Comment 2•3 years ago
|
||
[Tracking Requested - why for this release]:
|
Reporter | |
Updated•3 years ago
|
|
||
Updated•3 years ago
|
|
|
Reporter | |
Comment 3•3 years ago
|
||
Start Date: 2020-12-17 End Date: 2021-03-19
|
||
Comment 4•3 years ago
|
||
We have finished testing the experiment for Firefox 87 and sent a YELLOW sign off. You can find it here.
|
||
Comment 5•3 years ago
•
|
||
|
||
Updated•3 years ago
|
|
||
Updated•3 years ago
|
|
|
||
Comment 6•3 years ago
|
||
We have finished testing the experiments for Firefox 89 and sent the sign of email. You can find it here: https://docs.google.com/document/d/1zvbg5kO-DqQauWxXqjokDY-fZlmHPzE-PLQR7oSb-jk/edit
|
|
||
Comment 7•3 years ago
|
||
Finished testing the experiment for Firefox 90 and sent a GREEN sign off. You can find it here: https://docs.google.com/document/d/11Z006Cnaet93u0hZIw7I8WYWCamg540kpG7wdUv-HVo/edit.
Description
•