Closed
Bug 1343679
Opened 9 years ago
Closed 9 years ago
Create Optimizely experiment for v1.6 onboarding add-on (Launch on March 2nd)
Categories
(www.mozilla.org :: Analytics, enhancement)
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: cmore, Unassigned)
References
Details
Need an Optimizely redirect test to launch the v1.6 funnelcakes.
Need two experiments:
Experiment 1:
Audience:
* English
* Desktop
* Non-Firefox
Variations:
f=101
f=102
Goal: engagement + download click
Experiment 2:
Audience:
* German
* Desktop
* Non-Firefox
Variations:
f=103
f=104
Goal: engagement + download click
| Reporter | ||
Comment 1•9 years ago
|
||
Update on audience: both should also be Windows.
| Reporter | ||
Comment 2•9 years ago
|
||
English experiment: https://app.optimizely.com/edit?experiment_id=8273150911
German experiment: https://app.optimizely.com/edit?experiment_id=8272251554
:jpetto: can you review the two experiments above using the criteria in comment 0 and comment 1? Thanks!
Flags: needinfo?(jon)
Comment 3•9 years ago
|
||
Experiment code looks good and funnelcakes appear to be downloading correctly. r+
Noting that control for both experiments is currently getting 100% of the traffic. (Assuming this will change when experiment starts.)
Flags: needinfo?(jon)
| Reporter | ||
Comment 4•9 years ago
|
||
(In reply to Jon Petto [:jpetto] from comment #3)
> Experiment code looks good and funnelcakes appear to be downloading
> correctly. r+
>
> Noting that control for both experiments is currently getting 100% of the
> traffic. (Assuming this will change when experiment starts.)
Thanks, Jon. That was my last edit to make
Update for comment 0 since I didn't mention it before:
Traffic allocation: 100% for both experiments and 50/50 for each. This has been updated.
| Reporter | ||
Comment 5•9 years ago
|
||
I will launch at just 20% for the next 2 days as the analytics doesn't start being measured until this Sunday. No reason of using anymore Optimizely cycles this week.
| Reporter | ||
Comment 6•9 years ago
|
||
Started on 3/2/2017 at 11:00am PST at 20% volume.
| Reporter | ||
Updated•9 years ago
|
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
| Reporter | ||
Comment 7•9 years ago
|
||
Experiment went up to 100% volume for en-US and De 3/6/2017.
The split is 50% to the control and 50% to the variation arm until we get data back. When we do, we can make a decision about what to do next with volume and the arms.
Comment 8•9 years ago
|
||
:cmore - Should bedrock continue to allow downloading of these funnelcakes? I'm guessing not, but want to make sure.
Thanks.
Flags: needinfo?(chrismore.bugzilla)
| Reporter | ||
Comment 9•9 years ago
|
||
(In reply to Jon Petto [:jpetto] from comment #8)
> :cmore - Should bedrock continue to allow downloading of these funnelcakes?
> I'm guessing not, but want to make sure.
>
> Thanks.
Nope, they should not be distributed anymore. Thanks for checking
Flags: needinfo?(chrismore.bugzilla)
Comment 10•9 years ago
|
||
Commits pushed to master at https://github.com/mozmeao/www-config
https://github.com/mozmeao/www-config/commit/94df2d14e7c09a75c75c98547cf3d90cc942151e
[bug 1343679] Remove old onboarding add-on funnelcakes.
https://github.com/mozmeao/www-config/commit/c47f8e02e0d41c0d4f96afb15adeca7257b40cdc
Merge pull request #40 from jpetto/bug-1343679-remove-onboarding-addon-funnelcakes
[bug 1343679] Remove old onboarding add-on funnelcakes.
You need to log in
before you can comment on or make changes to this bug.
Description
•