Closed Bug 1343679 Opened 7 years ago Closed 7 years ago

Create Optimizely experiment for v1.6 onboarding add-on (Launch on March 2nd)

Categories

(www.mozilla.org :: Analytics, enhancement)

Product:
www.mozilla.org
Component:
Analytics
Version:
Production
Type:
enhancement
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: cmore, Unassigned)

References

Details

Need an Optimizely redirect test to launch the v1.6 funnelcakes.

Need two experiments:

Experiment 1:

Audience:

* English
* Desktop
* Non-Firefox

Variations:

f=101
f=102

Goal: engagement + download click

Experiment 2:

Audience:

* German
* Desktop
* Non-Firefox

Variations:

f=103
f=104

Goal: engagement + download click
Update on audience: both should also be Windows.
English experiment: https://app.optimizely.com/edit?experiment_id=8273150911

German experiment: https://app.optimizely.com/edit?experiment_id=8272251554

:jpetto: can you review the two experiments above using the criteria in comment 0 and comment 1? Thanks!
Flags: needinfo?(jon)
Experiment code looks good and funnelcakes appear to be downloading correctly. r+

Noting that control for both experiments is currently getting 100% of the traffic. (Assuming this will change when experiment starts.)
Flags: needinfo?(jon)
(In reply to Jon Petto [:jpetto] from comment #3)
> Experiment code looks good and funnelcakes appear to be downloading
> correctly. r+
> 
> Noting that control for both experiments is currently getting 100% of the
> traffic. (Assuming this will change when experiment starts.)

Thanks, Jon. That was my last edit to make

Update for comment 0 since I didn't mention it before:

Traffic allocation: 100% for both experiments and 50/50 for each. This has been updated.
I will launch at just 20% for the next 2 days as the analytics doesn't start being measured until this Sunday. No reason of using anymore Optimizely cycles this week.
Started on 3/2/2017 at 11:00am PST at 20% volume.
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
Experiment went up to 100% volume for en-US and De 3/6/2017.

The split is 50% to the control and 50% to the variation arm until we get data back. When we do, we can make a decision about what to do next with volume and the arms.
:cmore - Should bedrock continue to allow downloading of these funnelcakes? I'm guessing not, but want to make sure.

Thanks.
Flags: needinfo?(chrismore.bugzilla)
(In reply to Jon Petto [:jpetto] from comment #8)
> :cmore - Should bedrock continue to allow downloading of these funnelcakes?
> I'm guessing not, but want to make sure.
> 
> Thanks.

Nope, they should not be distributed anymore. Thanks for checking
Flags: needinfo?(chrismore.bugzilla)
Commits pushed to master at https://github.com/mozmeao/www-config

https://github.com/mozmeao/www-config/commit/94df2d14e7c09a75c75c98547cf3d90cc942151e
[bug 1343679] Remove old onboarding add-on funnelcakes.

https://github.com/mozmeao/www-config/commit/c47f8e02e0d41c0d4f96afb15adeca7257b40cdc
Merge pull request #40 from jpetto/bug-1343679-remove-onboarding-addon-funnelcakes

[bug 1343679] Remove old onboarding add-on funnelcakes.
You need to log in before you can comment on or make changes to this bug.