1304741 - Optimizely Test for Funnelcake 89/90 experiment

Status: RESOLVED FIXED

(www.mozilla.org :: Analytics, defect)

Description

[Winston Bowden]

We're planning a test that will launch late next week. The first run experience is currently being marked up. A release engineering bug has been filed for the funnel cake builds. 

We will need to get an Optimizely test setup for the funnelcake distribution. 

Test Details:

KPIs
Yahoo search retention rate 
Yahoo search volume compared to baseline
Firefox churn compared to baseline 

Our view of these will need to reflect several milestones.
1 day
3 day
5 day
7 day
After these thresholds, we’ll want to review weekly churn up to six weeks after the install

Cohorts:

2 cohorts. We’ll be using the same design, but we’ll try two versions of copy.
Test 1 – Control
Test 2 – Katie Couric First Run 

Details:
English only
Only users who have Yahoo set as their default search

Let me know what other info you'll need.

Comment 1

[Chris More [:cmore]]

I updated the other Optimizely test for onboarding to distribute this test and the onboarding v1.2 add-on (1295873).

https://app.optimizely.com/edit?experiment_id=7502522291

:jpetto: can you review this? Just new variations with updated f= parameters.

Comment 2

[Jonathan Petto [:jpetto]]

Added variations look good.

Noting that the traffic allocation is currently set to 0% for the Yahoo variations.

Comment 3

[Chris More [:cmore]]

Test started at 4:00pm pst on 10/5/2016. It will be shut off on the 16th. Thanks everyone!