1309289 - Optimizely test: Email Opt-In Baseline Test

Status: RESOLVED FIXED

(www.mozilla.org :: Analytics, defect)

Description

[Ben Niolet]

The purpose of this test is to understand the email opt-in rate if we re-direct users in first run to the ../newsletter/firefox/ page. 

Test plan: https://docs.google.com/document/d/1YcwuylA2IZAcEAMJSGkcQYi6LEshYow-fwRZkpU7jhE/edit
Optimizely: https://app.optimizely.com/edit?experiment_id=7593765991

Target audience
Browser: Firefox, desktop only
Language: en
Country: any
Traffic allocation: 8%

Comment 1

[Ben Niolet]

Cmore, r?

Comment 2

[Chris More [:cmore]]

Reviewed the original redirect, variation redirect, URL target, audience and goals. All looks fine to me. A simple redirect and we'll measure goals via Google Analytics since both the original and variation have redirects on them with UTM parameters.

:jpetto: r?

Comment 3

[Jonathan Petto [:jpetto]]

Code looks good.

Just checking - FxA Redirect variation has 0% audience?

Comment 4

[Chris More [:cmore]]

(In reply to Jon Petto [:jpetto] from comment #3)
> Code looks good.
> 
> Just checking - FxA Redirect variation has 0% audience?

That's right. I wasn't initially going to be using the original, but did a redirect there, so I could do all of the analysis in Google Analytics. It is 50/50 now. Thanks!

Comment 5

[Chris More [:cmore]]

es-ES stopped at 9am PST on 10/17 (15k visitors tested)

en-US started at 9:30am PST on 10/17

Comment 6

[Chris More [:cmore]]

Global baseline test stopped. Ran from 10/25 to 11/7