1112206 - Set up A/B testing with Optimizely for splash page

Status: RESOLVED FIXED

(Webmaker Graveyard :: webmaker.org, defect)

Description

[Bobby Richter [:secretrobotron]]

Create Optimizely tests to A/B test copy on the splash page

Recently created test matrix for copy: https://foundation.etherpad.mozilla.org/SplashPageCopy

Comment 1

[paulj]

We have all the assets ready to go live for primary version, Split 1. 

We have final copy for all other splits, 2-4.

Ricardo, can you confirm (or work) on 2nd design for splits 2 & 4? This is the "human" version where we would be using photography assets that are closer in style to current Webmaker visuals.

Comment 2

[Ricardo Vazquez [:ricardo]]

Attachment: https://www.dropbox.com/s/dv9venl1p22fsfr/Split%20Test%20Assets.zip?dl=0

Split Test Assets.

Different background image for top section.
Different globe colour

Comment 3

[Bobby Richter [:secretrobotron]]

@adam: filed 1112225 to get this stuff up on prod. List of pages to go along with the testing matrix:
https://webmaker.mofostaging.net/en-US/
https://webmaker.mofostaging.net/en-US/home-2
https://webmaker.mofostaging.net/en-US/home-3
https://webmaker.mofostaging.net/en-US/home-4
https://webmaker.mofostaging.net/en-US/home-5

On prod, they'll just have a different host. When we come back on the 5th, let's launch and hook up Optimizely.

Comment 4

[Adam Lofting (:adamlofting)]

A quick note that I'll be on PTO until 17th Jan.

Comment 5

[Adam Lofting (:adamlofting)]

Nice work setting this up in my absence :)

Next time we can do some more direct conversion tracking in Optimizely, as the Webmaker login flow is tagged with Optimizely conversion goals that we can hook into (even if the conversion happens several pages later in the users visit).

But for now, analyzing this as we've done in GA is a good solution.