1106015 - EOY A/B Test 1-page vs Sequential Form

Status: RESOLVED FIXED

(Mozilla Foundation :: Metrics, task)

Description

[Adam Lofting (:adamlofting)]

Attachment: screenshot

Report for this bug is here:
https://docs.google.com/a/mozillafoundation.org/document/d/1pUedU227JVKD078sATlijDsvRw6dEw1zmC3dFfZqy5Y/edit

There's a bug to fix before we put the test live.

Comment 1

[Adam Lofting (:adamlofting)]

Live results can be seen here, but give the 'Revenue' comparison some time (at least 24hrs) even if it claims to have found a winner:

https://www.optimizely.com/results2?experiment_id=2233440370&token=2ff96de819c9d4cb6e4a#view=2

Comment 2

[Andrea Wood [:andreawood]]

I think the correct live results page lives here:
http://optimize.ly/~xDntEr?token=7ffbe433d8f0769f1ce2#view=2

at this point sequential is doing 18% better, but i know it's a little early still.

Comment 3

[Adam Lofting (:adamlofting)]

This looks like a strong winner. As I'll be out of comms tomorrow with travel, I've set optimizely to point 95% of traffic to the winning page. That increases the donations while giving the original a little longer to sense check. And we can work through updating this at source on Tues.

Comment 4

[Adam Lofting (:adamlofting)]

The sequential form was the winner. The report has been written up here:
https://docs.google.com/a/mozillafoundation.org/document/d/1pUedU227JVKD078sATlijDsvRw6dEw1zmC3dFfZqy5Y/edit