807947 - Optimizely test: newsletter sign-up form

Status: RESOLVED FIXED

(www.mozilla.org :: Analytics, defect)

Description

[Holly Habstritt Gaal [:Habber]]

I am entering 3 bugs that we will use to test Optimizely. 

The primary goal is to run a couple of tests on areas of mozilla.org to learn how Optimizely works. Once we understand how it works we will move on to testing areas of the site that have greater impact. These tests will run on /en-US/ only.


Test one: Newsletter signup form at bottom of First Run and Homepage

First Run: http://www.mozilla.org/en-US/firefox/15.0/firstrun/
- We will change the call to action copy.

Homepage: https://www.mozilla.org/en-US/
- We will change the style of the newsletter form in some way. 


More detail to come.

Comment 1

[Holly Habstritt Gaal [:Habber]]

Attachment: Homepage newsletter form

Comment 2

[Holly Habstritt Gaal [:Habber]]

Attachment: Homepage newsletter form, expanded

Comment 3

[Holly Habstritt Gaal [:Habber]]

Attachment: First Run newsletter form

Comment 4

[Holly Habstritt Gaal [:Habber]]

Attachment: First Run newsletter form, expanded

Comment 5

[Holly Habstritt Gaal [:Habber]]

Pmac, I have made the following Optimizely experiments:

Newsletter on Mozilla Home:
https://www.optimizely.com/edit#experiment_id=139487676
- tracking interaction with email field
- tracking interaction with "Sign me up" button


Newsletter on First Run Page: 
https://www.optimizely.com/edit#experiment_id=138089532
- tracking interaction with email field
- tracking opting into newsletter (user selects button)
- Moved second block of text after video, so user has more to interact with closer to the email field. 


Can we get the First Run and Homepage URLs on a demo server? Then we can test this with just a few of us internally.

Comment 6

[Paul [:pmac] McLanahan]

So, first run is on the PHP side still, but will be on bedrock soon. Let's hold off on that as changes on the PHP side roll out to all demo servers. I deployed the optimizely snippet to demo1[0]. Since the snippet doesn't change per experiment, I just dropped it into the base templates, so all bedrock-based pages are now at your experimental disposal on demo1. We should NOT deploy this to production, but it'll be a great way to experiment with optimizely.

Let me know if there are issues.

[0] https://www-demo1.allizom.org/en-US/

Comment 7

[Holly Habstritt Gaal [:Habber]]

This test is working and sending results to Optimizely. I'll make sure the blogs test is working as well before we share to a larger group.

Comment 8

[Holly Habstritt Gaal [:Habber]]

Test was reset and expanded to Engagement Team mailing list today.

Comment 9

[Holly Habstritt Gaal [:Habber]]

Test closed.

Comment 10

[Andrei [:sancus]]

It looks like this test is done and hasn't seen any action in a long time, so I'm going to close this. Please reopen if I'm wrong!