1249042 - implement and measure firefox & you CTR tests

Status: RESOLVED FIXED

(www.mozilla.org :: Pages & Content, defect)

Description

[Jennifer Bertsch [:jbertsch]]

Let's test improving newsletter CTR (or adding newsletter sign up forms) for the following pages:
- /desktop 
- /products 
- /ios 
- /android 
- /all 
- hello 
- private-browsing

More details here:
https://docs.google.com/document/d/1Q9QuRca6dDX1SdDYvVwPQQQ21I9wnLJIVZSp4JUNMRw/edit#heading=h.dda57fn2njtv

Comment 1

[Michael Ham]

Attachment: moz_firefox-desktop_nwslttr_orange.jpg

Proposed Design – Addition of Firefox+You Newsletter signup band to Firefox Desktop page. FFX orange (#FF9500) on FFX Light Blue (#0095DD)

Comment 2

[Michael Ham]

Attachment: moz_firefox-desktop_nwslttr_blue.jpg

Proposed Design – Addition of Firefox+You Newsletter signup band to Firefox Desktop page. FFX Light Blue (#0095DD) on FFX Light Blue (#0095DD)

Comment 3

[Michael Ham]

Attachment: moz_firefox-products_nwslttr_orange-on-FFX-blue.jpg

Proposed Design – Addition of Firefox+You Newsletter signup band to Firefox Product page. FFX Light Orange (#FF9500) on FFX Blue (#00539F)

Comment 4

[Michael Ham]

Attachment: moz_firefox-products_nwslttr_orange-on-0088cc.jpg

Proposed Design – Addition of Firefox+You Newsletter signup band to Firefox Product page. FFX Light Orange (#FF9500) on Blue (#0088cc)

Comment 5

[Michael Ham]

Sharing JPEG mock-ups of pages showing Firefox+You newsletter signups with latest A/B copy:

https://mozilla.box.com/newsletter-signup

Comment 6

[Troy Palmer]

Hey Michael

Looks good. I think  you can remove the "Firefox + You" headings though - sorry I didn't reply to your earlier email about it.

Thanks.

(In reply to Michael Ham from comment #5)
> Sharing JPEG mock-ups of pages showing Firefox+You newsletter signups with
> latest A/B copy:
> 
> https://mozilla.box.com/newsletter-signup

Comment 7

[Jennifer Bertsch [:jbertsch]]

Note:  the /all page is now out of scope for this test due to technical complexity

Comment 8

[Craig Cook (:craigcook)]

Attachment: Github pull request https://github.com/mozilla/bedrock/pull/3900

Each page will need a waffle switch in production to activate the Optimizely snippet:

firefox-desktop-optimizely
firefox-android-optimizely
firefox-iod-optimizely
firefox-products-optimizely
firefox-hello-optimizely
firefox-private-browsing-optimizely

Comment 9

[Craig Cook (:craigcook)]

(In reply to Craig Cook (:craigcook) from comment #8)

> firefox-iod-optimizely

Err, that should be "firefox-ios-optimizely"

Comment 10

[Craig Cook (:craigcook)]

(In reply to Craig Cook (:craigcook) from comment #8)

> firefox-hello-optimizely

The Hello page has a new design set to go live March 8 (bug 1240980), so that page's newsletter test won't begin until then. We'll flip the Hello page optimizely switch at the same time we flip 'firefox-hello-2016' to activate the new page.

Comment 11

[[github robot]]

Commits pushed to master at https://github.com/mozilla/bedrock

https://github.com/mozilla/bedrock/commit/678495662eeb1a1a8def1b9897a4d92fe6d79b1c
Bug 1249042 - testing copy/design of Firefox newsletter form

https://github.com/mozilla/bedrock/commit/435b04d4b2a297dc07642b96994f5511ee37c389
Merge pull request #3900 from mozilla/bug-1249042-firefox-newsletter-testing

Bug 1249042 - testing copy/design of Firefox newsletter form

Comment 12

[Craig Cook (:craigcook)]

The following waffle switches should be flipped to ON in production now that the code has been pushed:

firefox-desktop-optimizely
firefox-android-optimizely
firefox-ios-optimizely
firefox-products-optimizely
firefox-private-browsing-optimizely

Comment 13

[Josh Mize [:jgmize]]

(In reply to Craig Cook (:craigcook) from comment #12)
> The following waffle switches should be flipped to ON in production now that
> the code has been pushed:
> 
> firefox-desktop-optimizely
> firefox-android-optimizely
> firefox-ios-optimizely
> firefox-products-optimizely
> firefox-private-browsing-optimizely

Ran the following in all 3 production deployments:

for switch in firefox-desktop-optimizely firefox-android-optimizely firefox-ios-optimizely firefox-products-optimizely firefox-private-browsing-optimizely; do ./manage.py switch $switch on --create; done