implement and measure firefox & you CTR tests

RESOLVED FIXED

Status

RESOLVED FIXED
3 years ago
3 years ago

People

(Reporter: jbertsch, Unassigned)

Tracking

Production

Firefox Tracking Flags

(Not tracked)

Details

(Whiteboard: [sprint-2])

Attachments

(5 attachments)

(Reporter)

Description

3 years ago
Let's test improving newsletter CTR (or adding newsletter sign up forms) for the following pages:
- /desktop 
- /products 
- /ios 
- /android 
- /all 
- hello 
- private-browsing

More details here:
https://docs.google.com/document/d/1Q9QuRca6dDX1SdDYvVwPQQQ21I9wnLJIVZSp4JUNMRw/edit#heading=h.dda57fn2njtv
(Reporter)

Updated

3 years ago
Whiteboard: [sprint-2]

Comment 1

3 years ago
Created attachment 8720552 [details]
moz_firefox-desktop_nwslttr_orange.jpg

Proposed Design – Addition of Firefox+You Newsletter signup band to Firefox Desktop page. FFX orange (#FF9500) on FFX Light Blue (#0095DD)

Comment 2

3 years ago
Created attachment 8720553 [details]
moz_firefox-desktop_nwslttr_blue.jpg

Proposed Design – Addition of Firefox+You Newsletter signup band to Firefox Desktop page. FFX Light Blue (#0095DD) on FFX Light Blue (#0095DD)

Comment 3

3 years ago
Created attachment 8720554 [details]
moz_firefox-products_nwslttr_orange-on-FFX-blue.jpg

Proposed Design – Addition of Firefox+You Newsletter signup band to Firefox Product page. FFX Light Orange (#FF9500) on FFX Blue (#00539F)

Comment 4

3 years ago
Created attachment 8720889 [details]
moz_firefox-products_nwslttr_orange-on-0088cc.jpg

Proposed Design – Addition of Firefox+You Newsletter signup band to Firefox Product page. FFX Light Orange (#FF9500) on Blue (#0088cc)

Comment 5

3 years ago
Sharing JPEG mock-ups of pages showing Firefox+You newsletter signups with latest A/B copy:

https://mozilla.box.com/newsletter-signup

Comment 6

3 years ago
Hey Michael

Looks good. I think  you can remove the "Firefox + You" headings though - sorry I didn't reply to your earlier email about it.

Thanks.

(In reply to Michael Ham from comment #5)
> Sharing JPEG mock-ups of pages showing Firefox+You newsletter signups with
> latest A/B copy:
> 
> https://mozilla.box.com/newsletter-signup
(Reporter)

Comment 7

3 years ago
Note:  the /all page is now out of scope for this test due to technical complexity
Created attachment 8723486 [details] [review]
Github pull request https://github.com/mozilla/bedrock/pull/3900

Each page will need a waffle switch in production to activate the Optimizely snippet:

firefox-desktop-optimizely
firefox-android-optimizely
firefox-iod-optimizely
firefox-products-optimizely
firefox-hello-optimizely
firefox-private-browsing-optimizely
(In reply to Craig Cook (:craigcook) from comment #8)

> firefox-iod-optimizely

Err, that should be "firefox-ios-optimizely"
(In reply to Craig Cook (:craigcook) from comment #8)

> firefox-hello-optimizely

The Hello page has a new design set to go live March 8 (bug 1240980), so that page's newsletter test won't begin until then. We'll flip the Hello page optimizely switch at the same time we flip 'firefox-hello-2016' to activate the new page.

Comment 11

3 years ago
Commits pushed to master at https://github.com/mozilla/bedrock

https://github.com/mozilla/bedrock/commit/678495662eeb1a1a8def1b9897a4d92fe6d79b1c
Bug 1249042 - testing copy/design of Firefox newsletter form

https://github.com/mozilla/bedrock/commit/435b04d4b2a297dc07642b96994f5511ee37c389
Merge pull request #3900 from mozilla/bug-1249042-firefox-newsletter-testing

Bug 1249042 - testing copy/design of Firefox newsletter form
The following waffle switches should be flipped to ON in production now that the code has been pushed:

firefox-desktop-optimizely
firefox-android-optimizely
firefox-ios-optimizely
firefox-products-optimizely
firefox-private-browsing-optimizely
Status: NEW → RESOLVED
Last Resolved: 3 years ago
Resolution: --- → FIXED

Comment 13

3 years ago
(In reply to Craig Cook (:craigcook) from comment #12)
> The following waffle switches should be flipped to ON in production now that
> the code has been pushed:
> 
> firefox-desktop-optimizely
> firefox-android-optimizely
> firefox-ios-optimizely
> firefox-products-optimizely
> firefox-private-browsing-optimizely

Ran the following in all 3 production deployments:

for switch in firefox-desktop-optimizely firefox-android-optimizely firefox-ios-optimizely firefox-products-optimizely firefox-private-browsing-optimizely; do ./manage.py switch $switch on --create; done
You need to log in before you can comment on or make changes to this bug.