Closed Bug 1249042 Opened 4 years ago Closed 4 years ago

implement and measure firefox & you CTR tests

Categories

(www.mozilla.org :: Pages & Content, defect)

Production
defect
Not set

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: jbertsch, Unassigned)

Details

(Whiteboard: [sprint-2])

Attachments

(5 files)

Let's test improving newsletter CTR (or adding newsletter sign up forms) for the following pages:
- /desktop 
- /products 
- /ios 
- /android 
- /all 
- hello 
- private-browsing

More details here:
https://docs.google.com/document/d/1Q9QuRca6dDX1SdDYvVwPQQQ21I9wnLJIVZSp4JUNMRw/edit#heading=h.dda57fn2njtv
Whiteboard: [sprint-2]
Proposed Design – Addition of Firefox+You Newsletter signup band to Firefox Desktop page. FFX orange (#FF9500) on FFX Light Blue (#0095DD)
Proposed Design – Addition of Firefox+You Newsletter signup band to Firefox Desktop page. FFX Light Blue (#0095DD) on FFX Light Blue (#0095DD)
Proposed Design – Addition of Firefox+You Newsletter signup band to Firefox Product page. FFX Light Orange (#FF9500) on FFX Blue (#00539F)
Proposed Design – Addition of Firefox+You Newsletter signup band to Firefox Product page. FFX Light Orange (#FF9500) on Blue (#0088cc)
Sharing JPEG mock-ups of pages showing Firefox+You newsletter signups with latest A/B copy:

https://mozilla.box.com/newsletter-signup
Hey Michael

Looks good. I think  you can remove the "Firefox + You" headings though - sorry I didn't reply to your earlier email about it.

Thanks.

(In reply to Michael Ham from comment #5)
> Sharing JPEG mock-ups of pages showing Firefox+You newsletter signups with
> latest A/B copy:
> 
> https://mozilla.box.com/newsletter-signup
Note:  the /all page is now out of scope for this test due to technical complexity
Each page will need a waffle switch in production to activate the Optimizely snippet:

firefox-desktop-optimizely
firefox-android-optimizely
firefox-iod-optimizely
firefox-products-optimizely
firefox-hello-optimizely
firefox-private-browsing-optimizely
(In reply to Craig Cook (:craigcook) from comment #8)

> firefox-iod-optimizely

Err, that should be "firefox-ios-optimizely"
(In reply to Craig Cook (:craigcook) from comment #8)

> firefox-hello-optimizely

The Hello page has a new design set to go live March 8 (bug 1240980), so that page's newsletter test won't begin until then. We'll flip the Hello page optimizely switch at the same time we flip 'firefox-hello-2016' to activate the new page.
Commits pushed to master at https://github.com/mozilla/bedrock

https://github.com/mozilla/bedrock/commit/678495662eeb1a1a8def1b9897a4d92fe6d79b1c
Bug 1249042 - testing copy/design of Firefox newsletter form

https://github.com/mozilla/bedrock/commit/435b04d4b2a297dc07642b96994f5511ee37c389
Merge pull request #3900 from mozilla/bug-1249042-firefox-newsletter-testing

Bug 1249042 - testing copy/design of Firefox newsletter form
The following waffle switches should be flipped to ON in production now that the code has been pushed:

firefox-desktop-optimizely
firefox-android-optimizely
firefox-ios-optimizely
firefox-products-optimizely
firefox-private-browsing-optimizely
Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → FIXED
(In reply to Craig Cook (:craigcook) from comment #12)
> The following waffle switches should be flipped to ON in production now that
> the code has been pushed:
> 
> firefox-desktop-optimizely
> firefox-android-optimizely
> firefox-ios-optimizely
> firefox-products-optimizely
> firefox-private-browsing-optimizely

Ran the following in all 3 production deployments:

for switch in firefox-desktop-optimizely firefox-android-optimizely firefox-ios-optimizely firefox-products-optimizely firefox-private-browsing-optimizely; do ./manage.py switch $switch on --create; done
You need to log in before you can comment on or make changes to this bug.