1313708 - Yahoo Search Test /firstrun - multiple provider search results

Status: RESOLVED FIXED

(www.mozilla.org :: Pages & Content, defect)

Description

[Eric Renaud [:erenaud]]

Create Firstrun pages (3) with copy variants and design supporting the test value proposition coded, tested, and live
- Funnels cake complete and live
- Optimizely configured and in place

Comment 1

[Alex Gibson [:agibson]]

As per a discussion that happened via email, there is an additional ask for some UITour functionality on these pages:

1.) User clicks a CTA button on the page.
2.) Search field is auto-focused ready for the user to perform a search (displaying the drop down search UI).

Comment 2

[Alex Gibson [:agibson]]

As per Bug 1312666, funnelcake ID's are as follows:

91 - control 
92 - variation 1

Test is en-US only.

Comment 3

[Luka Cempre (formerly owned by James Lorence)]

Hi,

from analytics perspective we want to ensure that the following attributes for links are added:

1. Firefox Download Links to include data attributes (with examples)
- data-direct-link="https://download-sha1.allizom.org/?product=firefox-stub&os=win&lang=en-US"
- data-link-type="download"
- data-display-name="Windows (XP/Vista)"
- data-download-version="winsha1"
- data-download-os="Desktop"

2. Other links to include the following 2 attributes (with examples):
data-link-type="footer" 
data-link-name="Privacy Policy"

Values for data link type can be link, nav, button, footer depending on the position on the page.

3. Is there a production page available to be accessed? I want to make sure that all the events are triggered as expected.

Thank you

Comment 4

[Alex Gibson [:agibson]]

(In reply to Luka Cempre (formerly owned by James Lorence) from comment #3)
> Hi,
> 
> from analytics perspective we want to ensure that the following attributes
> for links are added:
> 
> 1. Firefox Download Links to include data attributes (with examples)
> -
> data-direct-link="https://download-sha1.allizom.org/?product=firefox-
> stub&os=win&lang=en-US"
> - data-link-type="download"
> - data-display-name="Windows (XP/Vista)"
> - data-download-version="winsha1"
> - data-download-os="Desktop"

There should be no download buttons on this particular page, since this is /firstrun and the user is already using Firefox.

> 2. Other links to include the following 2 attributes (with examples):
> data-link-type="footer" 
> data-link-name="Privacy Policy"
> 
> Values for data link type can be link, nav, button, footer depending on the
> position on the page.

Will do, thanks.

> 3. Is there a production page available to be accessed? I want to make sure
> that all the events are triggered as expected.

The page will be available on a demo server soon, but for reference it will look very much like this page:

https://www.mozilla.org/en-US/firefox/49.0/firstrun/?f=90

The main addition will be a CTA button which the user can click in order to trigger the search UI. I'm guessing you'll want either a custom event here, or alternatively a specific set of data attributes for the button; as this will be the main interaction we want to get data on.

I'll update the bug here once this is available on demo for testing.

Comment 5

[Eric Renaud [:erenaud]]

Alex - Funnelcake builds are ready (note the possibility for change though, as nthomas describes in https://bugzilla.mozilla.org/show_bug.cgi?id=1312666#c4 )

Config landed as part of https://github.com/mozilla-partners/funnelcake/pull/40. 

Funnelcake installers based on 50.0 build2:

91:
http://archive.mozilla.org/pub/firefox/candidates/50.0-candidates/build2/partner-repacks/funnelcake91/win32/en-US/Firefox%20Setup%2050.0.exe (SHA1: 211b6c502ebe5bf32f464004c5458869ea1864ee)

92:
http://archive.mozilla.org/pub/firefox/candidates/50.0-candidates/build2/partner-repacks/funnelcake92/win32/en-US/Firefox%20Setup%2050.0.exe (SHA1: ecf8e0f892b5f40c64c2c6b91ba2edcb9b682741)

Comment 6

[Alex Gibson [:agibson]]

(In reply to Eric Renaud from comment #5)
> Alex - Funnelcake builds are ready (note the possibility for change though,
> as nthomas describes in
> https://bugzilla.mozilla.org/show_bug.cgi?id=1312666#c4 )
> 
> Config landed as part of
> https://github.com/mozilla-partners/funnelcake/pull/40. 
> 
> Funnelcake installers based on 50.0 build2:
> 
> 91:
> http://archive.mozilla.org/pub/firefox/candidates/50.0-candidates/build2/
> partner-repacks/funnelcake91/win32/en-US/Firefox%20Setup%2050.0.exe (SHA1:
> 211b6c502ebe5bf32f464004c5458869ea1864ee)
> 
> 92:
> http://archive.mozilla.org/pub/firefox/candidates/50.0-candidates/build2/
> partner-repacks/funnelcake92/win32/en-US/Firefox%20Setup%2050.0.exe (SHA1:
> ecf8e0f892b5f40c64c2c6b91ba2edcb9b682741)

Thanks for confirming Eric

Comment 7

[Eric Renaud [:erenaud]]

Alex - 

Imagery here - 

https://www.dropbox.com/s/pz3fdk4xm1cuzhl/firefox-first-run_yahoo-with-google-search_FINAL.sketch?dl=0

Copy variations are here - 

https://docs.google.com/document/d/16iIi_b51kIV4muczXTcM8sOPM9RFKsK6VwiEwquwF0Y/edit#

Comment 8

[Alex Gibson [:agibson]]

(In reply to Eric Renaud from comment #7)
> Alex - 
> 
> Imagery here - 
> 
> https://www.dropbox.com/s/pz3fdk4xm1cuzhl/firefox-first-run_yahoo-with-
> google-search_FINAL.sketch?dl=0
> 
> Copy variations are here - 
> 
> https://docs.google.com/document/d/
> 16iIi_b51kIV4muczXTcM8sOPM9RFKsK6VwiEwquwF0Y/edit#

Which copy in the doc should be used? It is not quite clear what's final to me. Thanks

Comment 9

[Alex Gibson [:agibson]]

This is now up on demo. although strings are not yet final:

https://bedrock-demo-agibson.us-west.moz.works/en-US/firefox/50.0/firstrun/?f=92

Note: to see the blue CTA button you will need to whitelist https://bedrock-demo-agibson.us-west.moz.works to work with UITour. You can do that using this plugin [1], or manually using the docs here [2]

[1] https://alexgibson.github.io/uitour-config/
[2] http://bedrock.readthedocs.io/en/latest/uitour.html#local-development

Comment 10

[Eric Renaud [:erenaud]]

agibson - a bit of change here, apologies.  Only one (new) /firstrun page will be used for the test (not 3 w. copy variants).  No need for the traffic cop.

FF team will provide us with the image and copy when approved by Yahoo.

Current go live target has been pushed to Nov 30th, pending approvals, of course.

Comment 11

[Alex Gibson [:agibson]]

Attachment: GitHub pull request

Comment 12

[Alex Gibson [:agibson]]

Demo is now updated as per Comment 10:

https://bedrock-demo-agibson.us-west.moz.works/en-US/firefox/50.0/firstrun/?f=92 (yahoo)
https://bedrock-demo-agibson.us-west.moz.works/en-US/firefox/50.0/firstrun/?f=91 (control)

Comment 13

[u570438]

Please add the following to the button.

dataLayer.push({
    'event': 'yh-click',
    'eventLabel': 'Yahoo Search Click' 
});

Comment 14

[Alex Gibson [:agibson]]

(In reply to Peter German from comment #13)
> Please add the following to the button.
> 
> dataLayer.push({
>     'event': 'yh-click',
>     'eventLabel': 'Yahoo Search Click' 
> });

Done, thanks

Comment 15

[Fabio Rios [:frios]]

Hey Alex, we have an updated design file for the Yahoo search page, you can download it here: https://www.dropbox.com/s/3g25kffbnebezx6/firefox-first-run_yahoo-with-google-search_fish_FINAL.sketch?dl=0

Please let me know if you have any questions. Thanks

Comment 16

[Alex Gibson [:agibson]]

(In reply to Fabio Rios [:frios] from comment #15)
> Hey Alex, we have an updated design file for the Yahoo search page, you can
> download it here:
> https://www.dropbox.com/s/3g25kffbnebezx6/firefox-first-run_yahoo-with-
> google-search_fish_FINAL.sketch?dl=0
> 
> Please let me know if you have any questions. Thanks

Thanks Fabio,

I notice there is no page footer on this design with links to privacy policy etc, is this no longer required?

Comment 17

[Alex Gibson [:agibson]]

Latest design & copy are up on demo:

https://bedrock-demo-agibson.us-west.moz.works/en-US/firefox/50.0/firstrun/?f=92

Please see comment 9 for configuring UITour.

I've left our standard footer links on the page for the time being (I'm assuming they need to be kept in).

Comment 18

[mternoway]

(In reply to Alex Gibson [:agibson] from comment #16)
> (In reply to Fabio Rios [:frios] from comment #15)
> > Hey Alex, we have an updated design file for the Yahoo search page, you can
> > download it here:
> > https://www.dropbox.com/s/3g25kffbnebezx6/firefox-first-run_yahoo-with-
> > google-search_fish_FINAL.sketch?dl=0
> > 
> > Please let me know if you have any questions. Thanks
> 
> Thanks Fabio,
> 
> I notice there is no page footer on this design with links to privacy policy
> etc, is this no longer required?

My mistake, Alex. I didn't include the footer in the Sketch file I sent along, but I see you included in the demo - which looks great - I believe including them makes sense, but maybe Fabio has a better idea here.

Comment 19

[Alex Gibson [:agibson]]

Ok, I think we have everything we need now in terms of copy & design.

Fabio / Winston, could you please take a look at the page and give us any final amends / sign-off to move forward?

https://bedrock-demo-agibson.us-west.moz.works/en-US/firefox/50.0/firstrun/?f=92

Please note to see the UITour functionality when clicking the cta button you will need to white-list the demo server (see comment 9 for instructions).

Comment 20

[Fabio Rios [:frios]]

Alex, 

Nice catch on the footer links.

can you move the "Yahoo is one of Mozilla’s search partners. Learn more." copy down and away from the purple CTA and much closer to the footer copy?

Since our CTA doesn't have text in it, I don't want the viewer to associate this copy as instruction for the CTA. At the moment it commands more attention then it merits.

Thanks

Comment 21

[Alex Gibson [:agibson]]

(In reply to Fabio Rios [:frios] from comment #20)
> Alex, 
> 
> Nice catch on the footer links.
> 
> can you move the "Yahoo is one of Mozilla’s search partners. Learn more."
> copy down and away from the purple CTA and much closer to the footer copy?
> 
> Since our CTA doesn't have text in it, I don't want the viewer to associate
> this copy as instruction for the CTA. At the moment it commands more
> attention then it merits.
> 
> Thanks

Will do, thanks

Comment 22

[mternoway]

Can we drop it out of a view below the fold on a 1366x768 screen res?

Comment 23

[Alex Gibson [:agibson]]

(In reply to mternoway from comment #22)
> Can we drop it out of a view below the fold on a 1366x768 screen res?

Sure

Comment 24

[Jennifer Balaco]

Replying for Winston since he's having bugzilla issues:
"Looks good to me! Except the button isn't working, even after installing the add-on."

Comment 25

[Alex Gibson [:agibson]]

(In reply to Jennifer Balaco from comment #24)
> Replying for Winston since he's having bugzilla issues:
> "Looks good to me! Except the button isn't working, even after installing
> the add-on."

If Winston would like some help configuring UITour I'd be happy to help.

Comment 26

[Fabio Rios [:frios]]

(In reply to Alex Gibson [:agibson] from comment #25)
> (In reply to Jennifer Balaco from comment #24)
> > Replying for Winston since he's having bugzilla issues:
> > "Looks good to me! Except the button isn't working, even after installing
> > the add-on."
> 
> If Winston would like some help configuring UITour I'd be happy to help.

All good on my side! Thanks Alex

Comment 27

[Alex Gibson [:agibson]]

Ok, we're now at a stage where this needs to move forward, but I'm still unclear on whether we have all the approvals we need. Last time I inquired with Eric on final status, he mentioned that Yahoo might need to see this on the demo server. Has this happened? Does it need to happen? Or are we free to move forward. Thanks

Comment 28

[Fabio Rios [:frios]]

Hey Alex, I sent this off to Yahoo on Wednesday. Please move forward to next phase.

Comment 29

[Alex Gibson [:agibson]]

(In reply to Fabio Rios [:frios] from comment #28)
> Hey Alex, I sent this off to Yahoo on Wednesday. Please move forward to next
> phase.

Thanks

Comment 30

[[github robot]]

Commits pushed to master at https://github.com/mozilla/bedrock

https://github.com/mozilla/bedrock/commit/5add51a14df08a4f2dee8be5c54fecfe38f745ec
[fix bug 1313708] Yahoo Search Test /firstrun

https://github.com/mozilla/bedrock/commit/8b564c1fb962e20b865b5b093013f02b6845d840
Merge pull request #4466 from alexgibson/bug-1313708-yahoo-search-retention

[fix bug 1313708] Yahoo Search Test /firstrun