1462835 - Replace Sauce Labs Banner with Survey Banner

Status: RESOLVED FIXED

(developer.mozilla.org Graveyard :: General, enhancement, P1)

Description

[Maciej Pluta]

Attachment: home_survey_icon-01.png

Dear Team,

We would like to replace the Home Page Sauce Labs Banner with a new Survey Banner. 

We would like to collect 500 - 1500 responses, which we estimate will take about 1 - 1.5 months. 

See attached creative, the copy would read:
Do you like creating things things for the web? We'd love to hear form you.

Link to the survey:
https://www.surveygizmo.com/s3/4300575/39f3e6f3d824

Please let me know if you'd have any questions.

Comment 1

[John Whitlock [:jwhitlock]]

Maciej,

Kadir tells me that you need this as soon as possible. I've talked to Schalk, and we have a few questions before starting.

1. What is the desired ship date?

2. Is the survey ready, or do you expect more changes (and maybe a URL change)? When will the survey be complete?

3. Who will monitor the response rate, and inform the MDN team when the desired rate is met?

4. Is that 500-1500 total respondents, or are you only counting "qualified" respondents?

5. It appears you are asking for something that looks like the current SauceLabs banner on the home page. This has three elements:
 - An image, hidden at some screen widths. The attached image should work.
 - Introductory text, localized into the display language. The text "Do you like creating things things for the web? We'd love to hear from you." will work well for this
 - Button text with the call-to-action. How about "Take our survey"?

If that sounds good, Schalk would like to create a banner mockup before proceeding.

6. Is an SVG variant of the image available? If it is smaller than the PNG, we'd rather use that.

7. Will the survey be English-only? This is probably OK for the target audience. However, the banner will be displayed in all locales, with localized text.

8. I was unable to get to the second page of the survey. What are the criteria for continuing with the survey?

9. The end-of-survey message is "Sorry, you do not qualify to take this survey". This seems rude to me for someone who took the time to start an optional survey, and unnecessary since they did provide some information. Can we change it to "Thank you for taking our survey.", and have a link that returns to https://developer.mozilla.org/ ?

10. In section 1 of the survey, "front-end" seems out of place, both because it is not capitalized, and because it doesn't feel like a technology or language like the other options. Should it be removed?

11. In section 2 of the survey, "dribble" seems out of place because it is not capitalized. Can it be "Dribble?"

12. In section 1 and 2, the "Other - Write In (Required)" doesn't open a free text field for adding more information. Is this intentional?
 
13. Do we expect to return to the SauceLabs promotion on the homepage at the end of the survey?

14. There's an additional SauceLabs promotion on Cross browser testing page. Should it remain?

https://developer.mozilla.org/en-US/docs/Learn/Tools_and_testing/Cross_browser_testing

Comment 2

[Schalk Neethling [:espressive]]

I am guessing most of the things under libraries/frameworks are placeholder? For example Figma, Adobe XD, InVision, After Effects are neither libraries not frameworks. Also, it is missing key pieces such as React, Nodejs, Vue.js, Angular etc.

Comment 3

[Maciej Pluta]

Than you Schalk, I'm working on collecting all the answers.

Comment 4

[Maciej Pluta]

Attachment: home_survey_icon.svg

Comment 5

[Maciej Pluta]

Thank you John, here are the answers to your questions.

1. What is the desired ship date?
[Maciej] As soon as possible.

2. Is the survey ready, or do you expect more changes (and maybe a URL change)? When will the survey be complete?
[Maciej] Making final changes today, no URL change

3. Who will monitor the response rate, and inform the MDN team when the desired rate is met?
[Maciej] Maciej Pluta and/or Dan Brown 

4. Is that 500-1500 total respondents, or are you only counting "qualified" respondents?
[Maciej] Only qualified, but we will be running the survey on Twitter/LinkedIn as well and count the answers against the total number needed. 

5. It appears you are asking for something that looks like the current SauceLabs banner on the home page. This has three elements:
 - An image, hidden at some screen widths. The attached image should work.
[Maciej] Great. 
 - Introductory text, localized into the display language. The text "Do you like creating things things for the web? We'd love to hear from you." will work well for this
[Maciej] Great!
 - Button text with the call-to-action. How about "Take our survey"?
[Maciej] Works for us! 

If that sounds good, Schalk would like to create a banner mockup before proceeding.
[Maciej] Sounds good.

6. Is an SVG variant of the image available? If it is smaller than the PNG, we'd rather use that.
[Maciej] Here is is (also attached) https://www.dropbox.com/sh/i37oumtgfurlwof/AAABqVMhLHesr23MGKaANhcFa?dl=0 

7. Will the survey be English-only? This is probably OK for the target audience. However, the banner will be displayed in all locales, with localized text.
[Maciej] We are fine with the localization, but the survey will be ENG only

8. I was unable to get to the second page of the survey. What are the criteria for continuing with the survey?

[Maciej] You need to have chosen something in both the first and second question (besides “none of the above” to qualify. Certain job titles such as ‘creative technologist’ will also instantly qualify you.

9. The end-of-survey message is "Sorry, you do not qualify to take this survey". This seems rude to me for someone who took the time to start an optional survey, and unnecessary since they did provide some information. Can we change it to "Thank you for taking our survey.", and have a link that returns to https://developer.mozilla.org/ ?

[Maciej] Yes to the URL, and I’ll add some friendlier text.


10. In section 1 of the survey, "front-end" seems out of place, both because it is not capitalized, and because it doesn't feel like a technology or language like the other options. Should it be removed?

[Maciej] You are right, that is strange and will be taken out.

11. In section 2 of the survey, "dribble" seems out of place because it is not capitalized. Can it be "Dribble?"

[Maciej] Yes

12. In section 1 and 2, the "Other - Write In (Required)" doesn't open a free text field for adding more information. Is this intentional?

[Maciej] This will be fixed.
 
13. Do we expect to return to the SauceLabs promotion on the homepage at the end of the survey?

[Maciej] We do not need to go back to SLs banner. 

14. There's an additional SauceLabs promotion on Cross browser testing page. Should it remain?

[Maciej] We would like to keep it as it seems relevant to the topic on the page

Comment 6

[Dan Brown]

Just wanted to add that the survey has been updated to address the issues and suggestions provided here.

Comment 7

[Schalk Neethling [:espressive]]

Thank you for the updates. A couple of items

> 13. Do we expect to return to the SauceLabs promotion on the homepage at the end of the survey?
> [Maciej] We do not need to go back to SLs banner.

If not the SL banner, do we just leave up the survey? We definitely do not just want white space so, either something completely different or, I would recommend going back to the SL banner

Comment 8

[Schalk Neethling [:espressive]]

Attachment: Screen Shot 2018-05-22 at 14.01.34.png

Here is the proposed layout of the banner. The blue background of the image does not match the blue used on MDN but, I can fix this in the SVG. If the layout works, I can get the code done and open a pull request.

Comment 9

[Dan Brown]

This looks good to me. I'm fine with leaving up the survey. My team can also work with you and the MDN team to find something a bit more evergreen for the spot after all of this.

Comment 10

[Schalk Neethling [:espressive]]

Hey Dan and Maciej,

Do you want to just use the URL as https://www.surveygizmo.com/s3/4300575/39f3e6f3d824 or do you want/need utm paramters added?
For example: https://www.surveygizmo.com/s3/4300575/39f3e6f3d824?utm_campaign=ccps&utm_medium=banner&utm_source=home-page

Comment 11

[Dan Brown]

No need. The URL is unique. I used the "generate unique link" option from surveygizmo so this link is specifically for MDN.

Comment 12

[John Whitlock [:jwhitlock]]

Attachment: survey-1462835.png

rjohnson identified another change for the text. We're going from:

Do you like creating things things for the web? We'd love to hear from you.

to

Do you like creating things for the web? We'd love to hear from you.

espressive has put together a pull request, and it is looking sharp with the SVG. I think this will be on developer.mozilla.org by Tuesday May 29.

Comment 13

[John Whitlock [:jwhitlock]]

Also, the survey looks good to me. I thought Dribbble was wrong, but no, that's how they spell it.

I was able to get to page 2. It was interesting that the "What companies" question had a randomized order, although some options (Not applicable, Other) could be pinned to the bottom, and "Not applicable" doesn't make much sense on page 3.

Thanks for the link back to MDN at the end of the survey.

Comment 14

[John Whitlock [:jwhitlock]]

We'll need another round of reviews before shipping. I think it will be Thursday, May 31st.

Comment 15

[Schalk Neethling [:espressive]]

Yeah, apologies everyone. I lost an entire day of work because of a power outage :-/

Comment 16

[[github robot]]

Commits pushed to master at https://github.com/mozilla/kuma

https://github.com/mozilla/kuma/commit/bcdd8a4b5a7b4673ccab84c31c01f7b8e4bfbc81
bug 1462835: Replace saucelabs banner with survey

https://github.com/mozilla/kuma/commit/faa5763931252c1d309b35f5caa0ab23964b3f30
Merge pull request #4815 from schalkneethling/bug1462835-replace-saucelabs-with-survey-homepage

bug 1462835: replace saucelabs banner with new perception survey

Comment 17

[John Whitlock [:jwhitlock]]

This is deployed to production:

https://developer.mozilla.org/en-US/

We shipped the strings to Pontoon last week, so we have some translations as well:

https://developer.mozilla.org/es/
https://developer.mozilla.org/fr/
https://developer.mozilla.org/zh-CN/

There is a weird bug for me in Firefox dev edition 61.0b9, where I get the wrong image in the survey banner. I get the correct image on FF 60, Chrome, and Safari, and Schalk gets the correct image with FF 61.0b9. My guess is that I have a caching issue that just affects me.