1341425 - Task completion rate survey on mozilla.org

Status: RESOLVED FIXED

(www.mozilla.org :: Pages & Content, defect)

Description

[Eric Renaud [:erenaud]]

Set up link to survey (Survey Monkey)for task completion on mozilla.org

Comment 1

[Alex Gibson [:agibson]]

Hi Peter,

Any direction for which pages you would like this survey to display on? I know you mentioned not showing it on the firefox download pages which makes sense, but what I'm curious about is if we want to show it pretty much *everywhere else*, or if showing it on a curated list of pages would be considered enough. Technically we could do it either way, but happy to discuss when you're around later today.

Comment 2

[pgerman]

Hi Alex,

The link to the survey is here: https://www.surveygizmo.com/s3/3353529/Moz-org-Task-Completion-Rate

It should be displayed to our main locale only for now /en-US/.

Exclude the following pages:
/firefox/new/
/firefox/new/?scene=2
/firefox/[version]/firstrun
/firefox/plugincheck/ (I feel like we already know why people come here and if they're successful)

I've added Justin Crawford to review the survey and this list of pages as well.

Comment 3

[Alex Gibson [:agibson]]

Some other pages I think we should exclude:

/firefox/[version]/whatsnew/ (in product page)
/firefox/[version]/tracking-protection/start/ (in product tour)
/firefox/features/ (this URL is redirected from old /firefox/firstrun/learnmore/ URLs)
/firefox/installer-help/ (may not be the appropriate time to launch a survey on someone)
/firefox/os/ (pages are currently being deprecated)
/firefox/channel/
/firefox/developer/
/firefox/all/
/firefox/feedback/ (in product page)

There may be a few more we need to exclude for UI reasons, which I'll add as I find them.

Comment 4

[Alex Gibson [:agibson]]

Further to our discussion today:

- Survey is to be toggled off behind a feature switch. We'll turn it on a few weeks before the Universal Nav prototype goes out, and then gauge for change in the overall sentiment of responses.
- If someone clicks the survey link or closes the popup, never show them the survey again.
- If someone ignores the survey, don't show them again for (x) days.

Comment 5

[Alex Gibson [:agibson]]

WIP version is now up on demo4: https://www-demo4.allizom.org/en-US/

Note: I've disabled the cookie check for now to make testing easier.

Comment 6

[pgerman]

Looks good to me. Can we hook up the survey?

Comment 7

[Alex Gibson [:agibson]]

(In reply to pgerman from comment #6)
> Looks good to me. Can we hook up the survey?

Sure, can you please provide the URL?

Comment 8

[pgerman]

Comment 2 :D

Comment 9

[Alex Gibson [:agibson]]

(In reply to pgerman from comment #8)
> Comment 2 :D

Oh, I'm being blind - forgive me :)

Comment 10

[Alex Gibson [:agibson]]

Correct survey link is now in place on demo:

https://www-demo4.allizom.org/en-US/

Comment 11

[Alex Gibson [:agibson]]

Ok the cookie that now hides the survey once seen / interacted with is now in place on demo 4.

For testing you will either have to clear either of the two cookies to see the survey again, or alternatively use a private window:

'moz-task-completion-survey-interaction'
'moz-task-completion-survey-shown'

Comment 12

[Alex Gibson [:agibson]]

Attachment: GitHub pull request

Comment 13

[Alex Gibson [:agibson]]

Peter,

I've added some logic to bedrock to automatically include the URL path as a query parameter to Survey Gizmo as discussed:

https://www-demo4.allizom.org/

(Note: for now I've disabled the cookie check, so the survey shows up every time to make testing easier).

I also added the related hidden fields to the survey form for both Date and Page. After completing the survey I can see both the Date and Page being populated correctly in the results page [1], so it looks like we don't need the custom JS that MDN used (assuming all we're really needing here is the page URL).

I can't seem to find a way to check the Google Spread Sheet however, so perhaps you could verify that all looks well?

[1] https://app.surveygizmo.com/explorer/report-summary/id/3353529

Comment 14

[pgerman]

Last week I confirmed that this was working appropriately.

Comment 15

[[github robot]]

Commits pushed to master at https://github.com/mozilla/bedrock

https://github.com/mozilla/bedrock/commit/9b6dd4401ca5f7c66a2423c217beced6fbfb8e9b
[fix bug 1341425] Task completion rate survey on mozilla.org

https://github.com/mozilla/bedrock/commit/433619292bf1449c7d9b7c000429951cbb05c247
Merge pull request #4678 from alexgibson/bug-1341425-task-completion-survey

[fix bug 1341425] Task completion rate survey on mozilla.org

Comment 16

[[github robot]]

Commits pushed to master at https://github.com/mozilla/bedrock

https://github.com/mozilla/bedrock/commit/cecd0890b2f06483af2a3d9183b8277aba132425
[bug 1341425] Rate limit task completion survey at 10%

https://github.com/mozilla/bedrock/commit/4f900871251930543e283424a60cb38bf3a4e635
Merge pull request #4717 from alexgibson/bug-1341425-rate-limit-survey

[bug 1341425] Rate limit task completion survey at 10%

Comment 17

[Alex Gibson [:agibson]]

Survey is complete - reopening this to remove the survey code.

Comment 18

[Alex Gibson [:agibson]]

Attachment: GitHub pull request

PR to remove survey code from all pages.

Comment 19

[[github robot]]

Commits pushed to master at https://github.com/mozilla/bedrock

https://github.com/mozilla/bedrock/commit/ee8e64faa0d4c6bddaff034fa796e6ced59c7b44
[fix bug 1341425] Remove task completion survey code

https://github.com/mozilla/bedrock/commit/23f68a52fe10fa1017e65959eef45f2fe40ffa68
Merge pull request #4809 from alexgibson/bug-1341425-remove-mozorg-survey-code

[fix bug 1341425] Remove task completion survey code