1283043 - Add Conscious Chooser specific survey link to mozilla.org homepage via Optimizely

Status: RESOLVED FIXED

(www.mozilla.org :: General, defect)

Description

[Holly Habstritt Gaal [:Habber]]

A brand perception survey was previously distributed to gather pre-mozilla.org redesign feedback from our users. (bug 1270141)

Based on these survey results, we modified one of the questions to learn more about our Conscious Chooser audience using a new Optimizely experiment. 

New Optimizely experiment link for this survey and code review https://app.optimizely.com/edit?experiment_id=6379870434


Banner code used in this Optimizely experiment is reused from this past experiment (that Jpetto previously code reviewed) - 
https://app.optimizely.com/edit?experiment_id=5802560476

Comment 1

[Holly Habstritt Gaal [:Habber]]

Hi Jon, would it make sense for you to code review this one since you reviewed past similar experiments?

Comment 2

[Jonathan Petto [:jpetto]]

Cleaned up the code a little to remove redundancies introduced by Optimizely's code generator. r+ from me.

Please give the variation one more inspection prior to launch to verify things are as expected.

Comment 3

[Holly Habstritt Gaal [:Habber]]

(In reply to Jon Petto [:jpetto] from comment #2)
> Cleaned up the code a little to remove redundancies introduced by
> Optimizely's code generator. r+ from me.
> 
> Please give the variation one more inspection prior to launch to verify
> things are as expected.

Thanks, Jon. I'll take another look, will review with the other interested parties, and will comment back in there when it's ready for launch.

Comment 4

[Holly Habstritt Gaal [:Habber]]

I ran into one intermittent issue when previewing. Homepage prototype A loaded instead of the current live site, but with this new survey link. http://cl.ly/192j2P31141E

I'd like to be sure we know what the page variation this survey will be shown on is our current Mozilla.org homepage and not one of our new prototype test variations. Should we wait until we are done testing Prototype A before posting this survey to avoid the collision?

Comment 5

[Jonathan Petto [:jpetto]]

Chatted with cmore briefly in IRC, and it looks like it would be better to put this code directly in bedrock rather than trying to wrangle Optimizely to work with two experiments targeting the exact same URL.

I'll open a PR later today to add this to the current home page.

Comment 6

[Holly Habstritt Gaal [:Habber]]

Survey link - https://www.surveygizmo.com/s3/2890025/Help-us-by-sharing-your-feedback-about-Mozilla

Comment 7

[Jonathan Petto [:jpetto]]

:habber - Can you confirm this survey should only be displayed for en-US, non-Firefox users? The Optimizely experiment was set up as such, but I'd like to make sure (particularly about the non-Fx part) prior to merging.

Thanks!

Comment 8

[Holly Habstritt Gaal [:Habber]]

(In reply to Jon Petto [:jpetto] from comment #7)
> :habber - Can you confirm this survey should only be displayed for en-US,
> non-Firefox users? The Optimizely experiment was set up as such, but I'd
> like to make sure (particularly about the non-Fx part) prior to merging.
> 
> Thanks!

You are correct. en-US only. From my understanding, this can be distributed to both Firefox and Non-Firefox users and we will receive a report that combines responses from these users. 

I'd like to also validate with jbertsch, that it's ok to group these responses like it was before. If not, I can create another survey URL, so that we have results specific to Firefox users and results specific to non-Firefox users. 

Jen, could you let Jon know if he can proceed with a single survey that is distributed to both Firefox and non-Firefox users?

Comment 9

[Jennifer Bertsch [:jbertsch]]

(In reply to Holly Habstritt Gaal [:Habber] from comment #8)
> (In reply to Jon Petto [:jpetto] from comment #7)
> > :habber - Can you confirm this survey should only be displayed for en-US,
> > non-Firefox users? The Optimizely experiment was set up as such, but I'd
> > like to make sure (particularly about the non-Fx part) prior to merging.
> > 
> > Thanks!
> 
> You are correct. en-US only. From my understanding, this can be distributed
> to both Firefox and Non-Firefox users and we will receive a report that
> combines responses from these users. 
> 
> I'd like to also validate with jbertsch, that it's ok to group these
> responses like it was before. If not, I can create another survey URL, so
> that we have results specific to Firefox users and results specific to
> non-Firefox users. 
> 
> Jen, could you let Jon know if he can proceed with a single survey that is
> distributed to both Firefox and non-Firefox users?

Yes please distribute without regard to browser platform.  We don't need results by browser.

Comment 10

[Jonathan Petto [:jpetto]]

Attachment: GitHub PR

Comment 11

[[github robot]]

Commits pushed to master at https://github.com/mozilla/bedrock

https://github.com/mozilla/bedrock/commit/9d6af0347828f8b3be20b070860a082aa9182a74
[fix bug 1283043] Add survey to en-US home page.

https://github.com/mozilla/bedrock/commit/25654f3a97808a97cd6ea97fb4056925ce42d443
Merge pull request #4206 from jpetto/bug-1283043-add-survey-to-homepage

[fix bug 1283043] Add survey to en-US home page.

Comment 12

[Holly Habstritt Gaal [:Habber]]

We have enough responses for this survey. It can now be removed from the homepage.

Comment 13

[[github robot]]

Commits pushed to master at https://github.com/mozilla/bedrock

https://github.com/mozilla/bedrock/commit/f81044e7a5039ced125f5c2eb92fa66b7c2387d7
[fix bug 1283043] Remove survey from homepage.

https://github.com/mozilla/bedrock/commit/13f1a264a0e3a5ffa874810f7e8a798d739cf80a
Merge pull request #4228 from jpetto/bug-1283043-remove-homepage-survey

[fix bug 1283043] Remove survey from homepage.