900747 - Randomly show a survey instead of snippet in Firefox 23 (at a 1% rate)

Status: RESOLVED FIXED

(Snippets Graveyard :: Surveys, task)

Description

[[:Cww]]

This time with lots more notice:

It's that time of the Firefox cycle again. And this time I mean 23 as in release.

This is like Bug #856832, we'd like to run a link to a survey in snippets at a 1% rate.


Image:
https://lh3.googleusercontent.com/-hThJcbmHuM4/T6BIBQ6NcvI/AAAAAAAAADA/tzdv76rHKwo/s40/talkbubbles_transparent.png
 
Copy / Link:
Please help us make Firefox better! Tell us what you think in this 3 minute survey.

Link:

http://www.surveygizmo.com/s3/1323475/Firefox-User-Feedback-Survey-August-2013-release

We'd like to run it starting **August 12th** for a week.  Please let me know before hitting go so I can take the survey off testing mode.

Thanks.

Comment 1

[Jean Collings]

I can set up the snippet with copy/logo/link (set to go live on Aug. 12th) but will let you know before I hit go. 

Mike you're going to have to let me know what I need to do about the 1% rate. 

Thanks,
Jean

Comment 2

[Osmose [:osmose, :mkelly]]

jcollings: I've added a new template for handling the release surveys called "Firefox Survey 1% Rate + Mailing List". It shows a snippet for signing up for the Firefox mailing list, but 3% of the time, it shows the survey snippet. Given that this snippet will probably go out with around 1-3 other snippets, it averages out to roughly being seen 1% of the time.

It already has the right icons and copy, so it should be good. Note that the preview for this snippet will probably show the mailing list signup, but it uses the exact same code as the older survey snippets, so it should work fine.

https://snippets.mozilla.com/admin/base/snippet/4084/ is the snippet I made. You just give it the survey URL and it should be good. The only caveat is that you must only have a single survey snippet out at any given time; having more than one out will cause issues.

This should allow you to create these snippets without needed any developer help in the future. Let me know if you need any more help!

Comment 3

[[:Cww]]

Would it be possible to use this to run different surveys on beta & release?

Comment 4

[Osmose [:osmose, :mkelly]]

If you're okay with using the same messaging and Jean is okay with adding an extra snippet to the rotation for those channels, yes. If you need different messaging, we'll need to create another template, but it's also possible.

Comment 5

[Jean Collings]

Cheng, let me know when you're ready for me to turn on the snippet. Thanks.

Comment 6

[Jean Collings]

Hi Mike,

Cheng and I discussed that it's best to create two different templates for beta vs. release. As for beta it's because we would need to have the survey shown more since the number of beta users are lower than release users. However, if you don't have time to build a template for the beta, I wouldn't worry too much about it since we can use just a regular simple snippet template. 

Jean

Comment 7

[Osmose [:osmose, :mkelly]]

I've created a template that shows the survey 25% of the time users see the snippet instead of the 3% that the existing one uses. The same warnings of showing more than one of this type of snippet to a user at a time apply, but you should be able to use it on Beta to get a larger percentage of users.

Considering that we don't normally run snippets to Beta users, if this is the only snippet they're seeing then it will show to 25% of Beta users. Let me know if you need the number adjusted, although keep in mind these numbers are ballpark figures since the percentage changes when more than one snippet is in rotation.

Comment 8

[Jean Collings]

Mike,
Wanted to double check with you with your statement that we cannot run more than a single survey at a time. Is that for all channels or per channel? For instance can I have a survey running on the Firefox release channel and a different survey running on the beta channel at the same time?

Thanks,
Jean

Comment 9

[Osmose [:osmose, :mkelly]]

(In reply to jcollings from comment #8)
> can I have a survey running on the Firefox release channel and a
> different survey running on the beta channel at the same time?

You can, as long as each is separate. No more than one survey going to a user at a time is the real rule.

Comment 10

[Osmose [:osmose, :mkelly]]

Calling this fixed, we ran the survey for this particular release and added a template, seems like we did fine. :D