Create Optimizely Test for Funnelcake Distribution to New and Returning Users

RESOLVED WORKSFORME

Status

www.mozilla.org
Analytics
RESOLVED WORKSFORME
2 years ago
2 years ago

People

(Reporter: frios, Unassigned)

Tracking

Production

Firefox Tracking Flags

(Not tracked)

Details

User Story

Test plan: https://mana.mozilla.org/wiki/display/FIREFOX/[bug+1257899+]+Funnelcake+Distribution+for+New+and+Returning+Firefox+Downloads

Optimizely experiment: https://app.optimizely.com/edit?experiment_id=5266132418
(Reporter)

Description

2 years ago
Please create an Optimizely test to distribute funnelcakes from bug 1257899.

These funnelcakes will be distributed to 25% of EN-US web traffic visting the /new page. A control funnel cake will also be used.

Here's a link to the Optimizely test. Please review. https://app.optimizely.com/edit?experiment_id=5266132418

Comment 1

2 years ago
(In reply to Fabio Rios [:frios] from comment #0)
> Please create an Optimizely test to distribute funnelcakes from bug 1257899.
> 
> These funnelcakes will be distributed to 25% of EN-US web traffic visting
> the /new page. A control funnel cake will also be used.
> 
> Here's a link to the Optimizely test. Please review.
> https://app.optimizely.com/edit?experiment_id=5266132418

Test created!

Updated

2 years ago
User Story: (updated)

Comment 2

2 years ago
:jpetto: no major rush since we can't do the funnelcake until Firefox 46. can you review this Optimizely test when you have a chance? I know some feedback you are going to have on it, but I will hold until you review. :-)
Flags: needinfo?(jon)

Comment 3

2 years ago
It looks like you're re-purposing the .os_osx link to be a secondary download button to point to a different Windows build, which I suppose works, but I don't see a Windows only rule in the audience filter. Should probably add that?

Also want to verify that the elements associated with the "Download Button (new/returning user)" goals (<span>'s within the <a> tags) are actually capturing clicks.

Lastly just mentioning that funnelcake URLs aren't set up yet (currently 404'ing).
Flags: needinfo?(jon)

Comment 4

2 years ago
(In reply to Jon Petto [:jpetto] from comment #3)
> It looks like you're re-purposing the .os_osx link to be a secondary
> download button to point to a different Windows build, which I suppose
> works, but I don't see a Windows only rule in the audience filter. Should
> probably add that?
> 
> Also want to verify that the elements associated with the "Download Button
> (new/returning user)" goals (<span>'s within the <a> tags) are actually
> capturing clicks.
> 
> Lastly just mentioning that funnelcake URLs aren't set up yet (currently
> 404'ing).

Good point about targeting only Windows since we are using the osx div. Just added that to the audience.

Yeah, funnelcakes are 404ing since they haven't been created yet. Just want to get the test setup to figure out how we would do it.

> Also want to verify that the elements associated with the "Download Button
> (new/returning user)" goals (<span>'s within the <a> tags) are actually
> capturing clicks.

I did some testing already on the demo server with this and I could see the goals coming through. We'll need to do more functional tests later once the funnelcakes are built.

Thanks!
Status: NEW → RESOLVED
Last Resolved: 2 years ago
Resolution: --- → WORKSFORME
You need to log in before you can comment on or make changes to this bug.