1258788 - Create Optimizely Test for Funnelcake Distribution to New and Returning Users

Status: RESOLVED WORKSFORME

(www.mozilla.org :: Analytics, defect)

Description

[Fabio Rios [:frios]]

Please create an Optimizely test to distribute funnelcakes from bug 1257899.

These funnelcakes will be distributed to 25% of EN-US web traffic visting the /new page. A control funnel cake will also be used.

Here's a link to the Optimizely test. Please review. https://app.optimizely.com/edit?experiment_id=5266132418

Comment 1

[Chris More [:cmore]]

(In reply to Fabio Rios [:frios] from comment #0)
> Please create an Optimizely test to distribute funnelcakes from bug 1257899.
> 
> These funnelcakes will be distributed to 25% of EN-US web traffic visting
> the /new page. A control funnel cake will also be used.
> 
> Here's a link to the Optimizely test. Please review.
> https://app.optimizely.com/edit?experiment_id=5266132418

Test created!

Comment 2

[Chris More [:cmore]]

:jpetto: no major rush since we can't do the funnelcake until Firefox 46. can you review this Optimizely test when you have a chance? I know some feedback you are going to have on it, but I will hold until you review. :-)

Comment 3

[Jonathan Petto [:jpetto]]

It looks like you're re-purposing the .os_osx link to be a secondary download button to point to a different Windows build, which I suppose works, but I don't see a Windows only rule in the audience filter. Should probably add that?

Also want to verify that the elements associated with the "Download Button (new/returning user)" goals (<span>'s within the <a> tags) are actually capturing clicks.

Lastly just mentioning that funnelcake URLs aren't set up yet (currently 404'ing).

Comment 4

[Chris More [:cmore]]

(In reply to Jon Petto [:jpetto] from comment #3)
> It looks like you're re-purposing the .os_osx link to be a secondary
> download button to point to a different Windows build, which I suppose
> works, but I don't see a Windows only rule in the audience filter. Should
> probably add that?
> 
> Also want to verify that the elements associated with the "Download Button
> (new/returning user)" goals (<span>'s within the <a> tags) are actually
> capturing clicks.
> 
> Lastly just mentioning that funnelcake URLs aren't set up yet (currently
> 404'ing).

Good point about targeting only Windows since we are using the osx div. Just added that to the audience.

Yeah, funnelcakes are 404ing since they haven't been created yet. Just want to get the test setup to figure out how we would do it.

> Also want to verify that the elements associated with the "Download Button
> (new/returning user)" goals (<span>'s within the <a> tags) are actually
> capturing clicks.

I did some testing already on the demo server with this and I could see the goals coming through. We'll need to do more functional tests later once the funnelcakes are built.

Thanks!