Open Bug 1434764 Opened 8 years ago Updated 7 years ago

[Fx Growth] - a/b test - video on landing page

Categories

(Websites :: Web Analytics, task)

Product:
Websites
Component:
Web Analytics
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

People

(Reporter: frios, Unassigned)

Details

Attachments

(2 files)

Link to GitHub pull-request: https://github.com/mozilla/bedrock/pull/5443
44 bytes, text/x-github-pull-request
Details | Review
Link to GitHub pull-request: https://github.com/mozilla/bedrock/pull/5483
44 bytes, text/x-github-pull-request
Details | Review
We've seen that landing pages with more information typically perform better than those with minimal detail. We'd like to see if presenting that information in a different format can increase performance further.
@justin @jpetto I listed this as an Optimizely experiment, but given that it's a simple AB test, wonder if this is better done through traffic cop. Would that work for this?
Flags: needinfo?(jon)
Flags: needinfo?(hoosteeno)
Yeah, Traffic Cop should be able to handle this.
Flags: needinfo?(jon)
Eric, Alex built the video template page already, so now we'll need to assemble the experiment in traffic cop so we can deploy. Let's align on timeline.
Flags: needinfo?(erenaud)
per comment in email - Justin is taking on setting up traffic cop. He's working on that today.
Flags: needinfo?(erenaud)
This experiment is ready to launch. :frios will reply in bug whenever the team is ready to send traffic at the waitface page.
Flags: needinfo?(hoosteeno)
(In reply to Justin Crawford [:hoosteeno] [:jcrawford] from comment #8) > This experiment is ready to launch. :frios will reply in bug whenever the > team is ready to send traffic at the waitface page. OK, so the params listed in this experiment won't be on for a while. I like to get this test rolling using a Facebook ad. The new params will be: utm_source=facebook&utm_medium=display Can you help adjust those and then I'll publish the ads?
Flags: needinfo?(hoosteeno)
This test was enabled 3/7 w. Traffic Cop
Summary: Optimizely test: video landing page → [Fx Growth] - a/b test - video on landing page
Justin/Fabio - what are the parameters of this test, as in: how many total users does this need to hit to reach statistical significance (when can we shut it off).
Flags: needinfo?(frios)
(In reply to Eric Renaud from comment #14) > Justin/Fabio - what are the parameters of this test, as in: how many total > users does this need to hit to reach statistical significance (when can we > shut it off). We'll run traffic via Facebook ads to it. It has a set budget, I think we'll exhaust that by EOD Friday. I'm going to the URL, but not seeing the video variation? Here's the link: https://www.mozilla.org/en-US/firefox/new/?xv=waitface&utm_medium=display&utm_source=facebook&utm_campaign=x&utm_content=video-lp
Flags: needinfo?(frios)
Commits pushed to master at https://github.com/mozmeao/www-config https://github.com/mozmeao/www-config/commit/35623464a773a6370059ab43191cdf3d52c33752 [bug 1434764] Followup: Waitface experiment enabled in stage https://github.com/mozmeao/www-config/commit/ac5c8728d3338202a613b7bbc6ad7304770d9cac Merge pull request #79 from hoosteeno/waitface-experiment [bug 1434764] Followup: Waitface experiment enabled in stage
Flags: needinfo?(hoosteeno)
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: