A/B test Rust video embed at top of Web Innovations page

REOPENED
Assigned to

Status

www.mozilla.org
Pages & Content
REOPENED
a year ago
8 months ago

People

(Reporter: agibson, Assigned: craigcook)

Tracking

Production

Firefox Tracking Flags

(Not tracked)

Details

(URL)

Attachments

(4 attachments, 1 obsolete attachment)

(Reporter)

Description

a year ago
In Bug 1320666 we added a Rust video embed via YouTube to the Rust section on the Web Innovations page. We'd like to A/B test embedding this video at the top of the page to test engagement.
(Reporter)

Updated

a year ago
Assignee: nobody → agibson
Status: NEW → ASSIGNED
(Reporter)

Comment 1

a year ago
Created attachment 8825050 [details] [review]
GitHub pull request

Placeholder branch for the A/B test - waiting on final copy / design direction.

Comment 2

a year ago
Prototypes with hotspots here:
https://invis.io/DWA17SCSV

Sketch file and associated assets here:
https://drive.google.com/drive/folders/0Bw8GuIJD9hBMR1VNY1VzX0diN0U?usp=sharing

PNGs:
https://drive.google.com/drive/folders/0Bw8GuIJD9hBMcld1NFBiMmEtdW8?usp=sharing

Final review with Yulia today, 01/17/17 for ultimate design direction.

Comment 3

a year ago
Alex – attaching PNGs of the final design for you and I to review. Couple of different ways to deploy based on these mock ups. Elements as PNGs with transparencies or as composited images for mobile and wide viewports. Happy to discuss further after you've had a chance to look at the mock ups.
Flags: needinfo?(agibson)

Comment 4

a year ago
Created attachment 8828532 [details]
Rust Video Intro Desktop HD v04b.png

Comment 5

a year ago
Created attachment 8828534 [details]
Rust Video Intro Mobile Portrait v04b.png
(Reporter)

Comment 6

a year ago
(In reply to Michael Ham from comment #3)
> Alex – attaching PNGs of the final design for you and I to review. Couple of
> different ways to deploy based on these mock ups. Elements as PNGs with
> transparencies or as composited images for mobile and wide viewports. Happy
> to discuss further after you've had a chance to look at the mock ups.

Hi Michael,

Sorry it took so long for me to get to these - I think using elements as PNGs with transparencies will work best for a responsive overlay. If you could attach those here, I'll put something up on a demo and we'll see how it looks?

I can probably pick this bug up tomorrow.
Flags: needinfo?(agibson)
(Reporter)

Updated

a year ago
Assignee: agibson → craigcook.bugz
(Assignee)

Comment 8

a year ago
Created attachment 8834711 [details] [review]
Github pull request https://github.com/mozilla/bedrock/pull/4645
Attachment #8825050 - Attachment is obsolete: true

Comment 9

a year ago
Commits pushed to master at https://github.com/mozilla/bedrock

https://github.com/mozilla/bedrock/commit/7bad071e138d33256e17e9bef85b47e6edb6937e
[fix bug 1329642] A/B test Rust video embed at top of Web Innovations page

https://github.com/mozilla/bedrock/commit/8a438b6dfec4ac534f3def8eb4d072c58e009b6f
Merge pull request #4645 from craigcook/bug-1329642-rust-video-technology-test

[fix bug 1329642] A/B test Rust video embed at top of Web Innovations page

Updated

a year ago
Status: ASSIGNED → RESOLVED
Last Resolved: a year ago
Resolution: --- → FIXED

Comment 10

9 months ago
Just checking to see if this experiment should still be running after 5 months...
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
(Reporter)

Comment 11

9 months ago
After 5 months it feels like we should probably just remove the experiment code here and leave the default as-is? I'm not sure what the winner / outcome was, but seeing as we're now discussing the future of this page it feels rather moot either way?

Comment 12

9 months ago
(In reply to Alex Gibson [:agibson] from comment #11)
> After 5 months it feels like we should probably just remove the experiment
> code here and leave the default as-is? I'm not sure what the winner /
> outcome was, but seeing as we're now discussing the future of this page it
> feels rather moot either way?

For whatever weight it carries, I agree with the above. We can make changes later based on the data if we need to.
per conversation in Slack:

Version B was the clear winner w. greater interaction with the Rust video. However, that video is in English.

The action requested here is to:  show the '?v=b' version to en-US only, and the '?v=a' version to all other locales.
Flags: needinfo?(craigcook.bugz)
(Assignee)

Comment 15

8 months ago
Created attachment 8897484 [details] [review]
Github pull request https://github.com/mozilla/bedrock/pull/5051

This PR makes the Rust header permanent for English locales. Others continue getting the original text header.
Flags: needinfo?(craigcook.bugz)

Comment 16

8 months ago
Commits pushed to master at https://github.com/mozilla/bedrock

https://github.com/mozilla/bedrock/commit/1cfaa27bee84587338f1ba53411cedf812ed74c2
[bug 1329642] Technology page, make Rust header permanent for English

https://github.com/mozilla/bedrock/commit/2b54de07e31bb8a9aed31a7591a204b7ddc03f4d
Merge pull request #5051 from craigcook/bug-1329642-technology-rust-video

[bug 1329642] Technology page, make Rust header permanent for English
You need to log in before you can comment on or make changes to this bug.