1329642 - A/B test Rust video embed at top of Web Innovations page

Status: REOPENED

(www.mozilla.org :: Pages & Content, defect)

Description

[Alex Gibson [:agibson]]

In Bug 1320666 we added a Rust video embed via YouTube to the Rust section on the Web Innovations page. We'd like to A/B test embedding this video at the top of the page to test engagement.

Comment 1

[Alex Gibson [:agibson]]

Attachment: GitHub pull request

Placeholder branch for the A/B test - waiting on final copy / design direction.

Comment 2

[Michael Ham]

Prototypes with hotspots here:
https://invis.io/DWA17SCSV

Sketch file and associated assets here:
https://drive.google.com/drive/folders/0Bw8GuIJD9hBMR1VNY1VzX0diN0U?usp=sharing

PNGs:
https://drive.google.com/drive/folders/0Bw8GuIJD9hBMcld1NFBiMmEtdW8?usp=sharing

Final review with Yulia today, 01/17/17 for ultimate design direction.

Comment 3

[Michael Ham]

Alex – attaching PNGs of the final design for you and I to review. Couple of different ways to deploy based on these mock ups. Elements as PNGs with transparencies or as composited images for mobile and wide viewports. Happy to discuss further after you've had a chance to look at the mock ups.

Comment 4

[Michael Ham]

Attachment: Rust Video Intro Desktop HD v04b.png

Comment 5

[Michael Ham]

Attachment: Rust Video Intro Mobile Portrait v04b.png

Comment 6

[Alex Gibson [:agibson]]

(In reply to Michael Ham from comment #3)
> Alex – attaching PNGs of the final design for you and I to review. Couple of
> different ways to deploy based on these mock ups. Elements as PNGs with
> transparencies or as composited images for mobile and wide viewports. Happy
> to discuss further after you've had a chance to look at the mock ups.

Hi Michael,

Sorry it took so long for me to get to these - I think using elements as PNGs with transparencies will work best for a responsive overlay. If you could attach those here, I'll put something up on a demo and we'll see how it looks?

I can probably pick this bug up tomorrow.

Comment 7

[Michael Ham]

Final assets for Rust video header:
https://drive.google.com/drive/folders/0Bw8GuIJD9hBMbzc4c1hlVm5WRHM?usp=sharing

Sketch File (refer to artboards labeled as "FINAL"):
https://drive.google.com/a/mozilla.com/file/d/0Bw8GuIJD9hBMa3FGQVFjdllrb3M/view?usp=sharing

Comment 8

[Craig Cook (:craigcook)]

Attachment: Github pull request https://github.com/mozilla/bedrock/pull/4645

Comment 9

[[github robot]]

Commits pushed to master at https://github.com/mozilla/bedrock

https://github.com/mozilla/bedrock/commit/7bad071e138d33256e17e9bef85b47e6edb6937e
[fix bug 1329642] A/B test Rust video embed at top of Web Innovations page

https://github.com/mozilla/bedrock/commit/8a438b6dfec4ac534f3def8eb4d072c58e009b6f
Merge pull request #4645 from craigcook/bug-1329642-rust-video-technology-test

[fix bug 1329642] A/B test Rust video embed at top of Web Innovations page

Comment 10

[Jonathan Petto [:jpetto]]

Just checking to see if this experiment should still be running after 5 months...

Comment 11

[Alex Gibson [:agibson]]

After 5 months it feels like we should probably just remove the experiment code here and leave the default as-is? I'm not sure what the winner / outcome was, but seeing as we're now discussing the future of this page it feels rather moot either way?

Comment 12

[Jonathan Petto [:jpetto]]

(In reply to Alex Gibson [:agibson] from comment #11)
> After 5 months it feels like we should probably just remove the experiment
> code here and leave the default as-is? I'm not sure what the winner /
> outcome was, but seeing as we're now discussing the future of this page it
> feels rather moot either way?

For whatever weight it carries, I agree with the above. We can make changes later based on the data if we need to.

Comment 13

[Craig Cook (:craigcook)]

PR to remove it: https://github.com/mozilla/bedrock/pull/5048

Comment 14

[Eric Renaud [:erenaud]]

per conversation in Slack:

Version B was the clear winner w. greater interaction with the Rust video. However, that video is in English.

The action requested here is to:  show the '?v=b' version to en-US only, and the '?v=a' version to all other locales.

Comment 15

[Craig Cook (:craigcook)]

Attachment: Github pull request https://github.com/mozilla/bedrock/pull/5051

This PR makes the Rust header permanent for English locales. Others continue getting the original text header.

Comment 16

[[github robot]]

Commits pushed to master at https://github.com/mozilla/bedrock

https://github.com/mozilla/bedrock/commit/1cfaa27bee84587338f1ba53411cedf812ed74c2
[bug 1329642] Technology page, make Rust header permanent for English

https://github.com/mozilla/bedrock/commit/2b54de07e31bb8a9aed31a7591a204b7ddc03f4d
Merge pull request #5051 from craigcook/bug-1329642-technology-rust-video

[bug 1329642] Technology page, make Rust header permanent for English