[meta] Firefox onboarding v2.0 experience for Feb 2017 funnelcake

NEW
Unassigned

Status

()

Firefox
General
8 months ago
5 months ago

People

(Reporter: Gijs, Unassigned)

Tracking

({meta})

Firefox Tracking Flags

(Not tracked)

Details

User Story

Funnelcake test plan with details: https://docs.google.com/document/d/1Kle7LlVQ_gCJ2IFpQOSg7XVDtrXGNYGPacKIaYO1i9A/edit
Comment hidden (empty)
(Reporter)

Updated

8 months ago
Summary: [meta] Firefox onboarding experience for Jan 2017 funnelcake → [meta] Firefox onboarding experience for Feb 2017 funnelcake
(Reporter)

Updated

8 months ago
Depends on: 1322719
(Reporter)

Updated

8 months ago
Depends on: 1322720
(Reporter)

Updated

8 months ago
Depends on: 1322723
(Reporter)

Updated

8 months ago
Depends on: 1322726
(Reporter)

Updated

8 months ago
Depends on: 1322730
(Reporter)

Updated

8 months ago
Depends on: 1322731
(Reporter)

Updated

8 months ago
Depends on: 1322737
(Reporter)

Updated

8 months ago
Depends on: 1322738

Updated

8 months ago
Depends on: 1324049
A bit of context, for people about to see this bug... ;)

We've been asked to run a funnelcake ASAP to test some changes to the first-run onboarding experience, with the ultimate aim to improve new user retention over the first few weeks of usage. The next funnelcake opportunity will be based on the Firefox 51 release on 1/24, so we're keeping the scope of this work as tight as possible due to the short schedule and need for late beta uplifts.

The general work we're testing involves streamlining the first-run experience, so that users can more quickly see and use their data. In a nutshell: (see deps for details)

 * Enable the existing automigration work, to avoid the "import data from another browser" wizard.
 * Remove/defer the distracting default browser prompt and data choices prompt
 * Show users about:newtab instead of about:home, so they will see either
   A) New default tiles that are more useful
   B) Their top sites that were automigrated from another browser
 * Start shifting the visual design of about:newtab towards what Activity Stream will look like

Updated

8 months ago
Depends on: 1326252

Updated

8 months ago
Depends on: 1328445
Blocks: 1285577

Updated

7 months ago
Depends on: 1329941

Updated

7 months ago
Depends on: 1330384

Updated

7 months ago
Depends on: 1330611
Ryan, I know the SV team is already on this bug, but wasn't sure to what degree you were looped in, so I wanted to bring it to your attention that we'll be needing a QA round on the funnelcake(s) starting at the end of January.
Flags: needinfo?(ryanvm)
Flags: needinfo?(ryanvm) → needinfo?(rares.bologa)

Comment 3

7 months ago
(In reply to Peter Dolanjski [:pdol] from comment #2)
> Ryan, I know the SV team is already on this bug, but wasn't sure to what
> degree you were looped in, so I wanted to bring it to your attention that
> we'll be needing a QA round on the funnelcake(s) starting at the end of
> January.

Peter, our QA Engineers from Las Vegas will help with this request. Thanks for the heads-up.

Updated

7 months ago
Flags: needinfo?(rares.bologa) → needinfo?(gwimberly)
Hi Peter, 

We are already working on a round of testing for this iteration of Funnelcake and should have a preliminary sign-off ready by the end of the week.
Flags: needinfo?(gwimberly)
Depends on: 1331800
(Reporter)

Updated

7 months ago
Depends on: 1331888

Updated

7 months ago
Summary: [meta] Firefox onboarding experience for Feb 2017 funnelcake → [meta] Firefox onboarding v2.0 experience for Feb 2017 funnelcake

Updated

7 months ago
Depends on: 1332130

Comment 5

7 months ago
Adding details of the Funnelcake test plan in the user story field. Please note we now consider 2 test builds with 1 control. All details are in the Google doc: https://docs.google.com/document/d/1Kle7LlVQ_gCJ2IFpQOSg7XVDtrXGNYGPacKIaYO1i9A/edit
User Story: (updated)

Comment 6

7 months ago
(In reply to Grover Wimberly IV [:Grover-QA] from comment #4)
> Hi Peter, 
> 
> We are already working on a round of testing for this iteration of
> Funnelcake and should have a preliminary sign-off ready by the end of the
> week.

Hi Grover, can you update us on that? Per the doc I linked to in my comment above we will have 2 test builds with 1 control - both test builds include the streamlined stub installer.
Do you have test plans you can share? Let us know if we need to meet to discuss the experience. I'd particularly like to check that the stub ping data is right and that the attribution field allows segmenting cohorts for reports.
Hi Romain,

This might be a bit different than what we were running tests on last week. Our tests currently cover primarily automigration. (See below)

https://docs.google.com/spreadsheets/d/1q0Z_dKADg2P9R9f5A45EjF_o1M-UKNrpiHuSGjxrnZY/edit#gid=0

This is the degree we've been involved in so far. We can meet to discuss the new features of Funnelcake mentioned in Comment 5 and Comment 6. Let me know what time is best for you.
Flags: needinfo?(rtestard)

Comment 8

7 months ago
OK, let's meet, I'll follow by e-mail to schedule something.
Flags: needinfo?(rtestard)

Updated

7 months ago
Depends on: 1333410

Updated

7 months ago
Depends on: 1333435
Depends on: 1333533
Depends on: 1333873
Depends on: 1336631

Updated

6 months ago
Depends on: 1336969
Hey Grover, how are we looking on QA?
Flags: needinfo?(gwimberly)
Hi Nicole, an email was sent yesterday and I believe Romain has you CC'd on the preliminary sign-off. Once I get the go-ahead, I will send the sign-off report.
Flags: needinfo?(gwimberly) → needinfo?(nyee)

Updated

6 months ago
Flags: needinfo?(nyee)

Comment 11

6 months ago
Experiment started on 2/7/2017 @ 6:05pm PST.
Depends on: 1344200
You need to log in before you can comment on or make changes to this bug.