Last Comment Bug 1322718 - [meta] Firefox onboarding v2.0 experience for Feb 2017 funnelcake
: [meta] Firefox onboarding v2.0 experience for Feb 2017 funnelcake
Status: NEW
: meta
Product: Firefox
Classification: Client Software
Component: General (show other bugs)
: unspecified
: Unspecified Unspecified
-- normal with 1 vote (vote)
: ---
Assigned To: Nobody; OK to take it and work on it
:
:
Mentors:
Depends on: 1333533 1322719 1322720 1322723 1322726 1322730 1322731 1322737 1322738 1324049 1326252 1328445 1329941 1330384 1330611 1331800 1331888 1332130 1333410 1333435 1333873 1336631 1336969
Blocks: 1285577
  Show dependency treegraph
 
Reported: 2016-12-09 11:51 PST by :Gijs
Modified: 2017-02-11 10:35 PST (History)
18 users (show)
See Also:
Crash Signature:
(edit)
QA Whiteboard:
Iteration: ---
Points: ---
Has Regression Range: ---
Has STR: ---


Attachments

User Story
Funnelcake test plan with details: https://docs.google.com/document/d/1Kle7LlVQ_gCJ2IFpQOSg7XVDtrXGNYGPacKIaYO1i9A/edit      
Description User image :Gijs 2016-12-09 11:51:26 PST

    
Comment 1 User image Justin Dolske [:Dolske] 2016-12-28 16:42:26 PST
A bit of context, for people about to see this bug... ;)

We've been asked to run a funnelcake ASAP to test some changes to the first-run onboarding experience, with the ultimate aim to improve new user retention over the first few weeks of usage. The next funnelcake opportunity will be based on the Firefox 51 release on 1/24, so we're keeping the scope of this work as tight as possible due to the short schedule and need for late beta uplifts.

The general work we're testing involves streamlining the first-run experience, so that users can more quickly see and use their data. In a nutshell: (see deps for details)

 * Enable the existing automigration work, to avoid the "import data from another browser" wizard.
 * Remove/defer the distracting default browser prompt and data choices prompt
 * Show users about:newtab instead of about:home, so they will see either
   A) New default tiles that are more useful
   B) Their top sites that were automigrated from another browser
 * Start shifting the visual design of about:newtab towards what Activity Stream will look like
Comment 2 User image Peter Dolanjski [:pdol] 2017-01-16 06:46:39 PST
Ryan, I know the SV team is already on this bug, but wasn't sure to what degree you were looped in, so I wanted to bring it to your attention that we'll be needing a QA round on the funnelcake(s) starting at the end of January.
Comment 3 User image RaresB 2017-01-17 04:54:34 PST
(In reply to Peter Dolanjski [:pdol] from comment #2)
> Ryan, I know the SV team is already on this bug, but wasn't sure to what
> degree you were looped in, so I wanted to bring it to your attention that
> we'll be needing a QA round on the funnelcake(s) starting at the end of
> January.

Peter, our QA Engineers from Las Vegas will help with this request. Thanks for the heads-up.
Comment 4 User image Grover Wimberly IV [:Grover-QA] 2017-01-17 08:26:41 PST
Hi Peter, 

We are already working on a round of testing for this iteration of Funnelcake and should have a preliminary sign-off ready by the end of the week.
Comment 5 User image Romain Testard [:RT] 2017-01-19 07:40:57 PST
Adding details of the Funnelcake test plan in the user story field. Please note we now consider 2 test builds with 1 control. All details are in the Google doc: https://docs.google.com/document/d/1Kle7LlVQ_gCJ2IFpQOSg7XVDtrXGNYGPacKIaYO1i9A/edit
Comment 6 User image Romain Testard [:RT] 2017-01-20 05:11:04 PST
(In reply to Grover Wimberly IV [:Grover-QA] from comment #4)
> Hi Peter, 
> 
> We are already working on a round of testing for this iteration of
> Funnelcake and should have a preliminary sign-off ready by the end of the
> week.

Hi Grover, can you update us on that? Per the doc I linked to in my comment above we will have 2 test builds with 1 control - both test builds include the streamlined stub installer.
Do you have test plans you can share? Let us know if we need to meet to discuss the experience. I'd particularly like to check that the stub ping data is right and that the attribution field allows segmenting cohorts for reports.
Comment 7 User image Grover Wimberly IV [:Grover-QA] 2017-01-23 08:17:25 PST
Hi Romain,

This might be a bit different than what we were running tests on last week. Our tests currently cover primarily automigration. (See below)

https://docs.google.com/spreadsheets/d/1q0Z_dKADg2P9R9f5A45EjF_o1M-UKNrpiHuSGjxrnZY/edit#gid=0

This is the degree we've been involved in so far. We can meet to discuss the new features of Funnelcake mentioned in Comment 5 and Comment 6. Let me know what time is best for you.
Comment 8 User image Romain Testard [:RT] 2017-01-23 08:25:58 PST
OK, let's meet, I'll follow by e-mail to schedule something.
Comment 9 User image Nicole Yee (:nicoleyee) 2017-02-06 17:01:11 PST
Hey Grover, how are we looking on QA?
Comment 10 User image Grover Wimberly IV [:Grover-QA] 2017-02-07 08:03:26 PST
Hi Nicole, an email was sent yesterday and I believe Romain has you CC'd on the preliminary sign-off. Once I get the go-ahead, I will send the sign-off report.
Comment 11 User image Chris More [:cmore] 2017-02-07 18:23:33 PST
Experiment started on 2/7/2017 @ 6:05pm PST.

Note You need to log in before you can comment on or make changes to this bug.