1564152 - (simple-aw) [meta] Simplified about:welcome

Status: RESOLVED FIXED

(Firefox :: Messaging System, task, P3)

Description

[Jim T]

Opening a bug to track ongoing investigation of real and perceived performance for first paint of about:welcome.

• Looks like we're over 1s for first paint on each of our recent variants https://sql.telemetry.mozilla.org/queries/63503#162553 although this data needs further investigation
• UR suggests this is causing confusion and issues for users: https://docs.google.com/presentation/d/1QxCf12uCc2CaAEaMTsGF2erOLxlORBq7UTWyCrYN1HU/edit#slide=id.g5cd9854b1c_0_1333

NanJ, can you look into whether this is a regression from 66 or not?

Comment 1

[Ed Lee :Mardak]

Just to note that the UR recordings were via software running on the user's machine, so those users would probably see a slower experience in general.

Bug 1448918 moved the web welcome experience to about:welcome in Firefox 62, and I believe there was an experiment showing the local page is better for engagement for loading faster, so it would be good to see how performance has changed or not since 62.

Comment 2

[Nan Jiang [:nanj]]

So I've added the 66 release to this chart.

It's quite obvious that 66 release beats all the experiment variants of 67 in terms of topsites first paint time, including the control group. Both its median and upper fence are much better than those 67 variants. I think it's reasonable to conclude that we've introduced some performance overhead to about:welcome with Trailhead.

Comment 3

[Liz Henry (:lizzard) (relman/hg->git project)]

Kate ar we still aiming to investigate and potentially improve first paint time, for 70?

Comment 4

[Liz Henry (:lizzard) (relman/hg->git project)]

After talking with Kate, looks like this is P2 (not aimed for 70 at this point.)

Comment 5

[Punam Dahiya [:pdahiya]]

Attachment: Technical Plan for simplified about:welcome page

Comment 6

[Punam Dahiya [:pdahiya]]

With feature complete and all dependent bug resolved, its safe to close tracking bug