1798386 - launch Import Bookmarks 0-6 Days Experiment in 107 release

Status: RESOLVED FIXED

(Firefox :: Messaging System, task, P1)

Description

[Dan Mosedale (:dmosedale, :dmose)]

We'd like to launch this experiment on the week of November 15th, 2022.

Comment 1

[Dan Mosedale (:dmosedale, :dmose)]

Setting to 109.1, as that's the timeframe for the launch (which is actually scheduled for the first week of 107 release).

Comment 2

[Dan Mosedale (:dmosedale, :dmose)]

QA has found an issue that causes the Spotlight to sometimes show only after 30-90 seconds. The debugging so far makes me think that what we suspected, that it was caused by bug 1797423 is very likely to be the case. However, since that bug only seems to be regularly reproducible with a new profile, and before that profile has done its initial fetch from Remote Settings, we may be OK for this experiment because we're only targetting profiles that are older than 28 days (meaning they're pretty likely to have done an initial featch from Remote Settings at some point in the past).

Simona, instead of testing by simulating that profiles are older than 28 days (eg by tweaking times.json), could you, for each platform test this on an actual old profile that has beeen used somewhat? You'll probably want to backup the profile before testing, so that it's possible to repeat the test.

Comment 3

[Simona Rosu [:srosu], Ecosystem QA]

After further investigations, I can confirm that this issue does not affect the experiment as long as it targets existing users with an older profile than 28 days.
I tested this in 3 ways:

A. Enrolling in the Treatment Branch of the experiment and or the rollout in a naturally aged profile.

• When I opened a naturally aged profile and navigated to the “Firefox View” tab, the Firefox View spotlight appeared instantly.
• After that, I set up my profile for enrolling in the experiment and rollout, restarted the browser, and the Import Spotlight appeared instantly as well.

B. Enrolling in the Treatment Branch of the experiment and or the rollout after waiting 1 minute without doing anything.

• When I opened a new Firefox profile and waited 1 minute without doing anything in the browser, I navigated to the Firefox View tab, and its spotlight appeared instantly.
• After that, I aged my profile and set it up for enrolling in the experiment and rollout, restarted the browser, and the Import Spotlight appeared instantly.

C. Enrolling in the Treatment Branch of the experiment and or the rollout after an initial fetch from Remote Settings.

• When I opened a new Firefox profile and navigated to the Firefox View tab, I waited 1 minute for its spotlight to appear.
• After that, I aged my profile and set it up for enrolling in the experiment and rollout, restarted the browser, and the Import Spotlight appeared instantly.

Comment 4

[Dan Mosedale (:dmosedale, :dmose)]

Thanks so much, Simona!