1770396 - [Experiment] The "Import" ECO spotlight is not displayed on Firefox profiles with the default number of bookmarks

Status: VERIFIED FIXED

(Firefox :: Messaging System, defect, P1)

Description

[Marius Coman [:mcoman], Ecosystem QA]

Attachment: rec of the issue.gif

[Affected versions]:

• Firefox Release 100.0.1 - Build ID: 20220513165813

[Affected Platforms]:

• Windows 10 x64
• macOS 11.6.2

[Prerequisites]:

• Have a new Firefox profile created.
• Have the "nimbus.debug" pref set to true in the "about:config" page.
• Have another browser (e.g. Chrome) with multiple bookmarks saved.

[Steps to reproduce]:

1. Open the Firefox profile from the prerequisites.
2. Navigate to the "about:studies?optin_slug=import-infrequent-eco2204-en&optin_branch=treatment-a&optin_collection=nimbus-preview" URL.
3. Restart the browser and observe the behavior.
4. Go to the browser's "File" menu and select the "Import From Another Browser..." option.
5. Complete the import flow and restart the browser.
6. Observe the behavior.

[Expected result]:
Step 3: The "Import" ECO spotlight is displayed.

Step 6: The "Import" ECO spotlight is NOT displayed.

[Actual result]:
Step 3: The "Import" ECO spotlight is NOT displayed.

Step 6: The "Import" ECO spotlight is wrongly displayed after an import bookmarks action was performed.

[Notes]:

• According to the experiment's mana page the "Import" ECO should be displayed only if users have the default number of bookmarks in Firefox (5 bookmarks).
• We observed in the message targeting the totalBookmarksCount > 5 filter and according to this, we will trigger the spotlight only if more than 5 bookmarks are saved.
• Attached a screen recording of the issue.

@Dan, could you please take a look over this?

Comment 1

[Dan Mosedale (:dmosedale, :dmose)]

https://github.com/mozilla/experimenter/pull/7299 will allow us to fix this bug.

Comment 2

[Dan Mosedale (:dmosedale, :dmose)]

Waiting for targeting to land in experimenter. Additionally, this is lower prio than the May Multiplier experiments.

Comment 3

[Dan Mosedale (:dmosedale, :dmose)]

A new targeting patch has been submitted to experimenter. Once that lands/deploys, I'll update the experiment itself.

Comment 4

[Dan Mosedale (:dmosedale, :dmose)]

The targeting has been updated in the experiment; if you could please re-test, that would be wonderful.

Comment 5

[Marius Coman [:mcoman], Ecosystem QA]

This issue was part of the work done on the [QA-1500] which was signed off as GREEN. Considering this I am marking this issue as Verified.