1848128 - [Experiment] The "Embedded Import" Onboarding screen from the "Treatment A" branch of the "Embedded Import Wizard Experiment in Fx116" experiment has the same UI as the one from the "Treatment B" branch

Status: VERIFIED FIXED

(Firefox :: Messaging System, defect)

Description

[Marius Coman [:mcoman], Ecosystem QA]

Attachment: rec of the issue.gif

[Affected versions]:

• Firefox Release 116.0.2 - Build ID: 20230805021307

[Affected Platforms]:

• Windows 10 x64

[Prerequisites]:

• Have a new Firefox profile with the nimbus.debug pref set to true in the "about:config" page.
• Firefox is pinned to the taskbar.

[Steps to reproduce]:

1. Open the browser with the profile from the prerequisites.
2. Navigate to "about:studies?optin_slug=embedded-import-wizard-fx116&optin_branch=treatment-a&optin_collection=nimbus-preview".
3. Navigate to the "about:welcome" page and go to the "Embedded Import" screen.
4. Observe the screen's UI.

[Expected result]:

• Variant 1 of the "Embedded Import" screen is displayed for the "Treatment A" branch.

[Actual result]:

• Variant 2 (show all) of the "Embedded Import" screen is displayed instead.

[Additional Notes]:

• The "Embedded Import" Onboarding screen from the "Treatment B" branch has the correct UI.
• Attached is a screen recording of the issue:

Comment 1

[Mimi Jung]

Sorry about that! In treatment-a I set the checkbox action to:

"name": "browser.migrate.content-modal.import-all.enabled",

And did not pass a value key as we usually do that to reset the value to it's original state, but with 116 the default value is "true" so the pref was returning true and setting the wrong layout for treatment a.

This should be resolved with passing in "value": false. I've updated the recipe to reflect this - thanks for looking into this with me, I appreciate it!

Comment 2

[Marius Coman [:mcoman], Ecosystem QA]

I have verified that this issue is no longer reproducible using the latest Firefox Release 116.0.2 (Build ID: 20230805021307) installed on Windows 10. I can confirm that the "Embedded Import" screen from the "Treatment A" branch of the experiment has the correct UI.

Based on the above testing I am closing the issue as Resolved - Fixed.