1806097 - [Experiment] A validation error is displayed in the "Browser Console" when trying to enroll in the "Device migration - Existing users ECO2212 EN" experiment on Firefox 100 to 104 versions

Status: VERIFIED FIXED

(Firefox :: Messaging System, defect)

Description

[Marius Coman [:mcoman], Ecosystem QA]

Attachment: rec of the issue.gif

[Notes]:

• The following error is displayed in the "Browser Console":
  Experiment device-migration-existing-users-eco2212-en branch 0 feature spotlight does not validate: [ { "instanceLocation": "#", "keyword": "required", "keywordLocation": "#/required", "error": "Instance does not have required property \"groups\"." } ] .

[Affected versions]:

• Firefox Release 100.0.2 - Build ID: 20220519220738
• Firefox Release 101.0.1 - Build ID: 20220608170832
• Firefox Release 102.0.1 - Build ID: 20220705093820
• Firefox Release 103.0.2 - Build ID: 20220808125904

[Affected Platforms]:

• Windows 7 x64
• Windows 10 x64
• Windows 11 x64

[Prerequisites]:

• Have a Firefox en-* locale installed.
• Have a Firefox profile older than 28 days.
• Have the "user.js" file saved to disk.

[Steps to reproduce]:

1. Navigate to the profile folder from prerequisites and paste the "user.js" file.
2. Open the browser using the profile from the prerequisites.
3. Navigate to the "about:studies" page and observe the listed experiments.

[Expected result]:

• The "Device migration - Existing users ECO2212 EN" experiment is displayed.

[Actual result]:

• The "Device migration - Existing users ECO2212 EN" experiment is NOT displayed.

[Additional Notes]:

• This issue is no longer reproducible on Firefox 104 and above versions.
• Attached is a screen recording of the issue:

Comment 1

[Meg Viar [:mviar]]

@mcoman thanks for catching this. I've updated the recipe to include an empty array for groups which should resolve this issue. FYI the update can take up to an hour to take effect in the preview. Let me know if that doesn't resolve the issue.

Comment 2

[Marius Coman [:mcoman], Ecosystem QA]

Hi, Meg! I have retested this issue using Firefox Release 100.0.2 (Build ID: 20220519220738). I can confirm that the validation error is no longer displayed and we can successfully enroll in the experiment on Windows 10 x64, and Windows 11 x64.

However, on Windows 7 we are still blocked by Bug 1806083 from enrolling in the experiment.

Comment 3

[Meg Viar [:mviar]]

The issue was that on versions 100-104 a "group" attribute was required in the multistage Spotlight message configuration. I've updated the recipe to have that attribute with a value of an empty array.

Comment 4

[Marius Coman [:mcoman], Ecosystem QA]

I have verified that this issue is no longer reproducible using the latest Firefox Release (100.0.2 Build ID - 20220519220738) installed on Windows 7 x64, Windows 10 x64, and Windows 11 x64. I can confirm that the validation error is no longer displayed and users are successfully enrolled in the "Device migration - Existing users ECO2212 EN" experiment.

Comment 5

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1752665

Comment 6

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1752665

Comment 7

[Dianna Smith [:diannaS]]

marking as fixed even though it was fixed three months ago, to prevent the bot from picking it up again