1938125 - [Rollout] Users cannot enroll in the “Microsurvey: sidebar CSAT and productivity” rollouts due to the way the Required Experiments are set

Status: VERIFIED FIXED

(Firefox :: Messaging System, defect)

Description

[Carmen Fat [:cfat] - Ecosystem QA]

[Notes]:

• Due to the way the “Required Experiments” section is configured for the rollouts, the user has to be enrolled in any branch from both of the experiments mentioned there. Currently it’s impossible for a user to have been enrolled in both “New” and “Existing Users” experiments thus the targeting will never be met.
• The enrollment condition should be fulfilled if the user was previously enrolled in any branch of either experiment.

[Affected versions]:

• Firefox Beta 134.0b10 Build ID: 20241213091550

[Affected Platforms]:

• Windows 10 x64
• Ubuntu 20.04 x64
• macOS 12.6.1

[Prerequisites]:

• Firefox Beta 134 is installed and its channel is changed to “release”.
• User is or was enrolled in one of the required experiments for the “Microsurvey: sidebar CSAT and productivity” rollouts; for example in the Treatment A branch of the “New users: sidebar + GenAI” experiment.

[Steps to reproduce]:

1. Open the browser with the profile from the prerequisites.
2. Try to enroll in the “Microsurvey: sidebar CSAT and productivity” rollout by adding this user.js file to the profile folder in the “about:support” page.
3. Restart the browser and observe the behavior.

[Expected result]:

• The user is enrolled in the “Microsurvey: sidebar CSAT and productivity” rollout successfully.

[Actual result]:

• The user is NOT enrolled in the “Microsurvey: sidebar CSAT and productivity” rollout.

[Additional Notes]:

• This issue is reproducible with both the left and right side microsurvey as well.

Comment 1

[Ania]

Hi Carmen,
I updated the targeting for sidebar microsurveys, selecting only Existing users experiment in the Audience section.
If this correctly enrolls users that have been enrolled into any branch of the existing users sidebar experiment, then I will create two separate rollouts targeting users that have been enrolled into any branch of the *new users sidebar experiment, so we'll have four rollouts total.
Please let me know if this approach worked!

Comment 2

[Carmen Fat [:cfat] - Ecosystem QA]

Hi Ania,
I can confirm that enrollment now works as expected for this scenario, in the Existing Users rollouts (left+right side). I will close this ticket as Verified once we test enrollment in the New Users rollouts as well.

Comment 3

[Carmen Fat [:cfat] - Ecosystem QA]

I have verified that this issue is no longer reproducible using the latest Firefox Beta 134.0b10 (Build ID: 20241213091550) on Windows 10, macOS 12.6.1, and Ubuntu 22.04. I can confirm that clients can successfully enroll in the "Microsurvey: sidebar CSAT and productivity, existing users" and the "Microsurvey: sidebar CSAT and productivity, NEW users" rollouts.

Based on this I am closing this issue as Resolved - Fixed.