1675796 - The profile remains enrolled in the "QuantumBar v2 Group" branch after manually disabling the feature from about:config

Status: NEW

(Firefox :: Address Bar, defect, P3)

Description

[Cosmin Muntean [:cmuntean], Ecosystem QA]

Attachment: Quantumbar v2 - Profile remains enrolled.gif

[Notes]:

• I have discussed this behavior with Michael De Boer, and it is expected to still have the experiment enrolled in the profile. This is an edgecase because the users have to manually disable the feature using "about:config" page and probably they are not aware of this pref.
• However, I have logged this behavior for tracking purposes and for all members involved in this experiment to be aware, in case that we will have any strange results at the end of the experiment.
• Our concern is that the users enrolled in the "QuantumBar v2 Group" branch which will have the QuantumBar v2 feature enabled, will still remain enrolled in the experiment if they manually disable the feature. This can affect the gathered telemetry data because the users enrolled in this branch should have the QuantumBar v2 feature enabled.

[Affected versions]:

• Beta 83.0b9;
• Nightly 84.0a1;

[Affected Platforms]:

• All Windows;
• All macOS;
• All Linux;

[Prerequisites]:

• Have a new clean Firefox Profile.
• See this document for the environment variable needed so you can enroll in the experiment.
• Copy this user.js file in the profile folder.

[Steps to reproduce]:

1. Open the Firefox browser using the profile from prerequisites.
2. Navigate to "about:studies" to verify that the experiment is active.
3. Navigate to "about:config" and set the "browser.urlbar.update2" to false.
4. Open a new tab and verify that the QuantumBar v2 feature is disabled.
5. Navigate to "about:studies" page and observe the behavior.

[Expected result]:

• The profile is unenrolled from the experiment because the QuantumBar v2 feature was disabled.

[Actual result]:

• The profile remains enrolled in the experiment on the "QuantumBar v2 Group" branch even if the QuantumBar v2 feature is disabled.

[Additional Notes]:

• Attached a screen recording with the described behavior.