1754986 - Users with “Enable picture-in-picture video control" disabled are not excluded from the A/A Picture in Picture study

Status: VERIFIED FIXED

(Toolkit :: Picture-in-Picture, defect, P2)

Description

[Maria Heres, inactive, contact Ecosystem QA]

[Affected Versions]:

• Firefox Nightly 99.0a1 (Build ID: 20220210065747)

[Affected Platforms]:

• Windows 10
• Linux Mint 20.2
• macOS 11.6

[Prerequisites]:

• Have Firefox Nightly 99 en-US / en-GB / en-CA installed.
• Set browser.search.region to one of: 'AU', 'CA', 'GB', 'NZ', 'US' and restart the browser.

[Steps to reproduce]:

1. Go to “about:preferences#general”.
2. Untick “Enable picture-in-picture video control”
3. Navigate to “about:config”.
4. Change “messaging-system.rsexperimentloader.collection_id” to “nimbus-preview” to change to the Preview environment.
5. Close and open the browser again.
6. Observe the “about:studies” page.

[Expected result]:

• You have not been enrolled in the “Picture-in-Picture - First-time Toggle Text (A/A)” study.

[Actual result]:

• You have been enrolled in the “Picture-in-Picture - First-time Toggle Text (A/A)” study.

[Notes]:

• The issue is also reproducible when users disable the setting while enrolled in the study. They are not unenrolled, despite the “Enable picture-in-picture video control” option being disabled.
• Attached is a recording of the issue.

Comment 1

[Ania]

The issue is also reproducible when users disable the setting while enrolled in the study. They are not unenrolled, despite the “Enable picture-in-picture video control” option being disabled.

Comment 2

[Maria Heres, inactive, contact Ecosystem QA]

The issue was fixed here https://github.com/mozilla/experimenter/pull/7088.

Comment 3

[Maria Heres, inactive, contact Ecosystem QA]

We have verified that the issue is no longer reproducible. The following scenarios were verified:

• Users with “Enable picture-in-picture video control” disabled are not enrolled in the study.
• Users who have already enrolled in the study remain enrolled if they disable “Enable picture-in-picture video control”.
  Tested using Firefox Nightly 99.0a1 (Build ID: 20220217212127) on Windows 10, macOS 11.6 and Linux Mint 20.2.