1727074 - [Nimbus] Profiles that invalidate the channel and version filters of an experiment are still marked as Active while being displayed in the "Completed Studies" section of the about:studies page

Status: RESOLVED WORKSFORME

(Firefox :: Nimbus Desktop Client, defect)

Description

[Patriciu Pop [:ppop], Ecosystem QA]

Attachment: 112316858-2b191c80-8cb4-11eb-9f31-9e249494c128.gif

Cloned from the Experimenter GitHub.

[Prerequisites]:

• Have an experiment that is set to target population on a specific release channel ("nightly", "beta", "release") and a specific version (e.g. 76 and higher).

[Steps to reproduce]:

1. Open a browser that can enroll in the experiment from prerequisites and enroll in the experiment.

2. Close the browser and open a different one using a different channel but the same profile.

3. Navigate to the "about:studies" page and observe the list of experiments.

[Expected result]:

• All experiments that had their targeting parameters invalidated by the channel switch are marked as completed and are found in the "Completed Studies" section.

[Actual result]:

• Experiments that had their targeting parameters invalidated by the channel switch are found in the "Completed Studies" section BUT they are marked as active.

[Notes]:

• The issue is also reproducible if the filter is invalidated by downgrading to an unsupported version using the same profile.

• The experiments are correctly marked as "completed" once the experiment is disabled in Remote Settings.

• Attached is a screenshot of the issue.

Comment 1

[Jared Lockhart [:jlockhart]]

The thing I'd be really interested to see here is whether the targeting parameters no longer matching is properly unenrolling the client and just mislabeling it in the about:studies page, or whether targeting parameters no longer matching is failing to unenroll the client.

Comment 2

[Beth Rennie [:beth] (she/her)]

The attached image does not show the issue, but I am unable to reproduce. I enrolled in an experiment targeting beta on a beta browser (with natural enrollment), closed the browser, and re-opened the profile with nightly. I was correctly unenrolled and the experiment showed as inactive and in the "Complete" section.