1994130 - The client is enrolled in the experiment in the first browsing session even if the ToU from the Onboarding screen was accepted

Status: VERIFIED FIXED

(Firefox for Android :: Experimentation and Telemetry, defect, P1)

Description

[Alice Varro [avarro], Ecosystem QA]

[Affected versions]:

• Firefox Release for Android 144.0, (Build #2016119298), 891fe1916a38e0f59abe348dec09ae0755b79367, GV: 144.0 - 20251009125714, AS: 144.0.1

[Affected Platforms]:

• Xiaomi 12 Pro - Android 15

[Prerequisites]:

• Have the app freshly installed on the device.
• You have not opened the app previously.

[Steps to reproduce]:

1. Open the Firefox app using the nimbus-cli command with the –preserve-targeting attribute: nimbus-cli --app fenix --channel release enroll preview/android-tou-no-sponsored-content-opt-outs --branch treatment-a --preserve-targeting to enroll in the Treatment branch of the https://experimenter.services.mozilla.com/nimbus/android-tou-no-sponsored-content-opt-outs/summary/ experiment.
2. Accept the ToU from Onboarding.
3. Dismiss the other Onboarding screens
4. Navigate to the Experiments section and observe the enrolled experiments.
5. Observe the behavior.

[Expected result]:

• The “Android ToU not sponsored content opt outs” experiment is NOT displayed with a checkmark.

[Actual result]:

• The “Android ToU not sponsored content opt outs” experiment is displayed with a checkmark.

[Notes]:

• Attaching a screen recording of the issue here.
• The issue is also reproducible on https://experimenter.services.mozilla.com/nimbus/android-tou-any-users/summary/ experiment.
• The issue is not reproducible if the browser is updated from an older version which doesn’t have ToU in Onboarding.

Comment 1

[twhite]

Potentially due to the TOU_TARGETING_ANDROID_NOT_ACCEPTED_AND_NO_SPONSORED_OPT_OUTS config not being enrolled as first run, updated the config for re-testing.

Comment 2

[twhite]

Attachment: GitHub Pull Request

Comment 3

[Chris Peterson [:cpeterson]]

Tom's fix has been merged:

https://github.com/mozilla/experimenter/pull/13681

Comment 5

[Alice Varro [avarro], Ecosystem QA]

I'm marking this issue as Verified - Fixed since the advanced targeting of the experimenter recipe was updated and new users are no longer included in the experiment.