1861664 - [Experiment] The shopping-experience feature cannot be enabled via Nimbus

Status: VERIFIED FIXED

(Fenix :: Experimentation and Telemetry, defect, P1)

Description

[Patriciu Pop [:ppop], Ecosystem QA]

Attachment: feature_not_enabled.mp4

[Prerequisites]:

• Have the latest Firefox for Android Beta 120 installed.
• Have a browser client enrolled in the treatment branch of the "Android Review Checker Beta Smoke Test" experiment.

[Steps to reproduce]:

1. Open the Firefox Beta app and navigate to a product page from a supported website. (e.g. amazon.com)
2. Observe the address bar.

[Expected result]:

• The Review Checker icon is displayed on the right side of the address bar.
• The Review Checker CFR is displayed.

[Actual result]:

• The Review Checker CFR and icon are not displayed.

[Device & build information]:

• OnePlus 6T - Android 11
• Samsung Galaxy A32 - Android 13

[Affected versions]:

• Firefox Beta 120 (Build #2015981850)

[Notes]:

• Looking at the nimbus.fml.yaml file, it appears that only the "developer" channel is listed as enabled.
• We've also used nimbus-cli to force enrollment on Nightly as well as locally made developer builds, but we didn't manage to get the treatment user experience.
• The issue is reproducible using all 3 supported websites (amazon.com, wallmart.com, and bestbuy.com).

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

The bug is marked as tracked for firefox120 (beta) and tracked for firefox121 (nightly). However, the bug still isn't assigned.

:amoya, could you please find an assignee for this tracked bug? If you disagree with the tracking decision, please talk with the release managers.

For more information, please visit BugBot documentation.

Comment 2

[BMO Github Automation]

Attachment: [mozilla-mobile/firefox-android] Bug 1861664 - Fix shopping experience nimbus flag usage (#4285)

Comment 3

[BMO Github Automation]

Authored by https://github.com/rahulsainani
https://github.com/mozilla-mobile/firefox-android/commit/9229d02daa613375bc9ea1f5aca669e1ec066a5b
[main] Bug 1861664 - Fix shopping experience nimbus flag usage

Comment 4

[BugBot [:suhaib / :marco/ :calixte]]

The patch landed in nightly and beta is affected.
:rsainani, is this bug important enough to require an uplift?

• If yes, please nominate the patch for beta approval.
• If no, please set status-firefox120 to wontfix.

For more information, please visit BugBot documentation.

Comment 5

[BMO Github Automation]

Attachment: [mozilla-mobile/firefox-android] Bug 1861664 - Fix shopping experience nimbus flag usage (backport #4285) (#4297)

Comment 6

[Rahul Sainani [:rsainani]]

Comment on attachment 9361176 [details] [review]
[mozilla-mobile/firefox-android] Bug 1861664 - Fix shopping experience nimbus flag usage (backport #4285) (#4297)

Beta/Release Uplift Approval Request

• User impact if declined: Users won't get exposed to shopping experience feature even if they are part of the experiment.
• Is this code covered by automated tests?: No
• Has the fix been verified in Nightly?: No
• Needs manual test from QE?: No
• If yes, steps to reproduce: Note that this has been verified by QE before landing.
• List of other uplifts needed: None
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky): This is basically using the nimbus config feature flag directly
• String changes made/needed: no
• Is Android affected?: Yes

Comment 7

[Patriciu Pop [:ppop], Ecosystem QA]

I've verified that the issue is no longer reproducible, the treatment/control experience is now correctly applied. Tested using a locally built Nightly 121 from the latest main on Android 13.

Comment 8

[BMO Github Automation]

Authored by https://github.com/rahulsainani
https://github.com/mozilla-mobile/firefox-android/commit/1433c4ec2121cde45526ab85bfca9a573a168d7c
[releases_v120] Bug 1861664 - Fix shopping experience nimbus flag usage

Comment 9

[Dianna Smith [:diannaS]]

Comment on attachment 9361176 [details] [review]
[mozilla-mobile/firefox-android] Bug 1861664 - Fix shopping experience nimbus flag usage (backport #4285) (#4297)

Approved for Mobile 120.0b5

Comment 10

[Ciprian Muresan [:cmuresan], Ecosystem QA]

I have verified that the issue is no longer reproducible on Firefox 120 Beta 7 for Android using a Samsung Galaxy A32 device on Android 13.