Closed Bug 1862962 Opened 1 year ago Closed 1 year ago

[Experiment] The Fakespot CFR message can be displayed more than twice if the message is not engaged with

Categories

(Fenix :: Experimentation and Telemetry, defect, P2)

Product:
Fenix
Component:
Experimentation and Telemetry
Platform:
All
Android
Type:
defect

Tracking

(firefox119 unaffected, firefox120 verified, firefox121 verified, firefox122 verified)

Status:
VERIFIED FIXED
Tracking Flags:
Tracking Status
firefox119 --- unaffected
firefox120 --- verified
firefox121 --- verified
firefox122 --- verified

People

(Reporter: cmuresan, Unassigned)

References

(Blocks 1 open bug)

Details

Preconditions

  • Have the nimbus-cli tool installed.
  • Have adb (cli) installed on your device.
  • Have an Android device with USB or Wifi debugging enabled and connected to the device on which you installed nimbus-cli.

Steps to reproduce

  1. Install the latest Firefox Nightly on an Android device.
  2. Open a terminal window on your workstation.
  3. Enter the following command in the terminal window nimbus-cli -a fenix -c nightly enroll android-review-checker-beta-smoke-test --branch treatment-a
  4. Navigate to and Amazon, BestBuy, or Walmart product page.
  5. Dismiss the CFR by tapping somewhere in the page.
  6. Fully close the app and change the system date to +1 day.
  7. Repeat steps 4-6 twice and observe the behavior.

Expected behaviour

  • No CFR message is displayed when navigating to a product page.

Actual behaviour

  • The CFR message is displayed for a 3rd time.

Additional information

  • I've used a Samsung Galaxy A32 with Android 13 to reproduce the issue.
  • The issue is not reproducible if the link from the CFR message is tapped or if the message is dismissed by tapping "x".
  • The issue is also reproducible without an experiment.
  • Attached a screen recording:

Hi, I think the "See also" bug linked is the wrong one, that one refers to reverting to closing the CFR when tapping outside or pressing back. I added the right one. The shopping CFR should now be displayed three times at an interval of 12 hours. There is currently an issue with how many times the CFR is displayed, but once the patch from 1861173 lands, it should be fixed.

See Also: 1859913 → 1861173

Sorry about that, I thought that this was caused by the change that enabled us to dismiss the CFR by tapping somewhere else on the screen. Thanks for the edit!
I'll keep an eye on the bug and retest once it lands.

This bug should be fixed when bug 1861173 is uplifted. Let's keep this bug open so we remember to verify it on Beta.

Depends on: 1861173
Priority: -- → P2
See Also: 1861173 →
See Also: → 1863504

Is this fixed now?

Flags: needinfo?(poiegas)

I have asked :mcoman to have someone look over it asap in the morning. Thanks for the heads up!

Flags: needinfo?(poiegas)

I have verified this issue on the latest Firefox Release 120.01 (Build #2015988378), on the latest Beta 121.0b4 (Build #2015988359) and the latest Nightly 122.0a1 (Build #2015988647) using the Experiment mentioned in the comment 0 on OnePlus 8 Pro device with Android 13.

  • I can confirm that the CFR message is displayed now after 12 hours, and it is displayed only 3 times.

Based on this and Bug 1861173, I'm marking this issue as Verified - Fixed.

Status: NEW → RESOLVED
Closed: 1 year ago
status-firefox120: affected → verified
status-firefox121: affected → verified
status-firefox122: --- → verified
Resolution: --- → FIXED
Status: RESOLVED → VERIFIED
You need to log in before you can comment on or make changes to this bug.