1841794 - [Experiment]Incorrect telemetry ping "events.marketing_notification_allowed": false is displayed in Glean

Status: NEW

(Firefox for Android :: Experimentation and Telemetry, defect)

Description

[Valentin Bandac [:vbandac], Ecosystem QA]

Attachment: marketing.false1.png

[Notes]:

• Android 13: If the user accesses Firefox -> Settings -> Notifications -> Notification categories -> disable and enable the “Marketing” option, after a browser restart the "events.marketing_notification_allowed" event is displayed correctly with value “true”.
• Android 11: At first run, if there are no marketing notifications received on the device, the “Marketing” option is not available. The user must first receive a marketing notification, then proceed as for Android 13 mentioned above.
• The same behaviour can be observed in Android Studio - Logcat.

[Prerequisites]:

• Have the phone connected to your PC and Android Studio.
• Make sure the Notification permissions from your device are enabled.
• Have Firefox Release 115.0 installed
• Have the latest version of nimubs-cli installed.
• Have the nimbus.cli command for the “Android re-engagement notifications timing offtrain” experiment (nimbus-cli.exe --app fenix --channel release enroll preview/android-re-engagement-notifications-timing-offtrain --branch treatment-privacy-notification)
• Have the command adb shell am start -n org.mozilla.firefox/mozilla.telemetry.glean.debug.GleanDebugActivity --ez logPings true --es sendPing events --es sendPing metrics --es debugViewTag <chosen_by_tester>

[Steps to reproduce]:

• Use the nimbus-cli command from prerequisites and enroll in the treatment-privacy-notification branch of the experiment and note the time it was opened.
• Close Firefox.
• Use the adb command from prerequisites to open Firefox.
• Go to the device's Settings > Date & Time and set the time to the same value as noted in Step 1.
• Set the Date 48h ahead and wait a minute.
• The Re-Engagement Notification is displayed.
• Navigate to debug-ping-preview.firebaseapp.com/pings/<tag_set_by_user>.
• Expand the “metrics” ping and search after “events.marketing notification allowed".

[Expected result]:

• The "events.marketing_notification_allowed": true event is displayed.

[Actual result]:

• The "events.marketing_notification_allowed": false event is displayed.

[Device and build information]:
Firefox Release 115.0 (Build ID: 20230629134642) - de locale - One+ 6 - Android 11
Firefox Release 115.0 (Build ID: 20230629134642) - en-US locale - Pixel 4 - Android 13

[Build version]:
Firefox Release 115.0 (Build ID: 2015959411), bfadf7719e+, GV: 115.0-20230629134642, AS: 115.02023-06-29T22:33:21.521849