Closed Bug 1866992 Opened 6 months ago Closed 6 months ago

Add adsExposure & noAdsAvailable telemetry probes

Categories

(Fenix :: Shopping, task, P1)

All
Android

Tracking

(firefox120 disabled, firefox121 verified, firefox122 verified)

VERIFIED FIXED
122 Branch
Tracking Status
firefox120 --- disabled
firefox121 --- verified
firefox122 --- verified

People

(Reporter: vdreghici, Assigned: rsainani)

References

Details

(Whiteboard: [fxdroid] [fakespot-android-mvp])

Attachments

(2 files)

According to this sheet we are still missing the adsExposure and noAdsAvailable probes.

Blocks: 1847010
Version: Firefox 121 → unspecified

The ads exposure events are needed for the execution of the ads experiment. The primary comparison of interest is “users who saw ads vs users who could’ve seen ads” and the telemetry is necessary to determine that 2nd population. Because it’s needed for the execution of the experiment, it is also needed to plan the experiment (sizing).

Assignee: nobody → rsainani
Status: NEW → ASSIGNED
Severity: -- → N/A
Priority: -- → P1
Whiteboard: [fxdroid] [fakespot-android-mvp]
Status: ASSIGNED → RESOLVED
Closed: 6 months ago
Flags: qe-verify+
Resolution: --- → FIXED
Target Milestone: --- → 122 Branch

Verified on the latest Fenix Nightly 122.0a1 from 11/29, and the following evenst were triggered:

 "timestamp": 1437,
"category": "shopping",
"name": "ads_exposure"
"timestamp": 5761,
"category": "shopping",
"name": "surface_no_ads_available"

Glean dashboard

Flags: qe-verify+

Comment on attachment 9366041 [details] [review]
[mozilla-mobile/firefox-android] Bug 1866992 - Add product recommendations exposure telemetry (backport #4622) (#4636)

Beta/Release Uplift Approval Request

  • User impact if declined: The ads exposure events are needed for the execution of the ads experiment. The primary comparison of interest is “users who saw ads vs users who could’ve seen ads” and the telemetry is necessary to determine that 2nd population. Because it’s needed for the execution of the experiment, it is also needed to plan the experiment (sizing).
  • Is this code covered by automated tests?: Yes
  • Has the fix been verified in Nightly?: Yes
  • Needs manual test from QE?: Yes
  • If yes, steps to reproduce: Mentioned in the bug description
  • List of other uplifts needed: None
  • Risk to taking this patch: Medium
  • Why is the change risky/not risky? (and alternatives if risky): Since this is adding 2 telemetry events and the logic is very well covered with unit tests it's a low risk change. But since the lines of code changes are bit higher, I'm being cautious in labeling the risk as medium.
  • String changes made/needed: no
  • Is Android affected?: Yes
Attachment #9366041 - Flags: approval-mozilla-beta?
Flags: qe-verify+
Comment on attachment 9366041 [details] [review]
[mozilla-mobile/firefox-android] Bug 1866992 - Add product recommendations exposure telemetry (backport #4622) (#4636)

Approved for 121.0b6.
Attachment #9366041 - Flags: approval-mozilla-beta? → approval-mozilla-beta+

Verified as fixed on Firefox Beta 121.0b6 with Samsung Galaxy S23 Ultra (Android 13) and Motorola G9 plus (Android 11).

Status: RESOLVED → VERIFIED
Flags: qe-verify+
See Also: → 1872904
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: