Closed Bug 2087132 Opened 22 days ago Closed 16 days ago

Metrics on the "metrics" ping used in onboarding experiments underreport from single-session uses

Categories

(Toolkit :: Telemetry, task, P1)

task

Tracking

()

RESOLVED FIXED
161 Branch
Tracking Status
firefox161 --- fixed

People

(Reporter: chutten, Assigned: chutten)

References

(Blocks 1 open bug)

Details

(Whiteboard: [fog-migration])

Attachments

(1 external file)

In https://docs.google.com/document/d/1o0X7rjXx_z-l9bK7ZlViuqwPl46yp4p1EQx8XP9mq6g/edit?tab=t.0 :jlockhart identified 36 metrics submitted on the "metrics" ping that correspond to Legacy probes that have been used in Legacy Jetstream analyses focusing on Firefox Desktop Onboarding. Onboarding experiment analyses are particularly sensitive to single-session uses of Firefox Desktop, and the "metrics" ping's design of being "Big and Slow" is particularly unsuited to report on these uses. This mismatch is a problem for conducting Onboarding experiments with Glean-sent data.

The solution we proposed in the document is to temporarily also report these 36 metrics on the "events" ping which is far more suited to report on these uses (especially after bug 2060890 and friends accelerated early "events" ping submission). Trying to shift the entire instrumentation and analysis culture to "If you want to look at it for Onboarding, put it on the "events" ping" isn't our desired end-goal, but is a the best (effort, timing, reversibility, etc.) way to unblock FOG Migration while we look for other, better designs next year.

Whiteboard: [fog-migration]
Blocks: 2087139
Pushed by chutten@mozilla.com: https://github.com/mozilla-firefox/firefox/commit/1038e9395cca https://hg.mozilla.org/integration/autoland/rev/b1bee0b330dd Temporarily add instrumentation from onboarding experiments to the 'events' ping r=jlockhart,extension-reviewers,tabbrowser-reviewers,sidebar-reviewers,jsudiaman,hsohaney,omarg,search-reviewers,daleharvey,rpl
Status: ASSIGNED → RESOLVED
Closed: 16 days ago
Resolution: --- → FIXED
Target Milestone: --- → 161 Branch
QA Whiteboard: [qa-triage-done-c162/b161]
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: