1797851 - Add telemetry to video section in onboarding

Status: VERIFIED FIXED

(Firefox :: Messaging System, task, P1)

Description

[Punam Dahiya [:pdahiya]]

Scope of this bug is to add probe to capture video start, and if possible video completed telemetry

Comment 1

[Mimi Jung]

Attachment: Bug 1797851 - Add telemetry to video section in onboarding

Comment 2

[Mimi Jung]

Attachment: Bug 1797851 - Add telemetry to video section in onboarding

Comment 3

[nbulous]

This fix is needed for the Onboarding welcome video experiment in Fx108

Comment 4

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/439eb32c3778
Add telemetry to video section in onboarding r=pdahiya,emcminn

Comment 5

[Serban Stanca [:SerbanS]]

https://hg.mozilla.org/mozilla-central/rev/439eb32c3778

Comment 6

[Simona Rosu [:srosu], Ecosystem QA]

I‘ve verified this task using the latest Firefox Nightly 109.0a1 (Build ID: 20221117093901) on Windows 10 x64.

• When the Firefox video starts, the following telemetry ping is registered in the Browser Console:

  • TELEMETRY PING (about:welcome): {"experiments":{"optin-onboarding-welcome-video-experiment":{"branch":"treatment-a"}},"locale":"en-US","version":"109.0a1","release_channel":"nightly","event":"CLICK_BUTTON","event_context":"{"source":"video_start","page":"about:welcome"}","message_id":"VIDEO-TREATMENT-A_0_VIDEO_ONBOARDING","addon_version":"20221117093901","client_id":"8bbf9524-3b46-42cf-b3fe-bd97057be9f3","browser_session_id":"8e288613-b682-44ca-a409-736cc6a35596"}

• When the Firefox Video ends, the following telemetry ping is registered:

  • TELEMETRY PING (about:welcome): {"experiments":{"optin-onboarding-welcome-video-experiment":{"branch":"treatment-a"}},"locale":"en-US","version":"109.0a1","release_channel":"nightly","event":"CLICK_BUTTON","event_context":"{"source":"video_end","page":"about:welcome"}","message_id":"VIDEO-TREATMENT-A_0_VIDEO_ONBOARDING","addon_version":"20221117093901","client_id":"8bbf9524-3b46-42cf-b3fe-bd97057be9f3","browser_session_id":"8e288613-b682-44ca-a409-736cc6a35596"}

Comment 7

[Mimi Jung]

Comment on attachment 9302706 [details]
Bug 1797851 - Add telemetry to video section in onboarding

Beta/Release Uplift Approval Request

• User impact if declined: Unable to have tracking/telemetry for onboarding video experiment
• Is this code covered by automated tests?: Yes
• Has the fix been verified in Nightly?: Yes
• Needs manual test from QE?: Yes
• If yes, steps to reproduce: Steps can be found in the phabricator test plan:
  https://phabricator.services.mozilla.com/D161704
• List of other uplifts needed: Bug 1797843
• Risk to taking this patch: Low
• Why is the change risky/not risky? (and alternatives if risky): Only adds existing click action telemetry/tracking for video onboarding experiment. This uplift should happen after 1797843 has been approved for uplift.
• String changes made/needed:
• Is Android affected?: No

Comment 8

[Dianna Smith [:diannaS]]

Comment on attachment 9302706 [details]
Bug 1797851 - Add telemetry to video section in onboarding

Approved for 108.0b4

Comment 9

[Dianna Smith [:diannaS]]

https://hg.mozilla.org/releases/mozilla-beta/rev/173fead79981

Comment 10

[Simona Rosu [:srosu], Ecosystem QA]

I‘ve verified this task using Firefox Beta 108.0b4 (Build ID: 20221120185746) on Windows 10 x64, macOS 11.7.1. On Ubuntu 22.04, I’m blocked from verifying due to Bug 1801038.

• After following the steps from the Test Plan, I can confirm the followings:

• When the Firefox video starts, the following telemetry ping is registered in the Browser Console:
  - TELEMETRY PING (about:welcome): {"experiments":{"task-continuity-sync-after-tab-change-rollout-40":{"branch":"sync-after-tab"}},"locale":"en-US","version":"108.0","release_channel":"beta","event":"CLICK_BUTTON","event_context":"{"source":"video_start","page":"about:welcome"}","message_id":"MR_WELCOME_DEFAULT_0_VIDEO_ONBOARDING","addon_version":"20221120185746","client_id":"c915eed6-f58b-4229-a64f-9983dc576797","browser_session_id":"f6fc9f39-d9a3-48d6-b181-d283431c8ea5"}

• When the Firefox Video ends, the following telemetry ping is registered:
  - TELEMETRY PING (about:welcome): {"experiments":{"task-continuity-sync-after-tab-change-rollout-40":{"branch":"sync-after-tab"}},"locale":"en-US","version":"108.0","release_channel":"beta","event":"CLICK_BUTTON","event_context":"{"source":"video_end","page":"about:welcome"}","message_id":"MR_WELCOME_DEFAULT_0_VIDEO_ONBOARDING","addon_version":"20221120185746","client_id":"c915eed6-f58b-4229-a64f-9983dc576797","browser_session_id":"f6fc9f39-d9a3-48d6-b181-d283431c8ea5"}