1634210 - Enrolled client_id with missing experiments field in messagingsystem.onboarding db

Status: RESOLVED FIXED

(Firefox :: Messaging System, defect, P2)

Description

[Punam Dahiya [:pdahiya]]

Large number of enrolled users in beta pull factor experiment are missing experiments info in the messaging_system.onboarding db.

https://sql.telemetry.mozilla.org/queries/70549/source shows users who were enrolled, didn't see about:welcome and later has telemetry pings without experiments info.

We should improve logging at following places to rule out race condition between RemoteSettingExperimentLoader.init completion and PingCenter.jsm which reads active experiments

https://searchfox.org/mozilla-central/source/browser/modules/PingCentre.jsm#81

https://searchfox.org/mozilla-central/source/toolkit/components/telemetry/app/TelemetryEnvironment.jsm#168

RemoteSettingsExperimentLoader.init() -> ExperimentManager.onRecipe -> enroll -> setExperimentActive

https://searchfox.org/mozilla-central/source/toolkit/components/normandy/Normandy.jsm#118

https://searchfox.org/mozilla-central/source/toolkit/components/messaging-system/experiments/ExperimentManager.jsm#169

https://searchfox.org/mozilla-central/source/toolkit/components/messaging-system/experiments/ExperimentManager.jsm#268

Comment 1

[Punam Dahiya [:pdahiya]]

Ran above query in release shows about 14,763 enrolled users who sent telemetry pings from new tab without experiment info
https://sql.telemetry.mozilla.org/queries/71722/source

Total users who were enrolled and didn't send impression ping from experiment branch in about:welcome
50,206
https://sql.telemetry.mozilla.org/queries/71723/source

Digging deeper the issue seems to be timed out users, 20% of firststartup timed out users in 76 release
https://sql.telemetry.mozilla.org/queries/71724/source
42,405.80

Comment 2

[Punam Dahiya [:pdahiya]]

With fix of bug 1642455 and bug 1630384 , we should see fewer timed out users enrolled in 78 onboarding experiment.

Comment 3

[Punam Dahiya [:pdahiya]]

Changing meta bug in favor of 1641286

Comment 4

[Punam Dahiya [:pdahiya]]

This issue was logged for beta pull factor experiment , since than first run enrollment has stabilized https://bugzilla.mozilla.org/show_bug.cgi?id=1633047#c8 and safe to close this issue. Please feel free to reopen if blank experiments field is still observed for onboarding experiment enrolled users.