1774051 - Android version without a number found in OS and Geo Distribution monitoring

Status: RESOLVED FIXED

(Data Platform and Tools :: General, task, P2)

Description

[anicholson]

In Firefox Android starting June 11, we've started seeing a number of clients with an OS version "Android" (as opposed to "Android x.x.x"). This is worth some investigations

Comment 1

[Wesley Dawson [:whd]]

This is very likely to be related to https://github.com/mozilla/gcp-ingestion/pull/2102 which landed on the 10th.

Comment 2

[Jeff Klukas [:klukas] (UTC-4)]

(In reply to Wesley Dawson [:whd] from comment #1)

This is very likely to be related to https://github.com/mozilla/gcp-ingestion/pull/2102 which landed on the 10th.

That change is limited to the ContextualServicesSender streaming job. The change in behavior that Alex is reporting here was showing up in our pipeline health check looker dashboard, based on os values from stable tables. So I don't think these can be related.

Comment 3

[Arkadiusz Komarzewski [:akomar]]

This is investigated in https://bugzilla.mozilla.org/show_bug.cgi?id=1781085

Comment 4

[Eduardo Filho [:efilho]]

(In reply to the resolution of https://bugzilla.mozilla.org/show_bug.cgi?id=1781085)

Glean v50.1.4 includes Bug 1781085 and will be released with Fenix/Focus 103.2.0

As of today we noticed the line for Android without a version stopped increasing. As discussed in the Platform Health Check meeting today, we should observe whether the line will lower after the fix above gets rolled out.

Comment 5

[Frank Bertsch [:frank]]

As of today, this value is still holding steady. We would expect the 103.2.0 to have been rolled out, so it's unclear if this has been fixed in the client.

Comment 6

[Marlene Hirose]

For more context: https://mozilla.slack.com/archives/C4D5ZA91B/p1658515046076419

Comment 7

[Sean Rose [:srose]]

(In reply to Frank Bertsch [:frank] from comment #5)

As of today, this value is still holding steady. We would expect the 103.2.0 to have been rolled out, so it's unclear if this has been fixed in the client.

I've confirmed Fenix 103.2.0 has indeed rolled out at the usual rate, and it looks like the missing Android version leveling out and holding steady is simply due to the long tail of people who aren't updating Fenix to the latest version. So this particular problem was not fixed in Glean 50.1.4 / Fenix 103.2.0.

I'm grabbing this bug to investigate further.

Comment 8

[Sean Rose [:srose]]

I've determined that in Fenix 103.1.0 and later client_info.os_version is nearly always "Unknown", and have created Glean SDK bug 1787928 for that.

Comment 9

[Sean Rose [:srose]]

A fix for this appears to have been deployed to the Fenix release channel around 2022-10-18 when the number of clients without a reported OS version began dropping rapidly.

While we still have around 391k clients remaining without a reported OS version, we'll consider this fixed.