1525702 - Make new 'intl' fields available for queries on STMO

Status: RESOLVED FIXED

(Data Platform and Tools :: General, enhancement, P1)

Description

[Francesco Lodolo [:flod]]

In bug 1502921 (and fx66) we added several fields to the Environment ping.

https://github.com/mozilla-services/mozilla-pipeline-schemas/pull/248 was filed to get the data validated and through to STMO.

intl: {
  requestedLocales: [ <string>, ... ], // The locales that are being requested.
  availableLocales: [ <string>, ... ], // The locales that are available for use.
  appLocales: [ <string>, ... ], // The negotiated locales that are being used.
  systemLocales: [ <string>, ... ], // The locales for the OS.
  regionalPrefsLocales: [ <string>, ... ], // The regional preferences for the OS.
  acceptLanguages: [ <string>, ... ], // The languages for the Accept-Languages header.
},

I'd like to be able to use this data in queries and dashboards on STMO as part of the multilingual effort.

Normally I would use the client_count_daily for such queries (tracking changing in l10n distribution and usage), not sure if that's relevant information.

Comment 1

[GitHub Bugzilla PR Linker]

Attachment: Link to GitHub pull-request: https://github.com/mozilla/telemetry-batch-view/pull/519

Comment 2

[Mark Reid [:mreid]]

These fields will be added to main_summary in tonight's run, the field names will be of the form:
environment_settings_intl_<snake_cased_name>

For example:
environment_settings_intl_accept_languages

I will double check that the fields are appearing as expected on Monday then close this out.

Comment 3

[Francesco Lodolo [:flod]]

I see there's a ClientsDailyView.scala file in the same repository. Does it mean that it will be only added to main_summary for now? Given the type of data, I think that would be OK, mostly double checking.

Comment 4

[Mark Reid [:mreid]]

Yes, for now it will only be available in main_summary. I've confirmed there's data coming in for it now.

We can add it to clients_daily too if that would help.

Comment 5

[Francesco Lodolo [:flod]]

(In reply to Mark Reid [:mreid] from comment #4)

Yes, for now it will only be available in main_summary. I've confirmed there's data coming in for it now.

We can add it to clients_daily too if that would help.

I'll start using main_summary and see how far I go. In case, I'll file a follow-up bug the other dataset.

Comment 6

[GitHub Bugzilla PR Linker]

Attachment: Link to GitHub pull-request: https://github.com/mozilla/telemetry-batch-view/pull/520

Comment 7

[Mark Reid [:mreid]]

It was easy enough to add to clients_daily, so I did that as well. It should appear there starting tomorrow.