1866889 - Public datasets for GLAM aggregates

Status: RESOLVED FIXED

(Data Platform and Tools :: General, task)

Description

[Anna Scholtz [:ascholtz]]

As part of the of the TMO decommissioning we want to make GLAM data for Firefox Desktop publicly available for pre-release channels (beta and nightly).
This is a bug to track the creation and data review of the datasets.
A draft pull request can be viewed at: https://github.com/mozilla/bigquery-etl/pull/4606

Reference:

https://wiki.mozilla.org/Data_Publishing#Dataset_Publishing_Process_2

Data Review Request

Description

2 separate datasets with aggregated GLAM data will be published:

• Firefox Desktop nightly GLAM data
• Firefox Desktop beta GLAM data

The datasets are aggregated by app versions and app builds and contain aggregated data of probes of the 3 most recent versions. The datasets are identical to the data that is shown in GLAM, except for search, event count related and other probes, which are filtered out from the datasets. The filtering is done based on the mozaggregator source code which powers the TMO dashboard.

Query link

https://github.com/mozilla/bigquery-etl/blob/981a8b390d4a1c427ca0c2fe55297ab1c130fc21/sql/moz-fx-data-shared-prod/glam_derived/client_probe_counts_firefox_desktop_beta_v1/query.sql

Data Characteristics

I'm using this document as a guideline. Here's the data characteristics, as asked by that doc.

Is the level of aggregation lower than 3 (ie. does it include individual-level data)?

No.

Are there any Data Collection Category 3 or 4 dimensions?

No.

Do any of the dimensions or metrics include sensitive data?

No.

Comment 1

[Anna Scholtz [:ascholtz]]

Attachment: GitHub Pull Request

Comment 2

[Travis Long [:travis_]]

Comment on attachment 9365689 [details] [review]
GitHub Pull Request

These questions are accurately answered and there are no confounding factors inherent in the publishing of the data.

### Result

data-review+

Comment 3

[Alessio Placitelli [:Dexter]]

Hey Anna,

is this work complete? Can the bug be closed?

Comment 4

[Anna Scholtz [:ascholtz]]

Yes