1493258 - Create Firefox Release Table from the product-details API

Status: RESOLVED FIXED

(Data Platform and Tools :: General, enhancement, P2)

Description

[bugzilla]

Soooo this exists: https://product-details.mozilla.org/1.0/all.json

I suspect we could add this to Athena pretty easily since it can read JSON, and then it'd be joinable to other queries. Right now it doesn't seem like there's any way to add an events overlay to re:dash visualizations, but it seems like that might be a reasonable feature to request in the future for line graphs if this table ends up being useful.

Comment 1

[bugzilla]

On second thought, having this as a source we can join in athena might be better: https://mozilla-services.github.io/buildhub

Comment 3

[William Lachance (:wlach)]

I think product-details might have some fields that can't be divined from the buildhub.json files that I propose to ingest in bug 1607229, but it probably makes sense to just close this since there's so much overlap. Can always open new issues to scrap/grab more data in the future if it turns out there is a need.

Comment 4

[Anna Scholtz [:ascholtz]]

There is renewed interest in having datasets with release dates for desktop. Having them would allow to add overlays in Looker.

The best path forward here is to setup a job that is executed daily via bigquery-etl that dumps https://product-details.mozilla.org/1.0/firefox.json into a table in telemetry_derived.

Comment 5

[GitHub Bugzilla PR Linker]

Attachment: Link to GitHub pull-request: https://github.com/mozilla/bigquery-etl/pull/1958