1555764 - Add os, os_version columns to search aggregates / search clients daily

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[arana]

For the following tables
a) search_clients_daily
b) search_aggregates

the following additional column is needed
os_version
(as in the main_summary table)

The data needs to be available from Jan 1 , 2018

Thanks

Comment 1

[William Lachance (:wlach)]

This looks easy to add but backfilling will take some time. Let's start with a PR.

Comment 2

[GitHub Bugzilla PR Linker]

Attachment: Link to GitHub pull-request: https://github.com/mozilla/python_mozetl/pull/331

Comment 3

[William Lachance (:wlach)]

Backfilled one day of this dataset, will check tomorrow after the metastore updates. Harter, can you review the above?

Comment 4

[William Lachance (:wlach)]

Harter reviewed the PR, went ahead and merged it. Will look into backfill tomorrow

Comment 5

[arana]

Thanks William for the quick turnaround.

Will wait for the backfill

Comment 6

[William Lachance (:wlach)]

Backfilled the datasets up to January 2018 in search_clients_daily_dev/search_aggregates_dev, currently copying files into place for production versions. Should be done by tomorrow, feel free to experiment with the _dev datasets before then.

Comment 7

[William Lachance (:wlach)]

Backfill should be complete in the v6 version of seach_aggregates/search_clients_daily. New columns available in 2018-01-01, 2016/2017 data is just copied over from the previous version (v5).