1799688 - Backfill mobile_search_clients_daily_v1 and corresponding downstream tables

Status: RESOLVED FIXED

(Data Platform and Tools :: General, enhancement)

Description

[Alekhya Kommasani [:Alekhya]]

As requested by Alessio in slack channel : https://mozilla.slack.com/archives/GE83ZMSAW/p1667469233239889
The PRs: https://github.com/mozilla/bigquery-etl/pull/2682 and https://github.com/mozilla/bigquery-etl/pull/3285 were merged into bigquery-etl to add Focus Glean data to the mobile_search_clients_daily_v1 table. The search data from the raw tables (org_mozilla_focus.metrics) is available since January 2021.

Comment 1

[Alekhya Kommasani [:Alekhya]]

./bqetl query backfill search_derived.mobile_search_clients_daily_v1 --project_id=moz-fx-data-shared-prod -s 2021-01-01 -e 2022-11-30 -n 0

Comment 2

[Anna Scholtz [:ascholtz]]

Do we also need to backfill search_derived.mobile_search_clients_last_seen_v1 and search_derived.mobile_search_aggregates_v1?

Comment 3

[Alekhya Kommasani [:Alekhya]]

unified_metrics, mobile_search_clients_last_seen_v1 and mobile_search_aggregates_v1 are the downstream tables.
Wondering if I need to wait for all to be run at once (since I'm waiting on unified metrics PR to be approved) or can go ahead with mobile_search_clients_last_seen_v1 and mobile_search_aggregates_v1 followed by unified_metrics_v1

In this case will run the below backfill commands:

./bqetl query backfill search_derived.mobile_search_clients_last_seen_v1 --project_id=moz-fx-data-shared-prod -s 2021-01-01 -e 2022-11-30 -n 0

./bqetl query backfill search_derived.mobile_search_aggregates_v1 --project_id=moz-fx-data-shared-prod -s 2021-01-01 -e 2022-11-30 -n 0

Comment 4

[Anna Scholtz [:ascholtz]]

sounds good!