As discussed in https://bugzilla.mozilla.org/show_bug.cgi?id=1770015 it seems like we neither currently have a process defined for creating derived glean usage tables, nor remember how this was done before. Long term solution to the problem is discussed in this bug. I have run bqetl query generator with some modifications (in this case [this check](https://github.com/mozilla/bigquery-etl/blob/31db89ac83b8812479cdb7fb0a978b73120c88d5/sql_generators/glean_usage/common.py#L192-L194) was not allowing init queries to be generated). It looks like for `org_mozilla_focus` and `org_mozilla_klar` following tables were missing: ``` org_mozilla_focus_beta_derived.baseline_clients_daily_v1 org_mozilla_focus_beta_derived.baseline_clients_first_seen_v1 org_mozilla_focus_beta_derived.baseline_clients_last_seen_v1 org_mozilla_focus_derived.baseline_clients_daily_v1 org_mozilla_focus_derived.baseline_clients_first_seen_v1 org_mozilla_focus_derived.baseline_clients_last_seen_v1 org_mozilla_focus_nightly_derived.baseline_clients_daily_v1 org_mozilla_focus_nightly_derived.baseline_clients_first_seen_v1 org_mozilla_focus_nightly_derived.baseline_clients_last_seen_v1 org_mozilla_klar_derived.baseline_clients_daily_v1 org_mozilla_klar_derived.baseline_clients_first_seen_v1 org_mozilla_klar_derived.baseline_clients_last_seen_v1 ``` I have just created these tables. Per https://bugzilla.mozilla.org/show_bug.cgi?id=1770015#c0 their views should get deployed after next run of probe_scraper. These tables will start getting populated on the next run of copy_deduplicate DAG, however we'll probably want to backfill them.
Bug 1770986 Comment 1 Edit History
Note: The actual edited comment in the bug view page will always show the original commenter’s name and original timestamp.
As discussed in https://bugzilla.mozilla.org/show_bug.cgi?id=1770015 it seems like we neither currently have a process defined for creating derived glean usage tables, nor remember how this was done before. Long term solution to the problem is discussed in this bug. I have run bqetl query generator with some modifications (in this case [this check](https://github.com/mozilla/bigquery-etl/blob/31db89ac83b8812479cdb7fb0a978b73120c88d5/sql_generators/glean_usage/common.py#L192-L194) was not allowing init queries to be generated). It looks like for `org_mozilla_focus` and `org_mozilla_klar` following tables were missing: ``` org_mozilla_focus_beta_derived.baseline_clients_daily_v1 org_mozilla_focus_beta_derived.baseline_clients_first_seen_v1 org_mozilla_focus_beta_derived.baseline_clients_last_seen_v1 org_mozilla_focus_derived.baseline_clients_daily_v1 org_mozilla_focus_derived.baseline_clients_first_seen_v1 org_mozilla_focus_derived.baseline_clients_last_seen_v1 org_mozilla_focus_nightly_derived.baseline_clients_daily_v1 org_mozilla_focus_nightly_derived.baseline_clients_first_seen_v1 org_mozilla_focus_nightly_derived.baseline_clients_last_seen_v1 org_mozilla_klar_derived.baseline_clients_daily_v1 org_mozilla_klar_derived.baseline_clients_first_seen_v1 org_mozilla_klar_derived.baseline_clients_last_seen_v1 ``` I have just created these tables. Per https://bugzilla.mozilla.org/show_bug.cgi?id=1770015#c0 their views should get deployed after next run of probe_scraper. These tables will start getting populated on the next run of copy_deduplicate DAG.