1785283 - Backfill for active_users_aggregates - did not run in https://github.com/mozilla/bigquery-backfill/pull/19

Status: RESOLVED WORKSFORME

(Data Platform and Tools :: General, enhancement)

Description

[Lucia Vargas [:lucia-vargas-a]]

Attachment: Screen Shot 2022-08-17 at 17.46.59.png

User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:105.0) Gecko/20100101 Firefox/105.0

Steps to reproduce:

The bqetl_analytics_aggregations should have been queued and run by this PR https://github.com/mozilla/bigquery-backfill/pull/19.

For the downstream aggregates there were failures in the cohorts aggregates for 2022-0515 anf the 3 tables for active_user_aggregates, didn't run.

Expected results:

All tables updated via DAG bqetl_analytics_aggregations should have been updated without errors.

Comment 1

[Lucia Vargas [:lucia-vargas-a]]

The cohorts aggregate was ran again from Airflow for 2022-05-15 with result success.

The active_users_aggregates tables that did not run as part of the queue are backfilled using the following commands:

./bqetl query backfill telemetry_derived.active_users_aggregates_v1 --project_id=moz-fx-data-shared-prod -s 2022-05-01 -e 2022-08-17 -n 0
./bqetl query backfill telemetry_derived.active_users_aggregates_device_v1 --project_id=moz-fx-data-shared-prod -s 2022-05-01 -e 2022-08-17 -n 0
./bqetl query backfill telemetry_derived.active_users_aggregates_attribution_v1 --project_id=moz-fx-data-shared-prod -s 2022-05-01 -e 2022-08-17 -n 0

This is ran in the CLI for better performance.
The backfill is from may 2022 until the current date to cover all changes in first_seen_dates that need to be updated.

Comment 2

[Lucia Vargas [:lucia-vargas-a]]

Backfill completed.