1886824 - Multiple Airflow tasks failed for exec_date March 21, 2024 https://github.com/mozilla/bigquery-etl/pull/5252

Status: NEW

(Data Platform and Tools :: General, defect)

Description

[Marlene Hirose]

Multiple Airflow tasks failed for exec_date March 21, 2024 https://github.com/mozilla/bigquery-etl/pull/5252

Task link:
https://workflow.telemetry.mozilla.org/dags/bqetl_analytics_aggregations/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_analytics_tables/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_campaign_cost_breakdowns/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_ctxsvc_derived/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_data_observability_test_data_copy/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_generated_funnels/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_glean_usage/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_gud/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_mobile_activation/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_mobile_feature_usage/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_newtab/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_nondesktop/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_org_mozilla_firefox_derived/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_search_dashboard/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_sponsored_tiles_clients_daily/grid
https://workflow.telemetry.mozilla.org/dags/bqetl_unified/grid
https://workflow.telemetry.mozilla.org/dags/kpi_forecasting/grid
https://workflow.telemetry.mozilla.org/dags/private_bqetl_revenue/grid

Comment 1

[Lucia Vargas]

The failure is due to a mismatch between the query and the BigQuery Schema.
For the solution we have updated the schemas in BigQuery and correct the query templates in this PR-5257.
The Airflow tasks that failed are running now...