1822251 - Airflow DAG bqetl_sponsored_tiles_clients_daily failing on 2023-03-14

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[Arkadiusz Komarzewski [:akomar]]

Airflow DAG bqetl_sponsored_tiles_clients_daily is failing on 2023-03-14 due to incompatible schema change (see https://workflow.telemetry.mozilla.org/log?dag_id=bqetl_sponsored_tiles_clients_daily&task_id=sponsored_tiles_clients_daily_v1&execution_date=2023-03-13T04%3A00%3A00%2B00%3A00)

Comment 1

[BMO Automation]

Attachment: [mozilla/bigquery-etl] Bug 1822251 Update legacy_compatible_experiments UDF (#3661)

Comment 2

[Curtis Morales [:curtis]]

Opened a PR to fix it https://github.com/mozilla/bigquery-etl/pull/3661

This happened because of the change to glean ping_info.experiments https://github.com/mozilla-services/mozilla-pipeline-schemas/pull/761, which broke a UDF because the experiments struct now has a different format

Comment 3

[Curtis Morales [:curtis]]

I merged the PR and reran the table for today. This is fixed now.