1942090 - Airflow task bqetl_artifact_deployment.publish_new_tables failed for exec_date 2025-01-16

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[Krzysztof Ignasiak [:kik]]

Airflow task bqetl_artifact_deployment.publish_new_tables failed for exec_date 2025-01-16

Task link:
https://workflow.telemetry.mozilla.org/dags/bqetl_artifact_deployment/grid?dag_run_id=manual__2025-01-16T11:08:14.436802%2000:00&task_id=publish_new_tables&tab=details

Log extract:

[2025-01-16, 13:55:09 UTC] {pod_manager.py:472} INFO - [base] Schema sql/moz-fx-data-shared-prod/revenue_derived/search_revenue_levers_monthly_v3/schema.yaml updated.
[2025-01-16, 13:55:09 UTC] {pod_manager.py:472} INFO - [base] sql/moz-fx-data-shared-prod/revenue_derived/revenue_google_country_level_tier1_v1/query.sql ERROR
[2025-01-16, 13:55:09 UTC] {pod_manager.py:472} INFO - [base]  404 POST https://bigquery.googleapis.com/bigquery/v2/projects/moz-fx-data-shared-prod/jobs?prettyPrint=false: Not found: Table mozdata:revenue_cat3_analysis.revenue_google_country_level_tier1_staging was not found in location US
[2025-01-16, 13:55:09 UTC] {pod_manager.py:472} INFO - [base] Location: None

Comment 1

[Krzysztof Ignasiak [:kik]]

We're also seeing the following errors for ads_derived:

[2025-01-16, 13:55:10 UTC] {pod_manager.py:472} INFO - [base] sql/moz-fx-data-shared-prod/ads_derived/dismissals_hourly_v1/query.sql ERROR
[2025-01-16, 13:55:10 UTC] {pod_manager.py:472} INFO - [base]  400 POST https://bigquery.googleapis.com/bigquery/v2/projects/moz-fx-data-shared-prod/jobs?prettyPrint=false: Query parameter 'interval_start' not found at [11:27]
[2025-01-16, 13:55:10 UTC] {pod_manager.py:472} INFO - [base] Location: None
[2025-01-16, 13:55:10 UTC] {pod_manager.py:472} INFO - [base] Job ID: dde5eec0-4622-409e-9a86-baac1f6356da

and

[2025-01-16, 13:55:12 UTC] {pod_manager.py:472} INFO - [base] Exception: Cannot merge schemas. mode attributes for root.interaction_count are incompatible
[2025-01-16, 13:55:12 UTC] {pod_manager.py:472} INFO - [base] sql/moz-fx-data-shared-prod/ads_derived/events_spocs_hourly_v2/query.sql ERROR
[2025-01-16, 13:55:12 UTC] {pod_manager.py:472} INFO - [base]  400 POST https://bigquery.googleapis.com/bigquery/v2/projects/moz-fx-data-shared-prod/jobs?prettyPrint=false: Query parameter 'interval_start' not found at [10:29]
[2025-01-16, 13:55:12 UTC] {pod_manager.py:472} INFO - [base] Location: None
[2025-01-16, 13:55:12 UTC] {pod_manager.py:472} INFO - [base] Job ID: 5faf6520-3cb3-4f68-b710-d05887851afe