1880270 - Airflow task bqetl_glam_refresh_aggregates .glam_etl__glam_desktop_beta_aggregates__v1 failed for exec_date 2024-02-14

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[Lucia Vargas]

Airflow task bqetl_glam_refresh_aggregates .glam_etl__glam_desktop_beta_aggregates__v1 failed for exec_date 2024-02-14

Tasks failing with the same error:
glam_etl__glam_desktop_nightly_aggregates__v1
glam_etl__glam_desktop_release_aggregates__v1
glam_etl__glam_fenix_beta_aggregates__v1
glam_etl__glam_fenix_nightly_aggregates__v1
glam_etl__glam_fenix_release_aggregates__v1
glam_etl__glam_fog_beta_aggregates__v1
glam_etl__glam_fog_nightly_aggregates__v1
glam_etl__glam_fog_release_aggregates__v1

Task link:
https://workflow.telemetry.mozilla.org/dags/bqetl_glam_refresh_aggregates/grid?dag_run_id=scheduled__2024-02-13T08%3A00%3A00%2B00%3A00&task_id=glam_etl__glam_desktop_beta_aggregates__v1&tab=logs

Log extract:

Invalid value for '--project-id' / '--project_id': Invalid project           │
[2024-02-14, 10:10:25 UTC] {pod_manager.py:437} INFO - [base] │ moz-fx-data-glam-prod-fca7  

Comment 1

[BMO Github Automation]

Attachment: [mozilla/bigquery-etl] Bug 1880270 Allow glam-prod project queries to execute (#5045)

Comment 2

[Lucia Vargas]

The same error persists on 2024-02-15.

Task link:
https://workflow.telemetry.mozilla.org/dags/bqetl_glam_refresh_aggregates/grid?dag_run_id=scheduled__2024-02-14T08%3A00%3A00%2B00%3A00&task_id=glam_etl__glam_desktop_beta_aggregates__v1&tab=logs

Comment 3

[Lucia Vargas]

After reverting this PR and a new docker image got published with the recent fixes, this DAG runs successfully.

Task link:
https://workflow.telemetry.mozilla.org/dags/bqetl_glam_refresh_aggregates/grid?dag_run_id=scheduled__2024-02-14T08%3A00%3A00%2B00%3A00&tab=graph