1845941 - Airflow task prerelease_telemetry_aggregates.mozaggregator2bq_extract failed for exec_date 2023-07-28

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[anicholson]

Airflow task prerelease_telemetry_aggregates.mozaggregator2bq_extract failed for exec_date 2023-07-28

Task link:
https://workflow.telemetry.mozilla.org/dags/prerelease_telemetry_aggregates/grid?dag_run_id=scheduled__2023-07-27T00%3A00%3A00%2B00%3A00&task_id=mozaggregator2bq_extract

Log extract:

[2023-07-28, 13:41:27 UTC] {pod_manager.py:235} INFO - Caught non-retryable exception while listing gs://mozaggregator2bq/data/submission_date/20230727/: BucketNotFoundException: 404 gs://mozaggregator2bq bucket does not exist.
[2023-07-28, 13:41:27 UTC] {pod_manager.py:235} INFO - CommandException: Caught non-retryable exception - aborting rsync

Comment 1

[Eduardo Filho [:efilho]]

Updated the bucket name config and the task is running and saved some results on the right bucket. This run is being used to backfill aggregates from AWS to BQ and after it finishes the task will be decommissioned.