Closed Bug 1824002 Opened 2 years ago Closed 2 years ago

Airflow task bqetl_mdn_yari.mdn_yari_derived__mdn_popularities__v1 failed for exec_date 2023-03-22

Categories

(Data Platform and Tools :: General, defect)

Product:
Data Platform and Tools
Component:
General
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: relud, Assigned: claas)

Details

(Whiteboard: [airflow-triage])

Airflow task bqetl_mdn_yari.mdn_yari_derived__mdn_popularities__v1 failed for exec_date 2023-03-22

Task link:
https://workflow.telemetry.mozilla.org/log?dag_id=bqetl_mdn_yari&task_id=mdn_yari_derived__mdn_popularities__v1&execution_date=2023-03-21T17%3A24%3A36.331524%2B00%3A00

Log extract:

Traceback (most recent call last):
  File "/app/sql/moz-fx-data-shared-prod/mdn_yari_derived/mdn_popularities_v1/query.py", line 94, in <module>
    main()
  File "/app/sql/moz-fx-data-shared-prod/mdn_yari_derived/mdn_popularities_v1/query.py", line 91, in main
    bucket.copy_blob(blob, args.destination_bucket, current_file_path)
  File "/usr/local/lib/python3.10/site-packages/google/cloud/storage/bucket.py", line 1950, in copy_blob
    api_path = blob.path + "/copyTo" + new_blob.path
AttributeError: 'NoneType' object has no attribute 'path'

:claas was able to solve this via https://github.com/mozilla/bigquery-etl/pull/3677 and some IAM changes. The most recent run ran successfully

Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
Assignee: nobody → caugner
You need to log in before you can comment on or make changes to this bug.