1866900 - Airflow task bqetl_backfill.bqetl_backfill failed for exec_date 2023-11-20

Status: RESOLVED WORKSFORME

(Data Platform and Tools :: General, defect)

Description

[Mike Williams [:mwilliams]]

Airflow task bqetl_backfill.bqetl_backfill failed for exec_date 2023-11-20

Task link:
https://workflow.telemetry.mozilla.org/dags/bqetl_backfill/grid?dag_run_id=manual__2023-11-20T22%3A09%3A21%2B00%3A00&task_id=bqetl_backfill&tab=logs

Log extract:

[2023-11-20, 22:11:21 UTC] {pod_manager.py:187} WARNING - Pod not yet started: bqetl-backfill-4b0m2qwe
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO - Traceback (most recent call last):
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -   File "/usr/local/bin/bqetl", line 8, in <module>
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -     sys.exit(cli())
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -   File "/usr/local/lib/python3.10/site-packages/bigquery_etl/cli/__init__.py", line 76, in cli
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -     group(prog_name=prog_name)
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -     return self.main(*args, **kwargs)
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1078, in main
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -     rv = self.invoke(ctx)
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -     return _process_result(sub_ctx.command.invoke(sub_ctx))
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -     return _process_result(sub_ctx.command.invoke(sub_ctx))
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -     return ctx.invoke(self.callback, **ctx.params)
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -   File "/usr/local/lib/python3.10/site-packages/click/core.py", line 783, in invoke
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -     return __callback(*args, **kwargs)
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -   File "/usr/local/lib/python3.10/site-packages/click/decorators.py", line 33, in new_func
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -     return f(get_current_context(), *args, **kwargs)
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -   File "/usr/local/lib/python3.10/site-packages/bigquery_etl/cli/query.py", line 725, in backfill
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO -     partitioning_type = metadata.bigquery.time_partitioning.type
[2023-11-20, 22:11:23 UTC] {pod_manager.py:235} INFO - AttributeError: 'NoneType' object has no attribute 'type'