1745241 - Airflow task bqetl_main_summary.client_probe_processes__v1 failing on 2021-12-09

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[William Lachance (:wlach)]

The Airflow task bqetl_main_summary.client_probe_processes__v1 failed on 2021-12-09.

https://workflow.telemetry.mozilla.org/log?dag_id=bqetl_main_summary&task_id=client_probe_processes__v1&execution_date=2021-12-08T02%3A00%3A00%2B00%3A00

Relevant snippit:

[2021-12-09 03:00:49,713] {{pod_launcher.py:149}} INFO - BigQuery error in query operation: Error processing job 'moz-fx-data-shared-
[2021-12-09 03:00:49,714] {{pod_launcher.py:149}} INFO - prod:bqjob_r6dee56548ef49f51_0000017d9d22e3cc_1': Partitioning specification
[2021-12-09 03:00:49,714] {{pod_launcher.py:149}} INFO - must be provided in order to create partitioned table
[2021-12-09 03:00:49,890] {{pod_launcher.py:149}} INFO - Traceback (most recent call last):
[2021-12-09 03:00:49,890] {{pod_launcher.py:149}} INFO -   File "/usr/local/lib/python3.8/runpy.py", line 194, in _run_module_as_main
[2021-12-09 03:00:49,891] {{pod_launcher.py:149}} INFO -     return _run_code(code, main_globals, None,
[2021-12-09 03:00:49,891] {{pod_launcher.py:149}} INFO -   File "/usr/local/lib/python3.8/runpy.py", line 87, in _run_code
[2021-12-09 03:00:49,891] {{pod_launcher.py:149}} INFO -     exec(code, run_globals)
[2021-12-09 03:00:49,891] {{pod_launcher.py:149}} INFO -   File "/app/bigquery_etl/run_query.py", line 107, in <module>
[2021-12-09 03:00:49,891] {{pod_launcher.py:149}} INFO -     main()
[2021-12-09 03:00:49,891] {{pod_launcher.py:149}} INFO -   File "/app/bigquery_etl/run_query.py", line 97, in main
[2021-12-09 03:00:49,892] {{pod_launcher.py:149}} INFO -     run(
[2021-12-09 03:00:49,892] {{pod_launcher.py:149}} INFO -   File "/app/bigquery_etl/run_query.py", line 91, in run
[2021-12-09 03:00:49,892] {{pod_launcher.py:149}} INFO -     subprocess.check_call(["bq"] + query_arguments, stdin=query_stream)
[2021-12-09 03:00:49,892] {{pod_launcher.py:149}} INFO -   File "/usr/local/lib/python3.8/subprocess.py", line 364, in check_call
[2021-12-09 03:00:49,892] {{pod_launcher.py:149}} INFO -     raise CalledProcessError(retcode, cmd)

Comment 1

[GitHub Bugzilla PR Linker]

Attachment: Link to GitHub pull-request: https://github.com/mozilla/bigquery-etl/pull/2564