Closed Bug 1923915 Opened 1 year ago Closed 1 year ago

Airflow task bqetl_newtab.telemetry_derived__newtab_visits__v1 failed for exec_date 2024-10-10

Categories

(Data Platform and Tools :: General, defect)

Product:
Data Platform and Tools
Component:
General
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: mwilliams, Unassigned)

Details

(Whiteboard: [airflow-triage])

Airflow task bqetl_newtab.telemetry_derived__newtab_visits__v1 failed for exec_date 2024-10-10

Task link:
https://workflow.telemetry.mozilla.org/dags/bqetl_newtab/grid?dag_run_id=scheduled__2024-10-09T00%3A00%3A00%2B00%3A00&task_id=telemetry_derived__newtab_visits__v1&tab=logs

Log extract:

[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base] Error in query string: Error processing job 'moz-fx-data-shared-
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base] prod:bqjob_r5e7a9420b815bccd_0000019274ed392e_1': Bad int64 value:
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base] 1.0000019073486328
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base] Traceback (most recent call last):
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]   File "<string>", line 1, in <module>
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]   File "/app/bigquery_etl/cli/__init__.py", line 78, in cli
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]     group(prog_name=prog_name)
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]   File "/usr/local/lib/python3.11/site-packages/rich_click/rich_command.py", line 367, in __call__
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]     return super().__call__(*args, **kwargs)
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]   File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1157, in __call__
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]     return self.main(*args, **kwargs)
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]            ^^^^^^^^^^^^^^^^^^^^^^^^^^
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]   File "/usr/local/lib/python3.11/site-packages/rich_click/rich_command.py", line 152, in main
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]     rv = self.invoke(ctx)
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]          ^^^^^^^^^^^^^^^^
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]   File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1688, in invoke
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]     return _process_result(sub_ctx.command.invoke(sub_ctx))
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]   File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1688, in invoke
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]     return _process_result(sub_ctx.command.invoke(sub_ctx))
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]   File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]     return ctx.invoke(self.callback, **ctx.params)
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]   File "/usr/local/lib/python3.11/site-packages/click/core.py", line 783, in invoke
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]     return __callback(*args, **kwargs)
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]   File "/usr/local/lib/python3.11/site-packages/click/decorators.py", line 33, in new_func
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]     return f(get_current_context(), *args, **kwargs)
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]   File "/app/bigquery_etl/cli/query.py", line 895, in run
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]     _run_query(
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]   File "/app/bigquery_etl/cli/query.py", line 1040, in _run_query
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]     subprocess.check_call(["bq"] + query_arguments, stdin=query_stream)
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]   File "/usr/local/lib/python3.11/subprocess.py", line 413, in check_call
[2024-10-10, 05:36:33 UTC] {pod_manager.py:472} INFO - [base]     raise CalledProcessError(retcode, cmd)
[2024-10-10, 05:36:34 UTC] {pod_manager.py:490} INFO - [base] subprocess.CalledProcessError: Command '['bq', 'query', '--parameter=submission_date:DATE:2024-10-09', '--project_id=moz-fx-data-shared-prod', '--destination_table=newtab_visits_v1$20241009', '--use_legacy_sql=False', '--dataset_id=telemetry_derived']' returned non-zero exit status 1.

Fixed by this PR (https://github.com/mozilla/bigquery-etl/pull/6327). Task cleared and ran successfully.

Status: NEW → RESOLVED
Closed: 1 year ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.