1945460 - Airflow task glam.clients_histogram_bucket_counts failed for 2025-01-30

Status: NEW

(Data Platform and Tools :: General, defect)

Description

[Lucia Vargas]

Airflow task glam.clients_histogram_bucket_counts failed for 2025-01-30

Task link:
https://workflow.telemetry.mozilla.org/dags/glam/grid?task_id=clients_histogram_bucket_counts&tab=logs&dag_run_id=scheduled__2025-01-30T16%3A00%3A00%2B00%3A00

Log extract:

Could not read served logs: HTTPConnectionPool(host='10.20.3.140', port=8793): Max retries exceeded with url: /log/dag_id=glam/run_id=scheduled__2025-01-30T16:00:00+00:00/task_id=clients_histogram_bucket_counts/attempt=1.log (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7ab6e544fb90>, 'Connection to 10.20.3.140 timed out. (connect timeout=5)'))

It seems related to the discussion in the data-platform channel, about an airflow failure where the tasks lost connection to the pods.

Comment 1

[Lucia Vargas]

This failure caused downstream failures in bqetl_glam_export.