Closed Bug 1919046 Opened 1 year ago Closed 8 months ago

Airflow task glam.client_scalar_probe_counts failing since exec_date 2024-09-13

Categories

(Data Platform and Tools :: General, defect)

Product:
Data Platform and Tools
Component:
General
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED WORKSFORME

People

(Reporter: kik, Assigned: efilho)

Details

(Whiteboard: [airflow-triage])

Airflow task glam.client_scalar_probe_counts failing since exec_date 2024-09-13

Task link:
https://workflow.telemetry.mozilla.org/dags/glam/grid?dag_run_id=scheduled__2024-09-13T16%3A00%3A00%2B00%3A00&task_id=client_scalar_probe_counts

Log extract:

[2024-09-16, 08:50:35 UTC] {pod_manager.py:466} INFO - [base] google.api_core.exceptions.InternalServerError: 500 Operation timed out after 6.0 hours. Consider reducing the amount of work performed by your operation so that it can complete within this limit.; reason: timeout, message: Operation timed out after 6.0 hours. Consider reducing the amount of work performed by your operation so that it can complete within this limit.
[2024-09-16, 08:50:35 UTC] {pod_manager.py:466} INFO - [base] Location: US
[2024-09-16, 08:50:35 UTC] {pod_manager.py:483} INFO - [base] Job ID: 6b618fd9-98bb-48d9-be27-9bd0dc9dcfb2

This also blocks the following DAGs:

  • glam_glean_imports
  • bqetl_glam_export
  • bqetl_glam_refresh_aggregates
Status: NEW → RESOLVED
Closed: 8 months ago
Resolution: --- → WORKSFORME
You need to log in before you can comment on or make changes to this bug.