1862945 - Airflow task dim_active_users_aggregates_mobile.fenix_active_users_aggregates_dim_check failed for exec_date 2023-11-03

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[Lucia Vargas]

Attachment: image.png

Airflow task dim_active_users_aggregates_mobile.fenix_active_users_aggregates_dim_check failed for exec_date 2023-11-03.
This is a blocker for the KPI dashboard (see image attached)

All the dim_checks are not running as scheduled and remain in state up_for_reschedule:
fenix_active_users_aggregates_dim_check
focus_android_active_users_aggregates_dim_check
firefox_ios_active_users_aggregates_dim_check
focus_ios_active_users_aggregates_dim_check
klar_ios_active_users_aggregates_dim_check

Task link for the dim_check tasks:
https://workflow.telemetry.mozilla.org/dags/dim_active_users_aggregates_mobile/grid?dag_run_id=scheduled__2023-11-02T04%3A30%3A00%2B00%3A00&task_id=fenix_active_users_aggregates_dim_check&tab=logs
See also attached image.

Task link for the wait_for tasks:
https://workflow.telemetry.mozilla.org/dags/dim_active_users_aggregates_mobile/grid?dag_run_id=scheduled__2023-11-02T04%3A30%3A00%2B00%3A00&task_id=wait_for_fenix&tab=logs

Log extract for the dim_check tasks:

*** No logs found in GCS; ti=%s <TaskInstance: dim_active_users_aggregates_mobile.fenix_active_users_aggregates_dim_check scheduled__2023-11-02T04:30:00+00:00 [None]>

Comment 1

[Lucia Vargas]

Attachment: kpoi_dashboard.png

Comment 2

[Lucia Vargas]

Attachment: dim_run_2023-11-07.png

Comment 3

[Lucia Vargas]

The problem persists today (2023-11-07), still blocking kpi_forecast :(

Link to the dim_check task

Link to the kpi_dashboard task

Comment 4

[Krzysztof Ignasiak [:kik]]

Waiting for PR to be approved which as far as I understand should address this issue detecting upstream task completion:
https://github.com/mozilla/telemetry-airflow/pull/1846

Comment 5

[Krzysztof Ignasiak [:kik]]

This issue has been resolved and tasks now correctly detect upstream dependencies.