1876789 - Airflow task bqetl_analytics_aggregations.checks__fail_telemetry_derived__active_users_agg failed for exec_date 2024-01-26

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[Anna Scholtz [:ascholtz]]

Airflow task bqetl_analytics_aggregations.checks__fail_telemetry_derived__active_users_agg failed for exec_date 2024-01-26

Task link:
https://workflow.telemetry.mozilla.org/dags/bqetl_analytics_aggregations/grid?tab=logs&dag_run_id=scheduled__2024-01-25T04%3A15%3A00%2B00%3A00&task_id=checks__fail_telemetry_derived__active_users_aggregates__v1

Log extract:

The row count for partition 2024-01-25 is outside of the expected boundaries

Comment 1

[Lucia Vargas]

This seems related to this change https://github.com/mozilla/bigquery-etl/commit/f84a09752417abb237ce0d54022a2abe96e252e6
Since telemetry_derived.active_users_aggregates_v1 is deprecated the checks on this table wouldn't be required.

Comment 2

[Krzysztof Ignasiak [:kik]]

Hey :lvargas,

Thanks for the update, removing the checks via: https://github.com/mozilla/bigquery-etl/pull/4910
Please kindly review and approve it.

Could you please confirm if this table should be added to this list? https://mozilla-hub.atlassian.net/browse/DENG-668

This epic contains a list of tables which we want to put through the deprecation process. Take it from changing the deprecation label to removing of the query logic and deleting the table in BQ.

Thanks!

Comment 3

[Lucia Vargas]

Approved, thank you.
I think the table should be added to the list if the deprecated label added in this PR isn't enough.

Comment 4

[Krzysztof Ignasiak [:kik]]

:lvargas, if this table is no longer intended to be used and we do not need the table / data then we should add it to that list.

Also, marking this issue as resolved as the PR to remove the checks has just been merged.

Comment 5

[Lucia Vargas]

The failing tasks in Airflow for Jan 26-27-28, 2024 were marked as successful.