1875023 - Airflow task bqetl_unified.checks__warn_telemetry_derived__unified_metrics__v1 failed for exec_date 2024-01-17

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[Arkadiusz Komarzewski [:akomar]]

Airflow task bqetl_unified.checks__warn_telemetry_derived__unified_metrics__v1 failed for exec_date 2024-01-17

Task link:
https://workflow.telemetry.mozilla.org/dags/bqetl_unified/grid?tab=code&dag_run_id=scheduled__2024-01-16T03%3A00%3A00%2B00%3A00&task_id=checks__warn_telemetry_derived__unified_metrics__v1

Log extract:

[2024-01-17, 03:19:29 UTC] {pod_manager.py:450} INFO - [base] Error in query string: Error processing job 'moz-fx-data-shared- prod:bqjob_r290889e8afaf5fb0_0000018d156e05ae_1': Columns with NULL values: normalized_os

Comment 1

[Krzysztof Ignasiak [:kik]]

Looks like there's only one client will a null value in this field: f08f8db2-0da6-486b-a301-bf753b1f8f31.

Looks like in the entire partition for this date (2024-01-16) inside telemetry_stable.main_v5 this is the only entry where this value is null:

SELECT
  COUNT(*),
FROM
  telemetry_stable.main_v5
WHERE DATE(submission_timestamp) = "2024-01-16"
AND normalized_os_version IS NULL

Yields: 1

This seems to be matching with the live table.

At this point, I'll consider this a one off and mark the task as successful with a note.