1919045 - Airflow task bqetl_firefox_ios.checks__fail_firefox_ios_derived__client_adclicks_history__v1 failed for exec_date 2024-09-15

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[Krzysztof Ignasiak [:kik]]

Airflow task bqetl_firefox_ios.checks__fail_firefox_ios_derived__client_adclicks_history__v1 failed for exec_date 2024-09-15

Task link:
https://workflow.telemetry.mozilla.org/dags/bqetl_firefox_ios/grid?dag_run_id=scheduled__2024-09-15T04%3A00%3A00%2B00%3A00&task_id=checks__fail_firefox_ios_derived__client_adclicks_history__v1

Running the following command:

./bqetl check render firefox_ios_derived.client_adclicks_history_v1

Returns the following SQL data check code:

#fail
WITH non_unique AS (
  SELECT
    COUNT(*) AS total_count
  FROM
    `moz-fx-data-shared-prod.firefox_ios_derived.client_adclicks_history_v1`
  GROUP BY
    client_id
  HAVING
    total_count > 1
)
SELECT
  IF(
    (SELECT COUNT(*) FROM non_unique) > 0,
    ERROR(
      "Duplicates detected (Expected combined set of values for columns ['client_id'] to be unique.)"
    ),
    NULL
  );

#fail
WITH min_row_count AS (
  SELECT
    COUNT(*) AS total_rows
  FROM
    `moz-fx-data-shared-prod.firefox_ios_derived.client_adclicks_history_v1`
)
SELECT
  IF(
    (SELECT COUNTIF(total_rows < 10000) FROM min_row_count) > 0,
    ERROR(
      CONCAT(
        "Min Row Count Error: ",
        (SELECT total_rows FROM min_row_count),
        " rows found, expected more than 10000 rows"
      )
    ),
    NULL
  );

Running this manually it appears all of these SQL statements return no errors.

Comment 1

[Krzysztof Ignasiak [:kik]]

Manually marked the task as success.