1890336 - Airflow task bqetl_nondesktop.wait_for_org_mozilla_focus_derived__baseline_clients_last_seen__v1 & wait_for_org_mozilla_reference_browser_derived__baseline_clients_last_seen__v1 failed for exec_date 2024-04-08

Status: RESOLVED FIXED

(Data Platform and Tools :: General, defect)

Description

[Katie Windau]

Airflow task bqetl_nondesktop.wait_for_org_mozilla_focus_derived__baseline_clients_last_seen__v1 & wait_for_org_mozilla_reference_browser_derived__baseline_clients_last_seen__v1 failed for exec_date 2024-04-08

Task link:
https://workflow.telemetry.mozilla.org/dags/bqetl_nondesktop/grid?dag_run_id=scheduled__2024-04-07T03%3A00%3A00%2B00%3A00

Log extract:

*** Found remote logs:
***   * gs://airflow-remote-logs-prod-prod/dag_id=bqetl_nondesktop/run_id=scheduled__2024-04-07T03:00:00+00:00/task_id=wait_for_org_mozilla_focus_derived__baseline_clients_last_seen__v1/attempt=2.log
[2024-04-08, 05:12:01 UTC] {taskinstance.py:1979} INFO - Dependencies all met for dep_context=non-requeueable deps ti=<TaskInstance: bqetl_nondesktop.wait_for_org_mozilla_focus_derived__baseline_clients_last_seen__v1 scheduled__2024-04-07T03:00:00+00:00 [queued]>
[2024-04-08, 05:12:01 UTC] {taskinstance.py:1979} INFO - Dependencies all met for dep_context=requeueable deps ti=<TaskInstance: bqetl_nondesktop.wait_for_org_mozilla_focus_derived__baseline_clients_last_seen__v1 scheduled__2024-04-07T03:00:00+00:00 [queued]>
[2024-04-08, 05:12:01 UTC] {taskinstance.py:2193} INFO - Starting attempt 2 of 2
[2024-04-08, 05:12:01 UTC] {taskinstance.py:2214} INFO - Executing <Task(ExternalTaskSensor): wait_for_org_mozilla_focus_derived__baseline_clients_last_seen__v1> on 2024-04-07 03:00:00+00:00
[2024-04-08, 05:12:01 UTC] {standard_task_runner.py:60} INFO - Started process 872433 to run task
[2024-04-08, 05:12:01 UTC] {standard_task_runner.py:87} INFO - Running: ['airflow', 'tasks', 'run', 'bqetl_nondesktop', 'wait_for_org_mozilla_focus_derived__baseline_clients_last_seen__v1', 'scheduled__2024-04-07T03:00:00+00:00', '--job-id', '4378991', '--raw', '--subdir', 'DAGS_FOLDER/bigquery-etl/dags/bqetl_nondesktop.py', '--cfg-path', '/tmp/tmporh5c0g9']
[2024-04-08, 05:12:01 UTC] {standard_task_runner.py:88} INFO - Job 4378991: Subtask wait_for_org_mozilla_focus_derived__baseline_clients_last_seen__v1
[2024-04-08, 05:12:01 UTC] {task_command.py:423} INFO - Running <TaskInstance: bqetl_nondesktop.wait_for_org_mozilla_focus_derived__baseline_clients_last_seen__v1 scheduled__2024-04-07T03:00:00+00:00 [running]> on host 10.20.2.144
[2024-04-08, 05:12:01 UTC] {taskinstance.py:2510} INFO - Exporting env vars: AIRFLOW_CTX_DAG_EMAIL='[e-mail]' AIRFLOW_CTX_DAG_OWNER='[e-mail]' AIRFLOW_CTX_DAG_ID='bqetl_nondesktop' AIRFLOW_CTX_TASK_ID='wait_for_org_mozilla_focus_derived__baseline_clients_last_seen__v1' AIRFLOW_CTX_EXECUTION_DATE='2024-04-07T03:00:00+00:00' AIRFLOW_CTX_TRY_NUMBER='2' AIRFLOW_CTX_DAG_RUN_ID='scheduled__2024-04-07T03:00:00+00:00'
[2024-04-08, 05:12:01 UTC] {external_task.py:244} INFO - Poking for tasks ['focus_android.org_mozilla_focus_derived__baseline_clients_last_seen__v1'] in dag bqetl_glean_usage on 2024-04-07T02:00:00+00:00 ... 
[2024-04-08, 05:12:01 UTC] {dagbag.py:540} INFO - Filling up the DagBag from /opt/airflow/dags/repo/bigquery-etl/dags/bqetl_glean_usage.py
[2024-04-08, 05:12:01 UTC] {taskinstance.py:2728} ERROR - Task failed with exception
Traceback (most recent call last):
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/models/taskinstance.py", line 444, in _execute_task
    result = _execute_callable(context=context, **execute_callable_kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/models/taskinstance.py", line 414, in _execute_callable
    return execute_callable(context=context, **execute_callable_kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/sensors/external_task.py", line 334, in execute
    super().execute(context)
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/sensors/base.py", line 265, in execute
    raise e
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/sensors/base.py", line 247, in execute
    poke_return = self.poke(context)
                  ^^^^^^^^^^^^^^^^^^
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/utils/session.py", line 79, in wrapper
    return func(*args, session=session, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/sensors/external_task.py", line 282, in poke
    raise AirflowException(
airflow.exceptions.AirflowException: Some of the external tasks ['focus_android.org_mozilla_focus_derived__baseline_clients_last_seen__v1'] in DAG bqetl_glean_usage failed.
[2024-04-08, 05:12:01 UTC] {taskinstance.py:1149} INFO - Marking task as FAILED. dag_id=bqetl_nondesktop, task_id=wait_for_org_mozilla_focus_derived__baseline_clients_last_seen__v1, execution_date=20240407T030000, start_date=20240408T051201, end_date=20240408T051201
[2024-04-08, 05:12:01 UTC] {warnings.py:110} WARNING - /home/airflow/.local/lib/python3.11/site-packages/airflow/utils/email.py:154: RemovedInAirflow3Warning: Fetching SMTP credentials from configuration variables will be deprecated in a future release. Please set credentials using a connection instead.
  send_mime_email(e_from=mail_from, e_to=recipients, mime_msg=msg, conn_id=conn_id, dryrun=dryrun)
[2024-04-08, 05:12:01 UTC] {email.py:270} INFO - Email alerting: attempt 1
[2024-04-08, 05:12:02 UTC] {email.py:281} INFO - Sent an alert email to ['[e-mail]']
[2024-04-08, 05:12:02 UTC] {standard_task_runner.py:107} ERROR - Failed to execute job 4378991 for task wait_for_org_mozilla_focus_derived__baseline_clients_last_seen__v1 (Some of the external tasks ['focus_android.org_mozilla_focus_derived__baseline_clients_last_seen__v1'] in DAG bqetl_glean_usage failed.; 872433)
[2024-04-08, 05:12:02 UTC] {local_task_job_runner.py:234} INFO - Task exited with return code 1
[2024-04-08, 05:12:02 UTC] {taskinstance.py:3309} INFO - 0 downstream tasks scheduled from follow-on schedule check