1942892 - Airflow task probe_scraper_glean_gecko_dev failed for exec_date 2025-01-21

Status: NEW

(Data Platform and Tools :: General, defect)

Description

[Alekhya Kommasani [:Alekhya]]

probe_scraper is failing at probe_scraper_glean_gecko_dev for 1/21/2025
Task link:
https://workflow.telemetry.mozilla.org/dags/probe_scraper/grid?task_id=probe_scraper_glean_gecko_dev&dag_run_id=scheduled__2025-01-20T00%3A00%3A00%2B00%3A00&tab=logs

[2025-01-21, 01:21:34 UTC] {pod_manager.py:472} INFO - [base] Traceback (most recent call last):
[2025-01-21, 01:21:34 UTC] {pod_manager.py:472} INFO - [base] File "<frozen runpy>", line 198, in _run_module_as_main
[2025-01-21, 01:21:34 UTC] {pod_manager.py:472} INFO - [base] File "<frozen runpy>", line 88, in _run_code
[2025-01-21, 01:21:34 UTC] {pod_manager.py:472} INFO - [base] File "/app/probe_scraper/runner.py", line 906, in <module>
[2025-01-21, 01:21:34 UTC] {pod_manager.py:472} INFO - [base] main(
[2025-01-21, 01:21:34 UTC] {pod_manager.py:472} INFO - [base] File "/app/probe_scraper/runner.py", line 716, in main
[2025-01-21, 01:21:34 UTC] {pod_manager.py:472} INFO - [base] upload_paths += load_glean_metrics(
[2025-01-21, 01:21:34 UTC] {pod_manager.py:472} INFO - [base] ^^^^^^^^^^^^^^^^^^^
[2025-01-21, 01:21:34 UTC] {pod_manager.py:472} INFO - [base] File "/app/probe_scraper/runner.py", line 617, in load_glean_metrics
[2025-01-21, 01:21:34 UTC] {pod_manager.py:472} INFO - [base] raise ValueError("Found duplicate Glean metrics, check email for details")
[2025-01-21, 01:21:34 UTC] {pod_manager.py:490} INFO - [base] ValueError: Found duplicate Glean metrics, check email for details
[2025-01-21, 01:21:34 UTC] {pod.py:554} INFO - Found matching pod probe-scraper-glean-gecko-dev-qyce4gq0 with labels {'airflow_kpo_in_cluster': 'None', 'airflow_version': '2.9.3', 'dag_id': 'probe_scraper', 'kubernetes_pod_operator': 'True', 'run_id': 'scheduled__2025-01-20T0000000000-e057da34a', 'task_id': 'probe_scraper_glean_gecko_dev', 'try_number': '3'}

Comment 1

[Ben Wu [:benwu]]

Should be fixed in the next run with bug 1943037