Closed Bug 2030972 Opened 7 months ago Closed 7 months ago

Airflow task `probe_scraper.probe_scraper_glean_firefox` failed for run `scheduled__2026-04-09T00:00:00+00:00`

Categories

(Data Platform and Tools :: General, defect, P1)

defect

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: benwu, Assigned: chutten)

References

(Regression)

Details

(Keywords: regression, Whiteboard: [airflow-triage])

Attachments

(1 external file)

Airflow task probe_scraper.probe_scraper_glean_firefox failed for run scheduled__2026-04-09T00:00:00+00:00.

Task link:
https://workflow.telemetry.mozilla.org/dags/probe_scraper/grid?dag_run_id=scheduled__2026-04-09T00%3A00%3A00%2B00%3A00&task_id=probe_scraper_glean_firefox

Log extract:

Pulling commits into /app/probe_cache/mozilla-firefox/firefox.git
Traceback (most recent call last):
  File "/app/probe_scraper/scrapers/git_scraper.py", line 387, in retrieve_files
    contents = get_file_at_hash(repo, commit.hash, rel_path)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/app/probe_scraper/scrapers/git_scraper.py", line 256, in get_file_at_hash
    return repo.git.show(f"{_hash}:{filename}")
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/git/cmd.py", line 800, in <lambda>
    return lambda *args, **kwargs: self._call_process(name, *args, **kwargs)
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/git/cmd.py", line 1386, in _call_process
    return self.execute(call, **exec_kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/git/cmd.py", line 1183, in execute
    raise GitCommandError(redacted_command, status, stderr_value, stdout_value)
git.exc.GitCommandError: Cmd('git') failed due to: exit code(128)
  cmdline: git show 34092faf48616f4f9dfc351e9d8176b3ac54c121:services/common/metrics.yaml
  stderr: 'fatal: path 'services/common/metrics.yaml' does not exist in '34092faf48616f4f9dfc351e9d8176b3ac54c121''
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/app/probe_scraper/runner.py", line 906, in <module>
    main(
  File "/app/probe_scraper/runner.py", line 716, in main
    upload_paths += load_glean_metrics(
                    ^^^^^^^^^^^^^^^^^^^
  File "/app/probe_scraper/runner.py", line 408, in load_glean_metrics
    commits_by_repo, emails, upload_repos = git_scraper.scrape(
                                            ^^^^^^^^^^^^^^^^^^^
  File "/app/probe_scraper/scrapers/git_scraper.py", line 476, in scrape
    commits, upload_repo = retrieve_files(
                           ^^^^^^^^^^^^^^^
  File "/app/probe_scraper/scrapers/git_scraper.py", line 390, in retrieve_files
    raise ProbeScraperInvalidRequest(
probe_scraper.exc.ProbeScraperInvalidRequest: services/common/metrics.yaml not found in commit 34092faf48616f4f9dfc351e9d8176b3ac54c121 for gecko

I think it's because services/common/metrics.yaml was moved in https://github.com/mozilla-firefox/firefox/commit/34092faf48616f4f9dfc351e9d8176b3ac54c121 but also reverted in https://github.com/mozilla-firefox/firefox/commit/4679debc428344310f0381dc0124c1b593cacec6.

Schema updates for firefox-desktop are blocked for now

chutten, would this error resolve itself when repositories.yaml gets updated or does something else need to be done?

Flags: needinfo?(chutten)

I'm not 100% about whether it'll solve itself later, so I'm going through and adding in all the skip commits that come up when running python -m probe_scraper.runner --glean --glean-repo glean-core --glean-repo glean-android --glean-repo gecko --glean-repo firefox-desktop-background-update --glean-repo firefox-desktop --glean-repo fenix --dry-run --cache-dir .scraper_cache/ which should unblock us.

Assignee: nobody → chutten
Severity: -- → S2
Status: NEW → ASSIGNED
Flags: needinfo?(chutten)
Priority: -- → P1

I've cleared the task to let it retry. Let's see what happens

It succeeded

Status: ASSIGNED → RESOLVED
Closed: 7 months ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: