Airflow task `probe_scraper.probe_scraper_glean_firefox` failed for run `scheduled__2026-04-09T00:00:00+00:00`
Categories
(Data Platform and Tools :: General, defect, P1)
Tracking
(Not tracked)
People
(Reporter: benwu, Assigned: chutten)
References
(Regression)
Details
(Keywords: regression, Whiteboard: [airflow-triage])
Attachments
(1 external file)
Airflow task probe_scraper.probe_scraper_glean_firefox failed for run scheduled__2026-04-09T00:00:00+00:00.
Log extract:
Pulling commits into /app/probe_cache/mozilla-firefox/firefox.git
Traceback (most recent call last):
File "/app/probe_scraper/scrapers/git_scraper.py", line 387, in retrieve_files
contents = get_file_at_hash(repo, commit.hash, rel_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/probe_scraper/scrapers/git_scraper.py", line 256, in get_file_at_hash
return repo.git.show(f"{_hash}:{filename}")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/git/cmd.py", line 800, in <lambda>
return lambda *args, **kwargs: self._call_process(name, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/git/cmd.py", line 1386, in _call_process
return self.execute(call, **exec_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/git/cmd.py", line 1183, in execute
raise GitCommandError(redacted_command, status, stderr_value, stdout_value)
git.exc.GitCommandError: Cmd('git') failed due to: exit code(128)
cmdline: git show 34092faf48616f4f9dfc351e9d8176b3ac54c121:services/common/metrics.yaml
stderr: 'fatal: path 'services/common/metrics.yaml' does not exist in '34092faf48616f4f9dfc351e9d8176b3ac54c121''
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "/app/probe_scraper/runner.py", line 906, in <module>
main(
File "/app/probe_scraper/runner.py", line 716, in main
upload_paths += load_glean_metrics(
^^^^^^^^^^^^^^^^^^^
File "/app/probe_scraper/runner.py", line 408, in load_glean_metrics
commits_by_repo, emails, upload_repos = git_scraper.scrape(
^^^^^^^^^^^^^^^^^^^
File "/app/probe_scraper/scrapers/git_scraper.py", line 476, in scrape
commits, upload_repo = retrieve_files(
^^^^^^^^^^^^^^^
File "/app/probe_scraper/scrapers/git_scraper.py", line 390, in retrieve_files
raise ProbeScraperInvalidRequest(
probe_scraper.exc.ProbeScraperInvalidRequest: services/common/metrics.yaml not found in commit 34092faf48616f4f9dfc351e9d8176b3ac54c121 for gecko
I think it's because services/common/metrics.yaml was moved in https://github.com/mozilla-firefox/firefox/commit/34092faf48616f4f9dfc351e9d8176b3ac54c121 but also reverted in https://github.com/mozilla-firefox/firefox/commit/4679debc428344310f0381dc0124c1b593cacec6.
Schema updates for firefox-desktop are blocked for now
chutten, would this error resolve itself when repositories.yaml gets updated or does something else need to be done?
| Assignee | ||
Comment 1•7 months ago
|
||
I'm not 100% about whether it'll solve itself later, so I'm going through and adding in all the skip commits that come up when running python -m probe_scraper.runner --glean --glean-repo glean-core --glean-repo glean-android --glean-repo gecko --glean-repo firefox-desktop-background-update --glean-repo firefox-desktop --glean-repo fenix --dry-run --cache-dir .scraper_cache/ which should unblock us.
| Assignee | ||
Comment 2•7 months ago
|
||
| Assignee | ||
Comment 3•7 months ago
|
||
| Assignee | ||
Comment 4•7 months ago
|
||
I've cleared the task to let it retry. Let's see what happens
| Assignee | ||
Comment 5•7 months ago
|
||
It succeeded
Description
•