1963483 - Perma snap mozbuild.repackaging.desktop_file.RemoteVCSError: Missing linuxDesktopEntry.ftl for cy: received HTTP 429 for GET https://raw.githubusercontent.com/mozilla-l10n/firefox-l10n/<...>/cy/browser/browser/linuxDesktopEntry.ftl

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P1)

Description

[Sandor Molnar[:smolnar]]

Push with failures

Failure log

Creating the 'repackage-desktop-file' site at /builds/worker/firefox-snap/parts/firefox/build/.mozbuild/srcdirs/build-0996710f2f4f/_virtualenvs/repackage-desktop-file
[task 2025-04-29T16:13:10.850Z] :: Error running mach:
[task 2025-04-29T16:13:10.850Z] ::
[task 2025-04-29T16:13:10.850Z] ::     mach repackage desktop-file --output /builds/worker/firefox-snap/parts/firefox/install/firefox.desktop --flavor snap --release-product firefox --release-type nightly
[task 2025-04-29T16:13:10.850Z] ::
[task 2025-04-29T16:13:10.850Z] :: The error occurred in code that was called by the mach command. This is either
[task 2025-04-29T16:13:10.850Z] :: a bug in the called code itself or in the way that mach is calling it.
[task 2025-04-29T16:13:10.850Z] :: You can invoke ``./mach busted`` to check if this issue is already on file. If it
[task 2025-04-29T16:13:10.850Z] :: isn't, please use ``./mach busted file repackage`` to report it. If ``./mach busted`` is
[task 2025-04-29T16:13:10.850Z] :: misbehaving, you can also inspect the dependencies of bug 1543241.
[task 2025-04-29T16:13:10.850Z] ::
[task 2025-04-29T16:13:10.850Z] :: If filing a bug, please include the full output of mach, including this error
[task 2025-04-29T16:13:10.850Z] :: message.
[task 2025-04-29T16:13:10.850Z] ::
[task 2025-04-29T16:13:10.850Z] :: The details of the failure are as follows:
[task 2025-04-29T16:13:10.851Z] ::
[task 2025-04-29T16:13:10.851Z] :: mozbuild.repackaging.desktop_file.RemoteVCSError: Missing linuxDesktopEntry.ftl for cy: received HTTP 429 for GET https://raw.githubusercontent.com/mozilla-l10n/firefox-l10n/1f26f0ee295ce9937c8a19dced593845c60b6575/cy/browser/browser/linuxDesktopEntry.ftl
[task 2025-04-29T16:13:10.851Z] ::
[task 2025-04-29T16:13:10.851Z] ::   File "/builds/worker/firefox-snap/parts/firefox/build/python/mozbuild/mozbuild/mach_commands.py", line 3475, in repackage_desktop_file
[task 2025-04-29T16:13:10.851Z] ::     desktop = SnapDesktopFile(
[task 2025-04-29T16:13:10.851Z] ::               ^^^^^^^^^^^^^^^^
[task 2025-04-29T16:13:10.851Z] ::   File "/builds/worker/firefox-snap/parts/firefox/build/python/mozbuild/mozbuild/repackaging/snapcraft_transform.py", line 160, in __init__
[task 2025-04-29T16:13:10.851Z] ::     self.desktop = generate_browser_desktop_entry(
[task 2025-04-29T16:13:10.851Z] ::                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[task 2025-04-29T16:13:10.851Z] ::   File "/builds/worker/firefox-snap/parts/firefox/build/python/mozbuild/mozbuild/repackaging/desktop_file.py", line 50, in generate_browser_desktop_entry
[task 2025-04-29T16:13:10.851Z] ::     localizations = _create_fluent_localizations(
[task 2025-04-29T16:13:10.851Z] ::                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[task 2025-04-29T16:13:10.851Z] ::   File "/builds/worker/firefox-snap/parts/firefox/build/python/mozbuild/mozbuild/repackaging/desktop_file.py", line 124, in _create_fluent_localizations
[task 2025-04-29T16:13:10.851Z] ::     raise RemoteVCSError(mgs.format(**params))
[task 2025-04-29T16:13:10.941Z] 'override-build' in part 'firefox' failed with code 1.
[task 2025-04-29T16:13:10.941Z] Detailed information: 
[task 2025-04-29T16:13:10.941Z] :: + rm -rf /builds/worker/firefox-snap/parts/wasi-sdk//src
[task 2025-04-29T16:13:10.941Z] :: + MACH='/usr/bin/python3 ./mach'
[task 2025-04-29T16:13:10.941Z] :: + /usr/bin/python3 ./mach repackage desktop-file --output /builds/worker/firefox-snap/parts/firefox/install/firefox.desktop --flavor snap --release-product firefox --release-type nightly
[task 2025-04-29T16:13:10.944Z] Recommended resolution: Review the scriptlet and make sure it's correct.
[task 2025-04-29T16:13:10.944Z] For more information, check out: https://canonical-snapcraft.readthedocs-hosted.com/en/8.8.1/reference/plugins.html
[task 2025-04-29T16:13:10.944Z] Full execution log: '/builds/worker/.local/state/snapcraft/log/snapcraft-20250429-160004.954049.log'
[taskcluster 2025-04-29 16:13:13.231Z] === Task Finished ===
[taskcluster 2025-04-29 16:13:13.778Z] Unsuccessful task run with exit code: 1 completed in 1094.13 seconds

Comment 1

[:gerard-majax]

Looks like github was unhappy? I see many reports on the internet at a similar time yesterday

Comment 2

[:gerard-majax]

Green after retries

Comment 3

[Cristian Tuns]

This is still an intermittent issue, can we keep this bug open for classification?

Comment 4

[Intermittent Failures Robot]

19 failures were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 17
• mozilla-central: 2

Table

	no_variant
linux64-snap--/opt	14
linux64-snap--/debug	5

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1963483&startday=2025-04-28&endday=2025-05-04&tree=all

Comment 5

[amarc]

Could you take a look at this recent spike in failures?

Recent failure log -> https://treeherder.mozilla.org/logviewer?job_id=508573812&repo=autoland

Comment 6

[:gerard-majax]

that's github, nothing i can do

Comment 7

[:gerard-majax]

github status reports some outage at the times that https://treeherder.mozilla.org/intermittent-failures/bugdetails?startday=2025-05-09&endday=2025-05-16&tree=all&failurehash=all&bug=1963483 shows spike

Comment 8

[Julien Cristau [:jcristau]]

429 means we're hitting rate limits.
https://github.blog/changelog/2025-05-08-updated-rate-limits-for-unauthenticated-requests/ probably doesn't help.

Comment 9

[Johan Lorenzo [:jlorenzo]]

Bug 1824327 introduced _create_fluent_localizations() and at that time, it fetched strings from hg.mozilla.org[1]. Bug 1900421 switched the repo to its GitHub equivalent. Given that repo is public, we didn't require any authentication.

As :jcristau said in comment 8, the root cause is the new GitHub policy for unauthenticated requests. I understand the fix is to make _create_fluent_localizations() use authenticated requests.

[1] https://hg-edge.mozilla.org/mozilla-central/rev/f9bda84dbaf72d3e41b8aeed9277a47baa3bdf33#l14.184

Comment 10

[Intermittent Failures Robot]

32 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 25
• mozilla-central: 7

Table

	no_variant
linux-x86/debug	12
linux-x86/opt	20

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1963483&startday=2025-05-16&endday=2025-05-16&tree=all

Comment 11

[amarc]

Tier 1 Rpk failure here: https://treeherder.mozilla.org/logviewer?job_id=508881438&repo=mozilla-central&lineNumber=429

Comment 12

[Intermittent Failures Robot]

34 failures were associated with this bug yesterday.

Repository breakdown:

• autoland: 18
• mozilla-central: 16

Table

	no_variant
linux-x86/debug	16
linux-x86/opt	16
linux64-aarch64/opt	2

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1963483&startday=2025-05-17&endday=2025-05-17&tree=all

Comment 13

[Intermittent Failures Robot]

87 failures were associated with this bug in the last 7 days.
This is the #8 most frequent failure this week.

This failure happened more than 75 times this week! Resolving this bug is a very high priority.

Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled.

Repository breakdown:

• mozilla-beta: 2
• mozilla-central: 30
• autoland: 55

Table

	no_variant
linux-x86/debug	33
linux-x86/opt	48
linux64-aarch64/opt	3
linux64-x86/asan	1
linux64-x86/opt	1
linux64/opt-x86/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1963483&startday=2025-05-12&endday=2025-05-18&tree=all

Comment 14

[Intermittent Failures Robot]

19 failures were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 6
• autoland: 13

Table

	no_variant
linux-x86/debug	8
linux-x86/opt	9
linux64-aarch64/opt	1
linux64/opt-x86/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1963483&startday=2025-05-20&endday=2025-05-20&tree=all

Comment 15

[:gerard-majax]

Full repo is ~1GB. I'm not sure we want to clone that much?

Comment 16

[:gerard-majax]

Attachment: Bug 1963483 - Use git clone instead of raw download for l10n sourcing when producing .desktop file r?#releng-reviewers!

Comment 17

[:gerard-majax]

a try but maybe not the most complete one we would want: https://treeherder.mozilla.org/jobs?repo=try&revision=261d0240b113dfae10aa027d31d209ccaaefcd65

Comment 18

[Intermittent Failures Robot]

28 failures were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 7
• autoland: 21

Table

	no_variant
linux-x86/debug	10
linux-x86/opt	16
linux64-aarch64/opt	1
linux64/opt-x86/opt	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1963483&startday=2025-05-19&endday=2025-05-25&tree=all

Comment 19

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/56b1564a4a4d
Use git clone instead of raw download for l10n sourcing when producing .desktop file r=releng-reviewers,ahal,bhearsum

Comment 20

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/d7444b81c07c
Revert "Bug 1963483 - Use git clone instead of raw download for l10n sourcing when producing .desktop file r=releng-reviewers,ahal,bhearsum" for causing py3 failures @ test_deb.py

Comment 21

[amarc]

Backed out for causing py3 failures @ test_deb.py

• Backout link
• Push with failures
• Failure Log

Comment 22

[Pulsebot]

Pushed by [e-mail]:
https://github.com/mozilla-firefox/firefox/commit/0e5fc7751588
https://hg.mozilla.org/integration/autoland/rev/be6674e3541f
Use git clone instead of raw download for l10n sourcing when producing .desktop file r=releng-reviewers,ahal,bhearsum

Comment 23

[Cristina Horotan [:chorotan]]

https://hg.mozilla.org/mozilla-central/rev/be6674e3541f

Comment 24

[Intermittent Failures Robot]

1 failures were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 1

Table

	no_variant
linux-x86/debug	1

For more details, see:

https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1963483&startday=2025-05-26&endday=2025-06-01&tree=all