1831988 - Perma Localized Debian Repacks Linux shippable Halting on failure while running ['/builds/worker/workspace/obj-build/_virtualenvs/common/bin/python', 'mach', '--log-no-times', 'repackage', 'deb-l10n', '--version', '115.0a1', '--build-number', '1', '--inpu

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P1)

Description

[Treeherder Bug Filer]

Filed by: imoraru [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=415005923&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/HrL8y5KyTteEEt3WYPFTLA/runs/0/artifacts/public/logs/live_backing.log

---

[task 2023-05-08T23:25:48.435Z] 23:25:48     INFO -  '_': '/builds/worker/checkouts/gecko/mach'}
[task 2023-05-08T23:26:03.518Z] 23:26:03     INFO -  dpkg-buildpackage: source package firefox-nightly-l10n-szl
[task 2023-05-08T23:26:03.518Z] 23:26:03     INFO -  dpkg-buildpackage: source version 115.0a1~20230508214159
[task 2023-05-08T23:26:03.518Z] 23:26:03     INFO -  dpkg-buildpackage: source distribution UNRELEASED
[task 2023-05-08T23:26:03.518Z] 23:26:03     INFO -  dpkg-buildpackage: source changed by Mozilla Releng <[e-mail]>
[task 2023-05-08T23:26:03.546Z] 23:26:03     INFO -  dpkg-buildpackage: warning: debian/rules is not executable; fixing that
[task 2023-05-08T23:26:03.546Z] 23:26:03     INFO -   dpkg-source --before-build source
[task 2023-05-08T23:26:03.546Z] 23:26:03     INFO -  dpkg-buildpackage: host architecture amd64
[task 2023-05-08T23:26:03.735Z] 23:26:03     INFO -   debian/rules clean
[task 2023-05-08T23:26:03.737Z] 23:26:03     INFO -  dh clean
[task 2023-05-08T23:26:03.784Z] 23:26:03     INFO -     dh_testdir
[task 2023-05-08T23:26:03.794Z] 23:26:03     INFO -     dh_auto_clean
[task 2023-05-08T23:26:03.845Z] 23:26:03     INFO -     dh_clean
[task 2023-05-08T23:26:03.867Z] 23:26:03     INFO -   debian/rules build
[task 2023-05-08T23:26:03.868Z] 23:26:03     INFO -  dh build
[task 2023-05-08T23:26:03.915Z] 23:26:03     INFO -     dh_testdir
[task 2023-05-08T23:26:03.925Z] 23:26:03     INFO -     dh_auto_configure
[task 2023-05-08T23:26:03.976Z] 23:26:03     INFO -     dh_auto_build
[task 2023-05-08T23:26:04.028Z] 23:26:04     INFO -     dh_auto_test
[task 2023-05-08T23:26:04.081Z] 23:26:04     INFO -   debian/rules binary
[task 2023-05-08T23:26:04.083Z] 23:26:04     INFO -  dh binary
[task 2023-05-08T23:26:04.129Z] 23:26:04     INFO -     dh_testroot
[task 2023-05-08T23:26:04.139Z] 23:26:04     INFO -     dh_prep
[task 2023-05-08T23:26:04.152Z] 23:26:04     INFO -     dh_auto_install
[task 2023-05-08T23:26:04.206Z] 23:26:04     INFO -     dh_install
[task 2023-05-08T23:26:04.231Z] 23:26:04     INFO -  cp: cannot stat ‘debian/tmp/debian/firefox-nightly-l10n-szl.desktop’: No such file or directory
[task 2023-05-08T23:26:04.231Z] 23:26:04     INFO -  dh_install: cp -a debian/tmp/debian/firefox-nightly-l10n-szl.desktop debian/firefox-nightly-l10n-szl/usr/share/applications/ returned exit code 1
[task 2023-05-08T23:26:04.233Z] 23:26:04     INFO -  debian/rules:4: recipe for target 'binary' failed
[task 2023-05-08T23:26:04.233Z] 23:26:04     INFO -  make: *** [binary] Error 2
[task 2023-05-08T23:26:04.234Z] 23:26:04     INFO -  dpkg-buildpackage: error: debian/rules binary gave error exit status 2
[task 2023-05-08T23:26:04.238Z] 23:26:04     INFO -  Error running mach:
[task 2023-05-08T23:26:04.239Z] 23:26:04     INFO -      ['--log-no-times', 'repackage', 'deb-l10n', '--version', '115.0a1', '--build-number', '1', '--input-tar-file', '/builds/worker/fetches/target.tar.bz2', '--input-xpi-file', '/builds/worker/fetches/target.langpack.xpi', '--output', '/builds/worker/workspace/outputs/szl/target.langpack.deb']
[task 2023-05-08T23:26:04.239Z] 23:26:04     INFO -  The error occurred in code that was called by the mach command. This is either
[task 2023-05-08T23:26:04.239Z] 23:26:04     INFO -  a bug in the called code itself or in the way that mach is calling it.
[task 2023-05-08T23:26:04.239Z] 23:26:04     INFO -  You can invoke ``./mach busted`` to check if this issue is already on file. If it
[task 2023-05-08T23:26:04.239Z] 23:26:04     INFO -  isn't, please use ``./mach busted file repackage`` to report it. If ``./mach busted`` is
[task 2023-05-08T23:26:04.239Z] 23:26:04     INFO -  misbehaving, you can also inspect the dependencies of bug 1543241.
[task 2023-05-08T23:26:04.239Z] 23:26:04     INFO -  If filing a bug, please include the full output of mach, including this error
[task 2023-05-08T23:26:04.239Z] 23:26:04     INFO -  message.
[task 2023-05-08T23:26:04.239Z] 23:26:04     INFO -  The details of the failure are as follows:
[task 2023-05-08T23:26:04.240Z] 23:26:04     INFO -  subprocess.CalledProcessError: Command '['chroot', '/srv/jessie-amd64', 'bash', '-c', 'cd /tmp/*/source; dpkg-buildpackage -us -uc -b']' returned non-zero exit status 2.
[task 2023-05-08T23:26:04.240Z] 23:26:04     INFO -    File "/builds/worker/checkouts/gecko/python/mozbuild/mozbuild/mach_commands.py", line 2375, in repackage_deb_l10n
[task 2023-05-08T23:26:04.240Z] 23:26:04     INFO -      repackage_deb_l10n(
[task 2023-05-08T23:26:04.240Z] 23:26:04     INFO -    File "/builds/worker/checkouts/gecko/python/mozbuild/mozbuild/repackaging/deb.py", line 152, in repackage_deb_l10n
[task 2023-05-08T23:26:04.240Z] 23:26:04     INFO -      _generate_deb_archive(
[task 2023-05-08T23:26:04.240Z] 23:26:04     INFO -    File "/builds/worker/checkouts/gecko/python/mozbuild/mozbuild/repackaging/deb.py", line 627, in _generate_deb_archive
[task 2023-05-08T23:26:04.240Z] 23:26:04     INFO -      subprocess.check_call(command, cwd=source_dir)
[task 2023-05-08T23:26:04.240Z] 23:26:04     INFO -    File "/usr/lib/python3.9/subprocess.py", line 373, in check_call
[task 2023-05-08T23:26:04.240Z] 23:26:04     INFO -      raise CalledProcessError(retcode, cmd)
[task 2023-05-08T23:26:04.315Z] 23:26:04     INFO - Return code: 1
[task 2023-05-08T23:26:04.315Z] 23:26:04    ERROR - 1 not in success codes: [0]
[task 2023-05-08T23:26:04.315Z] 23:26:04  WARNING - setting return code to 2
[task 2023-05-08T23:26:04.315Z] 23:26:04    FATAL - Halting on failure while running ['/builds/worker/workspace/obj-build/_virtualenvs/common/bin/python', 'mach', '--log-no-times', 'repackage', 'deb-l10n', '--version', '115.0a1', '--build-number', '1', '--input-tar-file', '/builds/worker/fetches/target.tar.bz2', '--input-xpi-file', '/builds/worker/fetches/target.langpack.xpi', '--output', '/builds/worker/workspace/outputs/szl/target.langpack.deb']
[task 2023-05-08T23:26:04.315Z] 23:26:04    FATAL - Running post_fatal callback...
[task 2023-05-08T23:26:04.315Z] 23:26:04    FATAL - Exiting 2
[task 2023-05-08T23:26:04.315Z] 23:26:04     INFO - [mozharness: 2023-05-08 23:26:04.315923Z] Finished repackage step (failed)
[taskcluster 2023-05-08 23:26:08.583Z] === Task Finished ===
[taskcluster 2023-05-08 23:26:08.705Z] Artifact "public/build" not found at "/builds/worker/artifacts/": (HTTP code 404) no such container - Could not find the file /builds/worker/artifacts/ in container bf4eac2a76481b8c8b184e39dabbccc8682f2d70bda17d6ae6c7b7d36a852593 
[taskcluster 2023-05-08 23:26:08.709Z] Artifact "public/build/szl/target.langpack.deb" not found at "/builds/worker/workspace/outputs/szl/target.langpack.deb": (HTTP code 404) no such container - Could not find the file /builds/worker/workspace/outputs/szl/target.langpack.deb in container bf4eac2a76481b8c8b184e39dabbccc8682f2d70bda17d6ae6c7b7d36a852593 
[taskcluster 2023-05-08 23:26:09.205Z] Unsuccessful task run with exit code: 2 completed in 167.361 seconds

Comment 1

[Iulian Moraru]

Hi Gabriel! Can you please take a look at this? Could this be something caused by the recent changes from Bug 1824327?
Thank you!

Comment 2

[Iulian Moraru]

Also :) Hi Johan! Wouldn't hurt if you could also take a look at this, please.

Comment 3

[Intermittent Failures Robot]

113 failures in 595 pushes (0.19 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 113

Platform and build breakdown:

• linux64-shippable: 113
  • opt: 113

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831988&startday=2023-05-08&endday=2023-05-08&tree=all

Comment 4

[Pascal Chevrel (relman team) -> :pascalc]

Bumping priority and severity as this means we are not serving Linux nightly builds to users.

Comment 5

[Julien Cristau [:jcristau]]

This is caused by bug 1824327 changing browser/installer/linux/debian/install.in in a way that works for the main browser package but not for langpacks. Since this is blocking nightlies I think we should back it out for now.

Comment 6

[Cosmin Sabou [:CosminS]]

Should be fixed by this backout: https://hg.mozilla.org/mozilla-central/rev/169e7173a60fb69db064292175b3d66a1dbdae65

Comment 7

[Intermittent Failures Robot]

113 failures in 4077 pushes (0.028 failures/push) were associated with this bug in the last 7 days.

This is the #4 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-central: 113

Platform and build breakdown:

• linux64-shippable: 113
  • opt: 113

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1831988&startday=2023-05-08&endday=2023-05-14&tree=all