1895338 - Perma [tier 2] esr115 Linux x64 snap /snap/bin/snapcraft: 3: exec: /snap/snapcraft/current/usr/bin/python3: not found

Status: RESOLVED FIXED

(Firefox Build System :: Third Party Packaging, defect)

Description

[Norisz Fay [:noriszfay]]

Parsed log: https://treeherder.mozilla.org/logviewer?job_id=457143891&repo=mozilla-esr115&lineNumber=2173
Full log: https://firefoxci.taskcluster-artifacts.net/BJkpBBaCTtG7QR6xZ7SeEw/2/public/logs/live_backing.log

./usr/share/locale-langpack/zh_CN/LC_MESSAGES/gtk30.mo
+ for i in *.deb
+ dpkg-deb --fsys-tarfile language-pack-gnome-zh-hant-base_1%3a20.04+20220818_all.deb
+ tar xv -C /home/worker/workspace/source --wildcards './usr/share/locale-langpack/*/LC_MESSAGES/gtk30.mo'
./usr/share/locale-langpack/zh_HK/LC_MESSAGES/gtk30.mo
./usr/share/locale-langpack/zh_TW/LC_MESSAGES/gtk30.mo
+ cp -v /scripts/tmpdir /home/worker/workspace/source
'/scripts/tmpdir' -> '/home/worker/workspace/source/tmpdir'
+ sed -e s/@VERSION@/115.11.0esr/g -e s/@BUILD_NUMBER@/1/g firefox.snapcraft.yaml.in
+ cd /home/worker/workspace
+ export SNAP_ARCH=amd64
+ SNAP_ARCH=amd64
+ snapcraft
/snap/bin/snapcraft: 3: exec: /snap/snapcraft/current/usr/bin/python3: not found
[taskcluster 2024-05-06 18:52:47.531Z] === Task Finished ===
[taskcluster 2024-05-06 18:52:47.538Z] Unsuccessful task run with exit code: 127 completed in 203.554 seconds

Comment 1

[:gerard-majax]

meh?

root@54386d75454f:/scripts# file /snap/snapcraft/current/usr/bin/python3.10    
/snap/snapcraft/current/usr/bin/python3.10: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, interpreter /snap/core22/current/lib64/ld-linux-x86-64.so.2, BuildID[sha1]=08d0fd215a9a98d5333fda7e5a9a46c923148415, for GNU/Linux 3.2.0, stripped

Comment 2

[:gerard-majax]

So it looks like snapcraft now depends on core22's python, however:

• most of firefox.snapcraft.yaml.in is outdated (gnome38?) and would need to be properly sync'd with upstream,
• this repackage task has no use to the best of my knowledge,
• we have snap-upstream tasks that runs daily and have test coverage,
• the snap ecosystem / APIs are such that it's mostly impossible to install an older version,

Installing core22 here should be enough, but the future of that repackaging task should be questionned: either we do the (non trivial?) work of upgrading to really match what is on github, or we drop it in favor of the existing snap-upstream?

Comment 3

[:gerard-majax]

Welcoming any feedback on the matter, my personal opinion would be that we should switch the few usage we have to snap-upstream task, but I really dont know what those uses are.

Comment 4

[:gerard-majax]

root@54386d75454f:/scripts# ls -hal /snap/snapcraft/current/usr/bin/python3.10 
-rwxr-xr-x 1 root root 5.7M Mar 15 21:35 /snap/snapcraft/current/usr/bin/python3.10
root@54386d75454f:/scripts# file /snap/snapcraft/current/usr/bin/python3.10    
/snap/snapcraft/current/usr/bin/python3.10: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, interpreter /snap/core22/current/lib64/ld-linux-x86-64.so.2, BuildID[sha1]=08d0fd215a9a98d5333fda7e5a9a46c923148415, for GNU/Linux 3.2.0, stripped
root@54386d75454f:/scripts# ll 
total 44
drwxr-x--- 1 root root  292 Apr 25 09:31 ./
drwxr-xr-x 1 root root  252 May  7 16:26 ../
-rw-r--r-- 1 root root 2650 Apr 25 09:31 Dockerfile
-rw-r--r-- 1 root root 1038 Apr 25 09:31 download_and_install_snap.sh
-rw-r--r-- 1 root root  463 Apr 25 09:31 extract_locales_from_l10n_json.py
-rw-r--r-- 1 root root 9175 Apr 25 09:31 firefox.desktop
-rw-r--r-- 1 root root 2006 Apr 25 09:31 firefox.snapcraft.yaml.in
-rw-r--r-- 1 root root  298 Apr 25 09:31 Makefile
-rw-r--r-- 1 root root   53 Apr 25 09:31 policies.json
-rwxr-xr-x 1 root root 3596 Apr 25 09:31 runme.sh*
-rwxr-xr-x 1 root root  133 Apr 25 09:31 tmpdir*
root@54386d75454f:/scripts#  bash download_and_install_snap.sh 'core22'
+ SNAP_NAME=core22
+ SNAP_CHANNEL=stable
+ SNAP_INSTALL_LOCATION=/snap
++ curl --header 'X-Ubuntu-Series: 16' 'https://api.snapcraft.io/api/v1/snaps/details/core22?channel=stable'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  1476  100  1476    0     0   6175      0 --:--:-- --:--:-- --:--:--  6175
+ SNAP_METADATA='{"aliases":null,"anon_download_url":"https://api.snapcraft.io/api/v1/snaps/download/amcUKQILKXHHTlmSa7NMdnXSx02dNeeT_1380.snap","apps":[],"architecture":["amd64"],"binary_filesize":77844480,"channel":"stable","common_ids":[],"confinement":"strict","contact":"https://github.com/snapcore/core-base/issues","content":"base","date_published":"2020-10-08T13:28:37.905711Z","deltas":[],"description":"The base snap based on the Ubuntu 22.04 release.","developer_id":"canonical","developer_name":"Canonical","developer_validation":"verified","download_sha3_384":"a14540963aaff186b46d42eb005ca50a26bba190543a1890056d0b2793e87d701d0d4584aa1c93fa1fe07a6fd188e36c","download_sha512":"74bd9df1e3829dd1576be957c8f65f2af5a85b364930e9aa02e01fada6fbf3eb9bc2385958f29251e96ce6838beb2fbd102cb9e39736e8678bccc3f888b6f000","download_url":"https://api.snapcraft.io/api/v1/snaps/download/amcUKQILKXHHTlmSa7NMdnXSx02dNeeT_1380.snap","epoch":"0","gated_snap_ids":[],"icon_url":"","last_updated":"2024-04-08T07:55:19.003331+00:00","license":"unset","links":{"contact":["https://github.com/snapcore/core-base/issues"],"website":[]},"name":"core22.canonical","origin":"canonical","package_name":"core22","prices":{},"private":false,"publisher":"Canonical","ratings_average":0.0,"release":["16"],"revision":1380,"screenshot_urls":[],"snap_id":"amcUKQILKXHHTlmSa7NMdnXSx02dNeeT","summary":"Runtime environment based on Ubuntu 22.04","support_url":"","title":"core22","version":"20240408","website":null}'
+ set +x
+ echo 'Downloading core22, version 20240408, revision 1380 (last updated: 2024-04-08T07:55:19.003331+00:00)...'
Downloading core22, version 20240408, revision 1380 (last updated: 2024-04-08T07:55:19.003331+00:00)...
+ curl --location https://api.snapcraft.io/api/v1/snaps/download/amcUKQILKXHHTlmSa7NMdnXSx02dNeeT_1380.snap --output core22.snap
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   549  100   549    0     0   3119      0 --:--:-- --:--:-- --:--:--  3119
100 74.2M  100 74.2M    0     0  14.5M      0  0:00:05  0:00:05 --:--:-- 16.3M
+ sha512sum -c /dev/fd/63
++ echo '74bd9df1e3829dd1576be957c8f65f2af5a85b364930e9aa02e01fada6fbf3eb9bc2385958f29251e96ce6838beb2fbd102cb9e39736e8678bccc3f888b6f000  core22.snap'
core22.snap: OK
+ mkdir -p /snap/core22
+ unsquashfs -d /snap/core22/current core22.snap
Parallel unsquashfs: Using 16 processors
12905 inodes (13801 blocks) to write

[========================================================================================================================================================================================================================================================================================================================-] 13801/13801 100%

created 10716 files
created 1673 directories
created 2065 symlinks
created 4 devices
created 0 fifos
+ rm core22.snap
+ echo 'core22 version 20240408 has correctly been uploaded and installed.'
core22 version 20240408 has correctly been uploaded and installed.
root@54386d75454f:/scripts# file /snap/snapcraft/current/usr/bin/python3.10    
/snap/snapcraft/current/usr/bin/python3.10: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, interpreter /snap/core22/current/lib64/ld-linux-x86-64.so.2, BuildID[sha1]=08d0fd215a9a98d5333fda7e5a9a46c923148415, for GNU/Linux 3.2.0, stripped
root@54386d75454f:/scripts# file /snap/snapcraft/current/usr/bin/python3.10 
/snap/snapcraft/current/usr/bin/python3.10: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, interpreter /snap/core22/current/lib64/ld-linux-x86-64.so.2, BuildID[sha1]=08d0fd215a9a98d5333fda7e5a9a46c923148415, for GNU/Linux 3.2.0, stripped
root@54386d75454f:/scripts# /snap/snapcraft/current/usr/bin/python3.10      
Python 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> 
root@54386d75454f:/scripts# logout

Comment 5

[:gerard-majax]

Attachment: Bug 1895338 - Add core22 Snap to unblock newer versions of Snapcraft against Python 3.10 r?jcristau!

Comment 6

[:gerard-majax]

Attachment: WIP: Bug 1895338 - Add core22 Snap to unblock newer versions of Snapcraft against Python 3.10 (ESR115)

Comment 7

[Julien Cristau [:jcristau]]

AFAIK we don't do anything with release-snap-repackage tasks, and if we ever needed/wanted to start building the snaps ourselves again we probably would base it off of the current builds from canonical rather than this, so IMO we should remove these..

Comment 8

[:gerard-majax]

needinfo so you can trigger a correct build to verify if at least this unblocks, we can take care of getting rid of that task in a follow up

Comment 9

[Julien Cristau [:jcristau]]

https://treeherder.mozilla.org/jobs?repo=try&revision=824307a094bb561b46f2181353fa6ffa4c02b96d&searchStr=snap is green

Comment 10

[:gerard-majax]

Attachment: Bug 1895338 - Add core22 Snap to unblock newer versions of Snapcraft against Python 3.10

Original Revision: https://phabricator.services.mozilla.com/D209716

Comment 11

[Intermittent Failures Robot]

4 failures in 3649 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr115: 4

Platform and build breakdown:

• linux64-shippable: 4
  • opt: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1895338&startday=2024-05-06&endday=2024-05-12&tree=all

Comment 12

[Phabricator Automation]

esr115 Uplift Approval Request

• User impact if declined: No snap testing by QA ?
• Code covered by automated testing: no
• Fix verified in Nightly: no
• Needs manual QE test: no
• Steps to reproduce for manual QE testing: N/A
• Risk associated with taking this patch: low
• Explanation of risk level: task is broken right now, this will unblock
• String changes made/needed: N/A
• Is Android affected?: no

Comment 13

[Pulsebot]

https://hg.mozilla.org/releases/mozilla-esr115/rev/780e0ae36deb