1780520 - Perma periodic file update Unsuccessful task run with exit code: 2 completed in X seconds after tar (child): bzip2: Cannot exec: No such file or directory

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, defect)

Description

[bszekely]

Failure log

Push with failures

Task details

[taskcluster 2022-07-21 08:05:45.861Z] Task ID: YjbzdT1eRgW45e4hg0gW6g
[taskcluster 2022-07-21 08:05:45.861Z] Worker ID: i-0f6928f7d67669f33
[taskcluster 2022-07-21 08:05:45.861Z] Worker Group: us-east-1
[taskcluster 2022-07-21 08:05:45.861Z] Worker Node Type: m5.4xlarge
[taskcluster 2022-07-21 08:05:45.861Z] Worker Type: b-linux
[taskcluster 2022-07-21 08:05:45.861Z] Public IP: 35.172.121.230
[taskcluster 2022-07-21 08:05:45.861Z] Hostname: ip-10-145-111-26

[taskcluster 2022-07-21 08:05:47.646Z] Downloading artifact "public/image.tar.zst" from task ID: INTftjsgSCyUfcOGx221WA.
[taskcluster 2022-07-21 08:05:52.647Z] Download Progress: 92.87%
[taskcluster 2022-07-21 08:05:52.978Z] Downloaded artifact successfully.
[taskcluster 2022-07-21 08:05:52.978Z] Downloaded 162.038 mb
[taskcluster 2022-07-21 08:05:52.979Z] Decompressing downloaded image
[taskcluster 2022-07-21 08:05:54.192Z] Loading docker image from downloaded archive.
[taskcluster 2022-07-21 08:06:01.821Z] Image 'public/image.tar.zst' from task 'INTftjsgSCyUfcOGx221WA' loaded.  Using image ID sha256:1fb16bd4e757c3445ab491191b2ddf70222910656ea3b914ed2f31ced3c711e2.
[taskcluster 2022-07-21 08:06:01.975Z] === Task Starting ===
+ test mozilla-central
+ test firefox
+ PARAMS=
+ '[' -n 1 ']'
+ PARAMS=' --use-mozilla-central'
+ '[' -n 1 ']'
+ PARAMS=' --use-mozilla-central --hsts'
+ '[' -n 1 ']'
+ PARAMS=' --use-mozilla-central --hsts --hpkp'
+ '[' -n 1 ']'
+ PARAMS=' --use-mozilla-central --hsts --hpkp --remote-settings'
+ '[' -n 1 ']'
+ PARAMS=' --use-mozilla-central --hsts --hpkp --remote-settings --suffix-list'
+ '[' -n '' ']'
+ export ARTIFACTS_DIR=/home/worker/artifacts
+ ARTIFACTS_DIR=/home/worker/artifacts
+ mkdir -p /home/worker/artifacts
+ queue_base=https://firefox-ci-tc.services.mozilla.com/api/queue/v1
+ '[' -n YjbzdT1eRgW45e4hg0gW6g ']'
+ curl --location --retry 10 --retry-delay 10 -o /home/worker/task.json https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/YjbzdT1eRgW45e4hg0gW6g
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100  2907  100  2907    0     0  37269      0 --:--:-- --:--:-- --:--:-- 37269
++ jq -r '.scopes[] | select(contains ("arc-phabricator-token"))' /home/worker/task.json
++ awk -F: '{print $3}'
+ ARC_SECRET=project/releng/gecko/build/level-3/arc-phabricator-token
+ '[' -n project/releng/gecko/build/level-3/arc-phabricator-token ']'
+ getent hosts taskcluster
172.17.0.2      taskcluster 906617c607ec nostalgic_mestorf
+ set +x
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   110  100   110    0     0   1111      0 --:--:-- --:--:-- --:--:--  1111
+ chmod 600 /builds/worker/.arcrc
+ export HGPLAIN=1
+ HGPLAIN=1
+ /home/worker/scripts/periodic_file_updates.sh -p firefox -b mozilla-central -a --use-mozilla-central --hsts --hpkp --remote-settings --suffix-list
+ PRODUCT=firefox
+ BRANCH=
+ PLATFORM_EXT=tar.bz2
+ UNPACK_CMD='tar jxf'
+ CLOSED_TREE=false
+ DONTBUILD=false
+ APPROVAL=false
+ COMMIT_AUTHOR='ffxbld <[e-mail]>'
+ REPODIR=
+ HGHOST=hg.mozilla.org
+ STAGEHOST=archive.mozilla.org
+ WGET='wget -nv'
+ UNTAR='tar -zxf'
++ command -v diff
+ DIFF='/usr/bin/diff -u'
+ BASEDIR=/builds/worker
+++ dirname /home/worker/scripts/periodic_file_updates.sh
++ realpath /home/worker/scripts
+ SCRIPTDIR=/home/worker/scripts
++ command -v hg
+ HG=/usr/bin/hg
+ DATADIR=/builds/worker/data
+ mkdir -p /builds/worker/data
+ USE_MC=false
+ USE_TC=true
++ command -v jq
+ JQ=/usr/bin/jq
+ DO_HSTS=false
+ HSTS_PRELOAD_SCRIPT=/home/worker/scripts/getHSTSPreloadList.js
+ HSTS_PRELOAD_ERRORS=nsSTSPreloadList.errors
+ HSTS_PRELOAD_INC=/builds/worker/data/nsSTSPreloadList.inc
+ HSTS_UPDATED=false
+ DO_HPKP=false
+ HPKP_PRELOAD_SCRIPT=/home/worker/scripts/genHPKPStaticPins.js
+ HPKP_PRELOAD_ERRORS=StaticHPKPins.errors
+ HPKP_PRELOAD_JSON=/builds/worker/data/PreloadedHPKPins.json
+ HPKP_PRELOAD_INC=StaticHPKPins.h
+ HPKP_PRELOAD_INPUT=/builds/worker/data/StaticHPKPins.h
+ HPKP_PRELOAD_OUTPUT=/builds/worker/data/StaticHPKPins.h.out
+ HPKP_UPDATED=false
+ DO_REMOTE_SETTINGS=false
+ REMOTE_SETTINGS_SERVER=
+ REMOTE_SETTINGS_INPUT=/builds/worker/data/remote-settings.in
+ REMOTE_SETTINGS_OUTPUT=/builds/worker/data/remote-settings.out
+ REMOTE_SETTINGS_DIR=/services/settings/dumps
+ REMOTE_SETTINGS_UPDATED=false
+ DO_SUFFIX_LIST=false
+ GITHUB_SUFFIX_URL=https://raw.githubusercontent.com/publicsuffix/list/master/public_suffix_list.dat
+ GITHUB_SUFFIX_LOCAL=public_suffix_list.dat
+ HG_SUFFIX_LOCAL=effective_tld_names.dat
+ HG_SUFFIX_PATH=/netwerk/dns/effective_tld_names.dat
+ SUFFIX_LIST_UPDATED=false
+ ARTIFACTS_DIR=/home/worker/artifacts
+ HSTS_DIFF_ARTIFACT=/home/worker/artifacts/nsSTSPreloadList.diff
+ HPKP_DIFF_ARTIFACT=/home/worker/artifacts/StaticHPKPins.h.diff
+ REMOTE_SETTINGS_DIFF_ARTIFACT=/home/worker/artifacts/remote-settings.diff
+ SUFFIX_LIST_DIFF_ARTIFACT=/home/worker/artifacts/effective_tld_names.diff
+ queue_base=https://firefox-ci-tc.services.mozilla.com/api/queue/v1
+ index_base=https://firefox-ci-tc.services.mozilla.com/api/index/v1
+ '[' 10 -gt 0 ']'
+ case "$1" in
+ PRODUCT=firefox
+ shift
+ shift
+ '[' 8 -gt 0 ']'
+ case "$1" in
+ BRANCH=mozilla-central
+ shift
+ shift
+ '[' 6 -gt 0 ']'
+ case "$1" in
+ APPROVAL=true
+ shift
+ '[' 5 -gt 0 ']'
+ case "$1" in
+ USE_MC=true
+ shift
+ '[' 4 -gt 0 ']'
+ case "$1" in
+ DO_HSTS=true
+ shift
+ '[' 3 -gt 0 ']'
+ case "$1" in
+ DO_HPKP=true
+ shift
+ '[' 2 -gt 0 ']'
+ case "$1" in
+ DO_REMOTE_SETTINGS=true
+ shift
+ '[' 1 -gt 0 ']'
+ case "$1" in
+ DO_SUFFIX_LIST=true
+ shift
+ '[' 0 -gt 0 ']'
+ '[' mozilla-central == '' ']'
+ '[' true == false ']'
+ case "${PRODUCT}" in
+ '[' '' == '' ']'
++ basename mozilla-central
+ REPODIR=mozilla-central
+ case "${BRANCH}" in
+ HGREPO=https://hg.mozilla.org/mozilla-central
+ BROWSER_ARCHIVE=target.tar.bz2
+ TESTS_ARCHIVE=target.common.tests.tar.gz
+ preflight_cleanup
+ cd /builds/worker
+ rm -rf firefox tests target.tar.bz2 target.common.tests.tar.gz
+ '[' true == true ']'
+ '[' true == true ']'
+ download_shared_artifacts_from_tc
+ cd /builds/worker
+ TASKID_FILE=taskId.json
+ echo 'INFO: Downloading all the necessary pieces from the taskcluster index...'
INFO: Downloading all the necessary pieces from the taskcluster index...
+ TASKID_URL=https://firefox-ci-tc.services.mozilla.com/api/index/v1/task/gecko.v2.mozilla-central.shippable.latest.firefox.linux64-opt
+ '[' true == true ']'
+ TASKID_URL=https://firefox-ci-tc.services.mozilla.com/api/index/v1/task/gecko.v2.mozilla-central.shippable.latest.firefox.linux64-opt
+ wget -nv -O taskId.json https://firefox-ci-tc.services.mozilla.com/api/index/v1/task/gecko.v2.mozilla-central.shippable.latest.firefox.linux64-opt
2022-07-21 08:06:02 URL:https://firefox-ci-tc.services.mozilla.com/api/index/v1/task/gecko.v2.mozilla-central.shippable.latest.firefox.linux64-opt [197/197] -> "taskId.json" [1]
++ /usr/bin/jq -r .taskId taskId.json
+ INDEX_TASK_ID=TsQq-myfTKeLBh21EccJ2Q
+ '[' -z TsQq-myfTKeLBh21EccJ2Q ']'
+ echo 'INFO: Got taskId of TsQq-myfTKeLBh21EccJ2Q'
INFO: Got taskId of TsQq-myfTKeLBh21EccJ2Q
+ TASKSTATUS_FILE=taskstatus.json
+ STATUS_URL=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TsQq-myfTKeLBh21EccJ2Q/status
+ wget -nv -O taskstatus.json https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TsQq-myfTKeLBh21EccJ2Q/status
2022-07-21 08:06:03 URL:https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TsQq-myfTKeLBh21EccJ2Q/status [836/836] -> "taskstatus.json" [1]
++ jq '.status.runs | length' taskstatus.json
+ LAST_RUN_INDEX=0
+ echo 'INFO: Examining run number 0'
INFO: Examining run number 0
+ BROWSER_ARCHIVE_URL=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TsQq-myfTKeLBh21EccJ2Q/runs/0/artifacts/public/build/target.tar.bz2
+ echo 'INFO: wget -nv https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TsQq-myfTKeLBh21EccJ2Q/runs/0/artifacts/public/build/target.tar.bz2'
INFO: wget -nv https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TsQq-myfTKeLBh21EccJ2Q/runs/0/artifacts/public/build/target.tar.bz2
+ wget -nv https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TsQq-myfTKeLBh21EccJ2Q/runs/0/artifacts/public/build/target.tar.bz2
2022-07-21 08:06:05 URL:https://firefoxci.taskcluster-artifacts.net/TsQq-myfTKeLBh21EccJ2Q/0/public/build/target.tar.bz2 [87823355/87823355] -> "target.tar.bz2" [1]
+ TESTS_ARCHIVE_URL=https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TsQq-myfTKeLBh21EccJ2Q/runs/0/artifacts/public/build/target.common.tests.tar.gz
+ echo 'INFO: wget -nv https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TsQq-myfTKeLBh21EccJ2Q/runs/0/artifacts/public/build/target.common.tests.tar.gz'
INFO: wget -nv https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TsQq-myfTKeLBh21EccJ2Q/runs/0/artifacts/public/build/target.common.tests.tar.gz
+ wget -nv https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/TsQq-myfTKeLBh21EccJ2Q/runs/0/artifacts/public/build/target.common.tests.tar.gz
2022-07-21 08:06:08 URL:https://firefoxci.taskcluster-artifacts.net/TsQq-myfTKeLBh21EccJ2Q/0/public/build/target.common.tests.tar.gz [57793917/57793917] -> "target.common.tests.tar.gz" [1]
+ unpack_artifacts
+ cd /builds/worker
+ '[' '!' -f target.tar.bz2 ']'
+ '[' '!' -f target.common.tests.tar.gz ']'
+ echo 'INFO: Unpacking resources...'
INFO: Unpacking resources...
+ tar jxf target.tar.bz2
tar (child): bzip2: Cannot exec: No such file or directory
tar (child): Error is not recoverable: exiting now
tar: Child returned status 2
tar: Error is not recoverable: exiting now
[taskcluster 2022-07-21 08:06:09.127Z] === Task Finished ===
[taskcluster 2022-07-21 08:06:09.223Z] Artifact "public/build/StaticHPKPins.h.diff" not found at "/home/worker/artifacts/StaticHPKPins.h.diff"
[taskcluster 2022-07-21 08:06:09.311Z] Artifact "public/build/remote-settings.diff" not found at "/home/worker/artifacts/remote-settings.diff"
[taskcluster 2022-07-21 08:06:09.403Z] Artifact "public/build/nsSTSPreloadList.diff" not found at "/home/worker/artifacts/nsSTSPreloadList.diff"
[taskcluster 2022-07-21 08:06:09.495Z] Unsuccessful task run with exit code: 2 completed in 23.636 seconds

Comment 1

[BugBot [:suhaib / :marco/ :calixte]]

Set release status flags based on info from the regressing bug 1780329

Comment 2

[Julien Cristau [:jcristau]]

Attachment: Bug 1780520 - install missing bzip2 package in periodic-updates image.

bzip2 has "important" priority in ubuntu 18.04 but "standard" in debian 11, so
it went missing when we switched the base image.

Comment 3

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/e1df2cae96ce
install missing bzip2 package in periodic-updates image. r=keeler DONTBUILD

Comment 4

[Iulian Moraru]

https://hg.mozilla.org/mozilla-central/rev/e1df2cae96ce

Comment 5

[Intermittent Failures Robot]

5 failures in 3497 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 5

Platform and build breakdown:

• linux64: 5
  • opt: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1780520&startday=2022-07-18&endday=2022-07-24&tree=all