OS X builders don't have the xz utils, therefore tooltool .tar.xz packages cannot be used on them

NEW
Unassigned

Status

Release Engineering
General
3 years ago
a month ago

People

(Reporter: Ehsan, Unassigned)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

3 years ago
See these two try pushes:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=a0421dc3fcb2
https://treeherder.mozilla.org/#/jobs?repo=try&revision=041f85622a53

I am getting:

05:58:02     INFO -  Executing: ['/builds/tooltool.py', '--authentication-file', '/builds/relengapi.tok', '--url', 'https://api.pub.build.mozilla.org/tooltool/', '--overwrite', '-m', '/builds/slave/try-m64-st-an-d-00000000000000/build/src/browser/config/tooltool-manifests/macosx64/clang.manifest', 'fetch', '-c', '/builds/tooltool_cache']
05:58:02     INFO -  INFO - File clang.tar.xz not present in local cache folder /builds/tooltool_cache
05:58:02     INFO -  INFO - Attempting to fetch from 'https://api.pub.build.mozilla.org/tooltool/'...
05:58:04     INFO -  INFO - File clang.tar.xz fetched from https://api.pub.build.mozilla.org/tooltool/ as /builds/slave/try-m64-st-an-d-00000000000000/build/src/tmpaMMfq3
05:58:04     INFO -  INFO - File sccache.tar.bz2 retrieved from local cache /builds/tooltool_cache
05:58:05     INFO -  INFO - File integrity verified, renaming tmpaMMfq3 to clang.tar.xz
05:58:05     INFO -  INFO - Updating local cache /builds/tooltool_cache...
05:58:05     INFO -  INFO - Local cache /builds/tooltool_cache updated with clang.tar.xz
05:58:05     INFO -  INFO - untarring "sccache.tar.bz2"
05:58:05     INFO -  INFO - untarring "clang.tar.xz"
05:58:05     INFO -  INFO - tar: Error opening archive: Child process exited with status 254Child process exited with status 254
05:58:05     INFO -  ERROR - The following files failed: 'clang.tar.xz'
05:58:36     INFO -  retry: Calling <function run_with_timeout at 0x1004f28c0> with args: (['/builds/tooltool.py', '--authentication-file', '/builds/relengapi.tok', '--url', 'https://api.pub.build.mozilla.org/tooltool/', '--overwrite', '-m', '/builds/slave/try-m64-st-an-d-00000000000000/build/src/browser/config/tooltool-manifests/macosx64/clang.manifest', 'fetch', '-c', '/builds/tooltool_cache'], 300, None, None, False, True), kwargs: {}, attempt #2
05:58:36     INFO -  Executing: ['/builds/tooltool.py', '--authentication-file', '/builds/relengapi.tok', '--url', 'https://api.pub.build.mozilla.org/tooltool/', '--overwrite', '-m', '/builds/slave/try-m64-st-an-d-00000000000000/build/src/browser/config/tooltool-manifests/macosx64/clang.manifest', 'fetch', '-c', '/builds/tooltool_cache']
05:58:37     INFO -  INFO - untarring "clang.tar.xz"
05:58:37     INFO -  INFO - tar: Error opening archive: Child process exited with status 254Child process exited with status 254
05:58:37     INFO -  INFO - rm tree: sccache
05:58:37     INFO -  INFO - untarring "sccache.tar.bz2"
05:58:37     INFO -  ERROR - The following files failed: 'clang.tar.xz'

The script dies after a bunch of retries.

I have tried to fetch this manifest locally using tooltool and it succeeds.  Not sure what's going on here.

This is blocking upgrading clang, which blocks Ted's OS X cross compiles.  I would appreciate if someone can take a look please.
(Reporter)

Comment 1

3 years ago
Looks like this is caused by the OS X builders not having the xz utils: http://qnundrum.com/question/426516
Summary: tooltool error when fetching a new compiler image that I uploaded to tooltool → OS X builders don't have the xz utils, therefore tooltool .tar.xz packages cannot be used on them
(Reporter)

Updated

3 years ago
No longer blocks: 1205242
(Assignee)

Updated

a month ago
Component: General Automation → General
Product: Release Engineering → Release Engineering
You need to log in before you can comment on or make changes to this bug.