1208467 - OS X builders don't have the xz utils, therefore tooltool .tar.xz packages cannot be used on them

Status: RESOLVED WONTFIX

(Release Engineering :: General, defect)

Description

[(no longer active)]

See these two try pushes:

https://treeherder.mozilla.org/#/jobs?repo=try&revision=a0421dc3fcb2
https://treeherder.mozilla.org/#/jobs?repo=try&revision=041f85622a53

I am getting:

05:58:02     INFO -  Executing: ['/builds/tooltool.py', '--authentication-file', '/builds/relengapi.tok', '--url', 'https://api.pub.build.mozilla.org/tooltool/', '--overwrite', '-m', '/builds/slave/try-m64-st-an-d-00000000000000/build/src/browser/config/tooltool-manifests/macosx64/clang.manifest', 'fetch', '-c', '/builds/tooltool_cache']
05:58:02     INFO -  INFO - File clang.tar.xz not present in local cache folder /builds/tooltool_cache
05:58:02     INFO -  INFO - Attempting to fetch from 'https://api.pub.build.mozilla.org/tooltool/'...
05:58:04     INFO -  INFO - File clang.tar.xz fetched from https://api.pub.build.mozilla.org/tooltool/ as /builds/slave/try-m64-st-an-d-00000000000000/build/src/tmpaMMfq3
05:58:04     INFO -  INFO - File sccache.tar.bz2 retrieved from local cache /builds/tooltool_cache
05:58:05     INFO -  INFO - File integrity verified, renaming tmpaMMfq3 to clang.tar.xz
05:58:05     INFO -  INFO - Updating local cache /builds/tooltool_cache...
05:58:05     INFO -  INFO - Local cache /builds/tooltool_cache updated with clang.tar.xz
05:58:05     INFO -  INFO - untarring "sccache.tar.bz2"
05:58:05     INFO -  INFO - untarring "clang.tar.xz"
05:58:05     INFO -  INFO - tar: Error opening archive: Child process exited with status 254Child process exited with status 254
05:58:05     INFO -  ERROR - The following files failed: 'clang.tar.xz'
05:58:36     INFO -  retry: Calling <function run_with_timeout at 0x1004f28c0> with args: (['/builds/tooltool.py', '--authentication-file', '/builds/relengapi.tok', '--url', 'https://api.pub.build.mozilla.org/tooltool/', '--overwrite', '-m', '/builds/slave/try-m64-st-an-d-00000000000000/build/src/browser/config/tooltool-manifests/macosx64/clang.manifest', 'fetch', '-c', '/builds/tooltool_cache'], 300, None, None, False, True), kwargs: {}, attempt #2
05:58:36     INFO -  Executing: ['/builds/tooltool.py', '--authentication-file', '/builds/relengapi.tok', '--url', 'https://api.pub.build.mozilla.org/tooltool/', '--overwrite', '-m', '/builds/slave/try-m64-st-an-d-00000000000000/build/src/browser/config/tooltool-manifests/macosx64/clang.manifest', 'fetch', '-c', '/builds/tooltool_cache']
05:58:37     INFO -  INFO - untarring "clang.tar.xz"
05:58:37     INFO -  INFO - tar: Error opening archive: Child process exited with status 254Child process exited with status 254
05:58:37     INFO -  INFO - rm tree: sccache
05:58:37     INFO -  INFO - untarring "sccache.tar.bz2"
05:58:37     INFO -  ERROR - The following files failed: 'clang.tar.xz'

The script dies after a bunch of retries.

I have tried to fetch this manifest locally using tooltool and it succeeds.  Not sure what's going on here.

This is blocking upgrading clang, which blocks Ted's OS X cross compiles.  I would appreciate if someone can take a look please.

Comment 1

[(no longer active)]

Looks like this is caused by the OS X builders not having the xz utils: http://qnundrum.com/question/426516

Comment 2

[[e-mail] (:bhearsum)]

These machines are dead.