Closed Bug 1186719 Opened 9 years ago Closed 8 years ago

TB's build fails in fetching rustc.tar.gz

Categories

(Release Engineering :: General, defect)

Product:
Release Engineering
Component:
General
Platform:
x86_64
macOS
Type:
defect
Priority:
Not set
Severity:
major

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: ewong, Unassigned)

References

Details

(Whiteboard: [workaround in comment 4]) 

From http://ftp.mozilla.org/pub/mozilla.org/thunderbird/tinderbox-builds/comm-central-macosx64/1437600918/comm-central-macosx64-bm84-build1-build11.txt.gz

TB's releng can't seem to be able to fetch rustc.tar.gz.  

Looking at a recent m-c's OSX 10.7 opt build, it seems to get it ok.

Is there something that I missed with my patch in bug 1188263 (https://bug1186283.bmoattachments.org/attachment.cgi?id=8636923)?
Severity: normal → major
Successful fetch of artifact by m-c build starting at Wed Jul 22 13:36:37 PDT 2015 - from log http://ftp.mozilla.org/pub/mozilla.org/firefox/tinderbox-builds/mozilla-central-macosx64/1437597288/mozilla-central-macosx64-bm85-build1-build202.txt.gz:

    13:37:26     INFO -  /builds/slave/m-cen-m64-00000000000000000000/build/src/browser/config/tooltool-manifests/macosx64/releng.manifest content
    13:37:26     INFO -  =======================================================
    13:37:26     INFO -  [
    13:37:26     INFO -  {
    13:37:26     INFO -  "clang_version": "r183744"
    13:37:26     INFO -  },
    13:37:26     INFO -  {
    13:37:26     INFO -  "size": 59602619,
    13:37:26     INFO -  "digest": "86662ebc0ef650490559005948c4f0cb015dad72c7cac43732c2bf2995247081e30c139cf8008d19670a0009fc302c4eee2676981ee3f9ff4a15c01af22b783b",
    13:37:26     INFO -  "algorithm": "sha512",
    13:37:26     INFO -  "filename": "clang.tar.bz2",
    13:37:26     INFO -  "unpack": true
    13:37:26     INFO -  },
    13:37:26     INFO -  {
    13:37:26     INFO -  "size": 167175,
    13:37:26     INFO -  "digest": "0b71a936edf5bd70cf274aaa5d7abc8f77fe8e7b5593a208f805cc9436fac646b9c4f0b43c2b10de63ff3da671497d35536077ecbc72dba7f8159a38b580f831",
    13:37:26     INFO -  "algorithm": "sha512",
    13:37:26     INFO -  "filename": "sccache.tar.bz2",
    13:37:26     INFO -  "unpack": true
    13:37:26     INFO -  },
    13:37:26     INFO -  {
    13:37:26     INFO -  "size": 86474070,
    13:37:26     INFO -  "digest": "85d528ba396d35e38280d01586d91c082a57846fb82c471579632995565caa54320b083581b04d96e526efa6cef53ea076a32c25f220f7f32f651a4dfdf30e31",
    13:37:26     INFO -  "algorithm": "sha512",
    13:37:26     INFO -  "filename": "rustc.tar.gz",
    13:37:26     INFO -  "unpack": true
    13:37:26     INFO -  }
    13:37:26     INFO -  ]
    13:37:26     INFO -  =======================================================
    13:37:26     INFO -  Fetching...
    13:37:26     INFO -  Executing: ['/builds/tooltool.py', '--authentication-file', '/builds/relengapi.tok', '--url', 'https://api.pub.build.mozilla.org/tooltool/', '--overwrite', '-m', '/builds/slave/m-cen-m64-00000000000000000000/build/src/browser/config/tooltool-manifests/macosx64/releng.manifest', 'fetch', '-c', '/builds/tooltool_cache']
    13:37:28     INFO -  INFO - rm tree: clang
    13:37:28     INFO -  INFO - untarring "clang.tar.bz2"
    13:37:38     INFO -  INFO - rm tree: sccache
    13:37:38     INFO -  INFO - untarring "sccache.tar.bz2"
    13:37:38     INFO -  INFO - rm tree: rustc
    13:37:39     INFO -  INFO - untarring "rustc.tar.gz"
    13:37:44     INFO - Return code: 0

Failed fetch of artifact by m-c build starting at Wed Jul 22 14:40:02 PDT 2015 - log at http://ftp.mozilla.org/pub/mozilla.org/thunderbird/tinderbox-builds/comm-central-macosx64/1437600918/comm-central-macosx64-bm84-build1-build11.txt.gz:

    mail/config/tooltool-manifests/macosx64/releng.manifest content
    =======================================================
    [
    {
    "clang_version": "r183744"
    }, 
    {
    "size": 59602619, 
    "digest": "86662ebc0ef650490559005948c4f0cb015dad72c7cac43732c2bf2995247081e30c139cf8008d19670a0009fc302c4eee2676981ee3f9ff4a15c01af22b783b", 
    "algorithm": "sha512", 
    "filename": "clang.tar.bz2",
    "unpack": true
    },
    {
    "size": 167175,
    "digest": "0b71a936edf5bd70cf274aaa5d7abc8f77fe8e7b5593a208f805cc9436fac646b9c4f0b43c2b10de63ff3da671497d35536077ecbc72dba7f8159a38b580f831",
    "algorithm": "sha512",
    "filename": "sccache.tar.bz2",
    "unpack": true
    },
    {
    "size": 86474070,
    "digest": "85d528ba396d35e38280d01586d91c082a57846fb82c471579632995565caa54320b083581b04d96e526efa6cef53ea076a32c25f220f7f32f651a4dfdf30e31",
    "algorithm": "sha512",
    "filename": "rustc.tar.gz",
    "unpack": true
    }
    ]
    =======================================================
    Fetching...
    Executing: ['/tools/tooltool.py', '--url', 'http://tooltool.pvt.build.mozilla.org/build', '--overwrite', '-m', 'mail/config/tooltool-manifests/macosx64/releng.manifest', 'fetch']
    INFO - Attempting to fetch from 'http://tooltool.pvt.build.mozilla.org/build/'...
    INFO - File clang.tar.bz2 fetched from http://tooltool.pvt.build.mozilla.org/build/ as /builds/slave/tb-c-cen-m64-00000000000000000/build/tmpIkA7DR
    INFO - Attempting to fetch from 'http://tooltool.pvt.build.mozilla.org/build/'...
    INFO - File sccache.tar.bz2 fetched from http://tooltool.pvt.build.mozilla.org/build/ as /builds/slave/tb-c-cen-m64-00000000000000000/build/tmp6r33JP
    INFO - Attempting to fetch from 'http://tooltool.pvt.build.mozilla.org/build/'...
    INFO - ...failed to fetch 'rustc.tar.gz' from http://tooltool.pvt.build.mozilla.org/build/
    INFO - File integrity verified, renaming tmpIkA7DR to clang.tar.bz2
    INFO - File integrity verified, renaming tmp6r33JP to sccache.tar.bz2

Note that all shas are the same, and the other 2 were successful.
Confirmed that file is available at the new tooltool (s3 backed). As temp workaround, downloaded from s3 using tooltool.py, then uploaded to old tooltool (nfs backed) following https://wiki.mozilla.org/ReleaseEngineering/Applications/Tooltool#Tooltool_uploads:_the_old_school

:ewong has retriggered build. :hwine crosses fingers _and_ toes
(In reply to Hal Wine [:hwine] (use NI) from comment #4)
> :ewong has retriggered build. :hwine crosses fingers _and_ toes

Both builds are far past the prior failure point - workaround successful.
Whiteboard: [workaround in comment 4]
This process should be upgraded to use the new tooltool.  The old will remain around until we succeed in performing build promotion, or until the current ESR expires, whichever is shorter, at which point they will be turned off (bug 1184951)
Blocks: oxidation
This bug is no longer relevant, correct?
Flags: needinfo?(ewong)
(In reply to Nathan Froyd [:froydnj] from comment #7)
> This bug is no longer relevant, correct?

I believe that's the case.
Status: NEW → RESOLVED
Closed: 8 years ago
Flags: needinfo?(ewong)
Resolution: --- → FIXED
Component: General Automation → General
You need to log in before you can comment on or make changes to this bug.