1220638 - B2g 2.5 Desktop Linux Builds fail with ERROR - The following files failed: 'moz-tt.tar.bz2'

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Carsten Book [:Tomcat]]

CalledProcessError: Command '['hg', 'unbundle', '--traceback', 
                            'https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-b2g44_v2_5.hg']' returned non-zero exit status 255

-> https://treeherder.mozilla.org/logviewer.html#?job_id=1175&repo=mozilla-b2g44_v2_5

tested this and seems to be real 404

Comment 1

[Kendall Libby [:fubar] (he/him)]

I'm not sure what the deal is with pulling bundles from ftp-ssl.m.o, or what's putting the bundles there (they haven't been updated since Oct 20). The bundles that dev services generates are up to date on https://hg.cdn.mozilla.net, including mozilla-b2g44_v2_5.

Comment 2

[Chris AtLee [:catlee]]

The real error is this:
 ERROR - The following files failed: 'moz-tt.tar.bz2'
 retry: Calling <function run_with_timeout at 0x7f2a49e2f7d0> with args: (['/tools/tooltool.py', '--url', 'http://tooltool.pvt.build.mozilla.org/build', '--overwrite', '-m', 'b2g/config/tooltool-manifests/linux64/releng.manifest', 'fetch', '-c', '/builds/tooltool_cache'], 300, None, None, False, True), kwargs: {}, attempt #2
 Executing: ['/tools/tooltool.py', '--url', 'http://tooltool.pvt.build.mozilla.org/build', '--overwrite', '-m', 'b2g/config/tooltool-manifests/linux64/releng.manifest', 'fetch', '-c', '/builds/tooltool_cache']
 INFO - File moz-tt.tar.bz2 not present in local cache folder /builds/tooltool_cache
 INFO - Attempting to fetch from 'http://tooltool.pvt.build.mozilla.org/build/'...
 INFO - ...failed to fetch 'moz-tt.tar.bz2' from http://tooltool.pvt.build.mozilla.org/build/
 INFO - rm tree: gcc
 INFO - untarring "gcc.tar.xz"
 INFO - rm tree: gtk3
 INFO - untarring "gtk3.tar.xz"
 INFO - rm tree: sccache
 INFO - untarring "sccache.tar.bz2"
 ERROR - The following files failed: 'moz-tt.tar.bz2'

Comment 3

[Jonathan Griffin (:jgriffin)]

The buildbot code which runs this tooltool fetch needs to fail after all the retries fail with an error string that matches one of these:

https://github.com/mozilla/treeherder/blob/master/treeherder/log_parser/parsers.py#L378

Comment 4

[Chris AtLee [:catlee]]

We can turn off b2g desktop builds on 2.5

Comment 5

[Chris AtLee [:catlee]]

Attachment: b2g-2.5-desktop-buildbot-configs.patch

Comment 6

[Justin Wood (:Callek)]

Comment on attachment 8682080 [details] [diff] [review]
b2g-2.5-desktop-buildbot-configs.patch

Review of attachment 8682080 [details] [diff] [review]:
-----------------------------------------------------------------

this does the c#4 thing of just disabling...

Comment 7

[Release Engineering SlaveAPI Service]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/5bd76ab0b76f

Comment 8

[Release Engineering SlaveAPI Service]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/fe55e58ec3a0