797861 - (b-linux64-hp-0029) b-linux64-hp-0029 problem tracking

Status: RESOLVED WONTFIX

(Infrastructure & Operations Graveyard :: CIDuty, task)

Comment 1

[Kim Moir [:kmoir] ET]

Reset raid config and now it's booted and is running a build

Comment 2

[Nick Thomas [:nthomas] (UTC+12)]

PDU rebooted for PING DOWN.

Comment 3

[Nick Thomas [:nthomas] (UTC+12)]

And again, DHCP failure.

Comment 4

[Phil Ringnalda (:philor)]

No space left on device, disabled in slavealloc.

Comment 5

[Phil Ringnalda (:philor)]

Somebody apparently cleared some space and reenabled it without mentioning it here, but now it has a stuck lockfile in the shared git repo which makes it say

GitError: platform/external/ipsec-tools update-ref: fatal: Unable to create '/builds/slave/b2g_m-cen_nexus-4_dep-00000000/build/.repo/projects/external/ipsec-tools.git/refs/remotes/m/master.lock': File exists.

for every b2g build it attempts (on every tree, the tree-specific directory is a lie).

Redisabled in slavealloc.

Comment 6

[Nick Thomas [:nthomas] (UTC+12)]

Back into production.

Comment 7

[Ryan VanderMeulen [:RyanVM]]

Out of space. Disabled.
https://tbpl.mozilla.org/php/getParsedLog.php?id=45613945&tree=Mozilla-B2g32-v2.0

Comment 8

[Nick Thomas [:nthomas] (UTC+12)]

Cleaned up old release builds, re-enabled.

Comment 9

[Phil Ringnalda (:philor)]

Hasn't taken a job for six days.

Comment 10

[Justin Wood (:Callek)]

Sep 10 09:53:32 b-linux64-hp-0029 abrtd: Init complete, entering main loop
...
Sep 10 09:54:03 b-linux64-hp-0029 python: abrt: detected unhandled Python exception
Sep 10 09:54:21 b-linux64-hp-0029 python: abrt: detected unhandled Python exception
Sep 10 09:54:34 b-linux64-hp-0029 python: abrt: detected unhandled Python exception
Sep 10 09:54:46 b-linux64-hp-0029 python: abrt: detected unhandled Python exception
Sep 10 09:55:02 b-linux64-hp-0029 python: abrt: detected unhandled Python exception

...

hg pull -R /builds/hg-shared/build/compare-locales
warning: hg.mozilla.org certificate with fingerprint af:27:b9:34:47:4e:e5:98:01:f6:83:2b:51:c9:aa:d8:df:fb:1a:27 not verified (
eck hostfingerprints or web.cacerts config setting)
pulling from https://hg.mozilla.org/integration/b2g-inbound
searching for changes
adding changesets
transaction abort!
rollback completed
abort: revlog decompress error: Error -5 while decompressing data: incomplete or truncated stream!
xargs: hg: exited with status 255; aborting
pulling from https://hg.mozilla.org/build/compare-locales
searching for changes
no changes found
pulling from https://hg.mozilla.org//integration/gaia-central
searching for changes
adding changesets
adding manifests
transaction abort!
rollback completed
abort: revlog decompress error: Error -5 while decompressing data: incomplete or truncated stream!
xargs: hg: exited with status 255; aborting
pulling from https://hg.mozilla.org/integration/mozilla-inbound
searching for changes
adding changesets
transaction abort!
rollback completed
** unknown exception encountered, please report by visiting
** http://mercurial.selenic.com/wiki/BugTracker
** Python 2.7.3 (default, Sep 10 2013, 11:27:00) [GCC 4.4.6 20110731 (Red Hat 4.4.6-3)]
** Mercurial Distributed SCM (version 2.5.4)
** Extensions loaded: share, rebase, mq, purge
Traceback (most recent call last):
  File "/usr/local/bin/hg", line 38, in <module>
    mercurial.dispatch.run()
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/dispatch.py", line 28, in run
    sys.exit((dispatch(request(sys.argv[1:])) or 0) & 255)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/dispatch.py", line 65, in dispatch
    return _runcatch(req)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/dispatch.py", line 88, in _runcatch
    return _dispatch(req)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/dispatch.py", line 743, in _dispatch
    cmdpats, cmdoptions)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/dispatch.py", line 514, in runcommand
    ret = _runcommand(ui, options, cmd, d)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/dispatch.py", line 833, in _runcommand
    return checkargs()
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/dispatch.py", line 804, in checkargs
    return cmdfunc()
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/dispatch.py", line 740, in <lambda>
    d = lambda: util.checksignature(func)(ui, *args, **cmdoptions)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/util.py", line 475, in check
    return func(*args, **kwargs)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/extensions.py", line 144, in wrap
    util.checksignature(origfn), *args, **kwargs)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/util.py", line 475, in check
    return func(*args, **kwargs)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/hgext/mq.py", line 3508, in mqcommand
    return orig(ui, repo, *args, **kwargs)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/util.py", line 475, in check
    return func(*args, **kwargs)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/extensions.py", line 144, in wrap
    util.checksignature(origfn), *args, **kwargs)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/util.py", line 475, in check
    return func(*args, **kwargs)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/hgext/rebase.py", line 779, in pullrebase
    orig(ui, repo, *args, **opts)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/util.py", line 475, in check
    return func(*args, **kwargs)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/commands.py", line 4743, in pull
    modheads = repo.pull(other, heads=revs, force=opts.get('force'))
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/localrepo.py", line 1699, in pull
    result = self.addchangegroup(cg, 'pull', remote.url())
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/localrepo.py", line 58, in wrapper
    return orig(repo.unfiltered(), *args, **kwargs)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/localrepo.py", line 2276, in addchangegroup
    srccontent = cl.addgroup(source, csmap, trp)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/revlog.py", line 1241, in addgroup
    p1, p2, (baserev, delta), ifh, dfh)
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/revlog.py", line 1111, in _addrevision
    text = buildtext()
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/revlog.py", line 1053, in buildtext
    basetext = self.revision(self.node(cachedelta[0]))
  File "/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/revlog.py", line 929, in revision
    text = mdiff.patches(text, bins)
mpatch.mpatchError: patch cannot be decoded

Sounds like hardware faults

Comment 11

[Chris Cooper [:coop] (he/him)]

Please do not re-enable this slave. We are retiring linux hardware build slaves in bug 1106922.