982067 - trackbacks on build masters

Status: RESOLVED WONTFIX

(Release Engineering :: General, defect)

Description

[[e-mail] (:bhearsum)]

Noticed these this morning:
Exception in bm70:/builds/buildbot/build1/master/twistd.log:
2014-03-11 05:10:34-0700 [-] Unhandled Error
        Traceback (most recent call last):
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_d420aaf60317_production_0.8-py2.7.egg/buildbot/process/builder.py", line 517, in _claim_buildreqs
            sb = self._choose_slave(available_slaves)
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_d420aaf60317_production_0.8-py2.7.egg/buildbot/process/builder.py", line 548, in _choose_slave
            return self.nextSlave(self, available_slaves)
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbotcustom/misc.py", line 270, in _nextSlave
            except Exception:
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbotcustom/misc.py", line 453, in _nextSlave
            # Something went wrong; fallback to using any available machine
        --- <exception caught here> ---
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbotcustom/misc.py", line 402, in get_slaves


Exception in bm66:/builds/buildbot/build1/master/twistd.log.4:
2014-03-11 05:12:02-0700 [-] Unhandled Error
        Traceback (most recent call last):
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_f23f5672becd_production_0.8-py2.7.egg/buildbot/process/builder.py", line 517, in _claim_buildreqs
            sb = self._choose_slave(available_slaves)
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_f23f5672becd_production_0.8-py2.7.egg/buildbot/process/builder.py", line 548, in _choose_slave
            return self.nextSlave(self, available_slaves)
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbotcustom/misc.py", line 270, in _nextSlave
            " randomly instead" % builder.name)
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbotcustom/misc.py", line 453, in _nextSlave

Comment 1

[Chris AtLee [:catlee]]

Very similar issue here:
2014-03-11 05:10:34-0700 [-] Error choosing next slave for builder 'Firefox mozilla-aurora linux l10n nightly', choosing randomly instead
2014-03-11 05:10:34-0700 [-] Unhandled Error
        Traceback (most recent call last):
          File "/builds/buildbot/build1/lib/python2.7/site-packages/twisted/python/context.py", line 37, in callWithContext
            return func(*args,**kw)
          File "/builds/buildbot/build1/lib/python2.7/site-packages/twisted/enterprise/adbapi.py", line 429, in _runInteraction
            result = interaction(trans, *args, **kw)
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_d420aaf60317_production_0.8-py2.7.egg/buildbot/process/builder.py", line 517, in _claim_buildreqs
            sb = self._choose_slave(available_slaves)
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbot-0.8.2_hg_d420aaf60317_production_0.8-py2.7.egg/buildbot/process/builder.py", line 548, in _choose_slave
            return self.nextSlave(self, available_slaves)
        --- <exception caught here> ---
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbotcustom/misc.py", line 270, in _nextSlave
            except Exception:
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbotcustom/misc.py", line 457, in _nextSlave
            return _nextSlave
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbotcustom/misc.py", line 620, in _nextSlave
            return sorter(ondemand, builder)
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbotcustom/misc.py", line 552, in sorter
            if not slaves:
          File "/builds/buildbot/build1/lib/python2.7/site-packages/buildbotcustom/misc.py", line 258, in sortfunc
            t2 = _getLastTimeOnBuilder(builder, s2.slave.slavename)
        exceptions.AttributeError: 'NoneType' object has no attribute 'slavename'

Comment 2

[Rail Aliiev [:rail]]

buildbot is almost dead!