629652 - lots of Pulse exceptions in Buildbot Master twistd logs

Status: RESOLVED DUPLICATE of bug 628720

(Release Engineering :: General, defect, P2)

Description

[[e-mail] (:bhearsum)]

There's two different ones. The first is a timeout:
The following exceptions (total 1) were detected on buildbot-master1.build.scl1.mozilla.com tests_master3:

Exception in /builds/buildbot/tests_master3/master/twistd.log.2:
2011-01-27 15:48:36-0800 [-] Unhandled Error
	Traceback (most recent call last):
	  File "/tools/python-2.6.5/lib/python2.6/threading.py", line 484, in run
	    self.__target(*self.__args, **self.__kwargs)
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/twisted/python/threadpool.py", line 207, in _worker
	    result = context.call(ctx, function, *args, **kwargs)
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/twisted/python/context.py", line 59, in callWithContext
	    return self.currentContext().callWithContext(ctx, func, *args, **kw)
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/twisted/python/context.py", line 37, in callWithContext
	    return func(*args,**kw)
	--- <exception caught here> ---
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/buildbotcustom/status/pulse.py", line 95, in threadedPush
	    self.publisher.publish(msg)
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/mozillapulse/publishers.py", line 66, in publish
	    routing_key=message.routing_key)
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/carrot/messaging.py", line 657, in __init__
	    self.declare()
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/carrot/messaging.py", line 669, in declare
	    auto_delete=self.auto_delete)
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/carrot/backends/pyamqplib.py", line 253, in exchange_declare
	    return self.channel.exchange_declare(exchange=exchange,
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/carrot/backends/pyamqplib.py", line 188, in channel
	    self._channel_ref = weakref.ref(connection.channel())
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/amqplib/client_0_8/connection.py", line 230, in channel
	    return Channel(self, channel_id)
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/amqplib/client_0_8/channel.py", line 82, in __init__
	    self._x_open()
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/amqplib/client_0_8/channel.py", line 471, in _x_open
	    (20, 11),    # Channel.open_ok
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/amqplib/client_0_8/abstract_channel.py", line 89, in wait
	    self.channel_id, allowed_methods)
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/amqplib/client_0_8/connection.py", line 198, in _wait_method
	    self.method_reader.read_method()
	  File "/builds/buildbot/tests_master3/lib/python2.6/site-packages/amqplib/client_0_8/method_framing.py", line 215, in read_method
	    raise m
	socket.error: [Errno 110] Connection timed out



The second I can't make heads or tails of:
The following exceptions (total 1) were detected on buildbot-master3.build.mozilla.org try_master1:

Exception in /builds/buildbot/try_master1/master/twistd.log:
2011-01-27 22:04:08-0800 [-] Unhandled Error
	Traceback (most recent call last):
	  File "/tools/python-2.6.5/lib/python2.6/threading.py", line 484, in run
	    self.__target(*self.__args, **self.__kwargs)
	  File "/builds/buildbot/try_master1/lib/python2.6/site-packages/twisted/python/threadpool.py", line 207, in _worker
	    result = context.call(ctx, function, *args, **kwargs)
	  File "/builds/buildbot/try_master1/lib/python2.6/site-packages/twisted/python/context.py", line 59, in callWithContext
	    return self.currentContext().callWithContext(ctx, func, *args, **kw)
	  File "/builds/buildbot/try_master1/lib/python2.6/site-packages/twisted/python/context.py", line 37, in callWithContext
	    return func(*args,**kw)
	--- <exception caught here> ---
	  File "/builds/buildbot/try_master1/buildbotcustom/status/pulse.py", line 95, in threadedPush
	    self.publisher.publish(msg)
	  File "build/bdist.linux-i686/egg/mozillapulse/publishers.py", line 67, in publish