736946 - self-serve busted by yet another hg outage

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P2)

Description

[Phil Ringnalda (:philor)]

"buildbot-master10.build.sjc1:self service agent is CRITICAL: PROCS CRITICAL: 0 processes with args selfserve-agent.py"

Comment 1

[Nick Thomas [:nthomas] (UTC+12)]

Yup:

2012-03-18 23:57:05,830 Loading masters from http://hg.mozilla.org/build/tools/raw-file/default/buildfarm/maintenance/production-masters.json
Traceback (most recent call last):
  File "buildapi/buildapi/scripts/selfserve-agent.py", line 562, in <module>
    consumer.wait()
  File "/builds/buildbot/selfserve-agent/lib/python2.6/site-packages/carrot/messaging.py", line 446, in wait
    it.next()
  File "/builds/buildbot/selfserve-agent/lib/python2.6/site-packages/carrot/backends/pyamqplib.py", line 300, in consume
    self.channel.wait()
  File "/builds/buildbot/selfserve-agent/lib/python2.6/site-packages/amqplib/client_0_8/abstract_channel.py", line 107, in wait
    return amqp_method(self, args, content)
  File "/builds/buildbot/selfserve-agent/lib/python2.6/site-packages/amqplib/client_0_8/channel.py", line 1973, in _basic_deliver
    func(msg)
  File "/builds/buildbot/selfserve-agent/lib/python2.6/site-packages/carrot/messaging.py", line 291, in _receive_callback
    self.receive(message.payload, message)
  File "/builds/buildbot/selfserve-agent/lib/python2.6/site-packages/carrot/messaging.py", line 344, in receive
    callback(message_data, message)
  File "buildapi/buildapi/scripts/selfserve-agent.py", line 157, in receive_message
    self._refresh_masters()
  File "buildapi/buildapi/scripts/selfserve-agent.py", line 60, in _refresh_masters
    self.masters = json.load(urllib.urlopen(self.masters_url))
  File "/usr/lib64/python2.6/urllib.py", line 86, in urlopen
    return opener.open(url)
  File "/usr/lib64/python2.6/urllib.py", line 205, in open
    return getattr(self, name)(url)
  File "/usr/lib64/python2.6/urllib.py", line 353, in open_http
    'got a bad status line', None)
IOError: ('http protocol error', 0, 'got a bad status line', None)

Restarted.