1379179 - intermittent connection errors to aus4-admin.mozilla.org

Status: RESOLVED WONTFIX

(Cloud Services :: Operations: Miscellaneous, task)

Description

[[e-mail] (:bhearsum)]

Probably rooted in the same issues as bug 1377796, but we saw new occurences today, eg:
07:45:19     INFO -  Traceback (most recent call last):
07:45:19     INFO -    File "/builds/slave/rel-m-beta-de_publish_balrog-0/build/tools/scripts/build-promotion/balrog-release-shipper.py", line 57, in <module>
07:45:19     INFO -      args.build_number, args.rule_ids, args.backgroundRate)
07:45:19     INFO -    File "/builds/slave/rel-m-beta-de_publish_balrog-0/build/tools/scripts/build-promotion/../../lib/python/balrog/submitter/cli.py", line 497, in run
07:45:19     INFO -      ).update_rule(**data)
07:45:19     INFO -    File "/builds/slave/rel-m-beta-de_publish_balrog-0/build/tools/lib/python/vendor/balrogclient-0.0.4/balrogclient/api.py", line 239, in update_rule
07:45:19     INFO -      return self.request(method='POST', data=rule_data)
07:45:19     INFO -    File "/builds/slave/rel-m-beta-de_publish_balrog-0/build/tools/lib/python/vendor/balrogclient-0.0.4/balrogclient/api.py", line 88, in request
07:45:19     INFO -      res = self.do_request(prerequest_url, None, 'HEAD')
07:45:19     INFO -    File "/builds/slave/rel-m-beta-de_publish_balrog-0/build/tools/lib/python/vendor/balrogclient-0.0.4/balrogclient/api.py", line 127, in do_request
07:45:19     INFO -      verify=self.verify, auth=self.auth, headers=headers)
07:45:19     INFO -    File "/builds/slave/rel-m-beta-de_publish_balrog-0/build/tools/scripts/build-promotion/../../lib/python/vendor/requests-2.7.0/requests/sessions.py", line 465, in request
07:45:19     INFO -      resp = self.send(prep, **send_kwargs)
07:45:19     INFO -    File "/builds/slave/rel-m-beta-de_publish_balrog-0/build/tools/scripts/build-promotion/../../lib/python/vendor/requests-2.7.0/requests/sessions.py", line 573, in send
07:45:19     INFO -      r = adapter.send(request, **kwargs)
07:45:19     INFO -    File "/builds/slave/rel-m-beta-de_publish_balrog-0/build/tools/scripts/build-promotion/../../lib/python/vendor/requests-2.7.0/requests/adapters.py", line 415, in send
07:45:19     INFO -      raise ConnectionError(err, request=request)
07:45:19     INFO -  requests.exceptions.ConnectionError: ('Connection aborted.', BadStatusLine("''",))


Seems very intermittent at the moment - a subsequent attempt succeeded.

Comment 1

[Daniel Thorn [:relud]]

25 requests have had a connection terminated in the last 24 hours, and all of them were due to ldap timing out.

Comment 2

[Daniel Thorn [:relud]]

looking at the metrics, this was a transient thing. it showed up once for a brief moment around 7:45, and hasn't come back. I'm going to resolve wontfix until this comes back again