1413025 - investigate missing http timeouts in bbb

Status: RESOLVED WONTFIX

(Release Engineering :: General, enhancement, P2)

Description

[Jordan Lund (:jlund)]

context:

catlee> I saw some pulse alerts about long queues last night
14:12:25 
<•nthomas> https://papertrailapp.com/groups/2819754/events?q=PfWaH7VMRu-ByVzH8K4KSA just has all the setup, no resolution or monitoring
14:12:34 
<•catlee> 15k pending messages
14:12:37 that's not good
14:12:54 
<•nthomas> is that a global count or just the exchanges we care about right now ?
14:13:02 
<•catlee> the two queues we care about
14:13:05 started/log_uploaded
14:13:07 both about 15k
...
catlee> it's hung trying to talk to 174.129.218.85
14:37:23 port 443
14:37:28 some https call needs a timeout

Comment 1

[Chris AtLee [:catlee]]

possible suspects:
https://github.com/mozilla-releng/buildbot-bridge/blob/d3b899ff948e9ea0920b6369ff80c052d20365e3/bbb/tcutils.py#L29
https://github.com/mozilla-releng/buildbot-bridge/blob/a51e733bdc4988aca6f2a3afff67c2a826c7f812/bbb/servicebase.py#L35

Comment 2

[Mihai Tabara [:mtabara]⌚️GMT]

BBB is now dead in 60+, I guess we can close this!