1350123 - web2.bugs.scl3.mozilla.com max clients hit

Status: RESOLVED INCOMPLETE

(bugzilla.mozilla.org :: Infrastructure, enhancement)

Description

[Salvador Espinoza [:sal]]

So I was not able to get server-status, httpd graceful cleared.  
Filing this in case it comes back and we need to ban some IP's.

Will close in a few days if the issue doesn't pop up again. 

  

@nagios-scl3> Thu 21:05:03 UTC [5007] web2.bugs.scl3.mozilla.com:httpd max clients is CRITICAL: (Service check timed out after 90.01 seconds) (http://m.mozilla.org/httpd+max+clients)
14:05:14 <@nagios-scl3> Thu 21:05:13 UTC [5009] web2.bugs.scl3.mozilla.com:SCL3 Zeus - Port 443 is CRITICAL: web2.bugs.scl3.mozilla.com down(2) (http://m.mozilla.org/SCL3+Zeus+-+Port+443)
14:07:21 <@nagios-scl3> Thu 21:07:20 UTC [5012] web2.bugs.scl3.mozilla.com:http string - bugzilla.m.o is CRITICAL: CRITICAL - Socket timeout (http://m.mozilla.org/http+string+-+bugzilla.m.o)
14:08:28 <@nagios-scl3> Thu 21:08:27 UTC [5015] web2.bugs.scl3.mozilla.com:https string - bugzilla.m.o is CRITICAL: CRITICAL - Socket timeout (http://m.mozilla.org/https+string+-+bugzilla.m.o)
14:09:33 <@nagios-scl3> Thu 21:09:32 UTC [5018] web2.bugs.scl3.mozilla.com:httpd max clients is OK: Using 3 out of 260 Clients (http://m.mozilla.org/httpd+max+clients)
14:09:44 <@nagios-scl3> Thu 21:09:43 UTC [5020] web2.bugs.scl3.mozilla.com:https string - bugzilla.m.o is OK: HTTP OK: HTTP/1.1 200 OK - 12733 bytes in 0.095 second response time (http://m.mozilla.org/https+string+-+bugzilla.m.o)
14:09:45 <@nagios-scl3> Thu 21:09:43 UTC [5023] web2.bugs.scl3.mozilla.com:http string - bugzilla.m.o is OK: HTTP OK: HTTP/1.1 200 OK - 12733 bytes in 0.113 second response time (http://m.mozilla.org/http+string+-+bugzilla.m.o)

Comment 1

[Emma Humphries ☕️🎸🧞‍♀️✨ (she/they) [:emceeaich] (Pacific Time) use needinfo]

Since this hasn't come up again, I'm closing.