682777 - Webifyme: Server errors

Status: RESOLVED FIXED

(Websites :: webifyme.org, defect)

Description

[Chris More [:cmore]]

We have been receiving server errors for Webifyme all weekend and external users are reporting intermittent 403 errors.

Here are a selection of track back errors and server IPs:

IOError: request data read error
'SERVER_ADDR': '10.8.32.35',

IOError: request data read error
'SERVER_ADDR': '10.8.32.30',

IOError: request data read error
 'SERVER_ADDR': '10.8.32.35',


OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0")
'SERVER_ADDR': '10.8.32.25',


OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0")
'SERVER_ADDR': '10.8.32.244',

Exception: Newsletter subscription failed: (6, "Couldn't resolve host 'awesomeness.mozilla.org'")
'SERVER_ADDR': '10.8.32.238',


File "/usr/lib/python2.6/urllib2.py", line 518, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 504: Gateway Time-out
'SERVER_ADDR': '10.8.32.225',


OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 104")
'SERVER_ADDR': '10.8.32.234',

Are we running out of server resources again?

Comment 1

[Chris More [:cmore]]

I've tried taking the quiz and it is very slow so maybe we still have a memory leak.

Comment 2

[Jeremy Orem [:oremj]]

https://ganglia.mozilla.org/phx1/?c=Engagement&m=cpu_report&r=week&s=descending&hc=4&mc=2 <- looks like resources were fine.

Comment 3

[Jeremy Orem [:oremj]]

Is this still happening frequently?

Comment 4

[Chris More [:cmore]]

We had about 25 similar errors last night at 7:15pm PT and then it went away and hasn't happened again. It seems like once or twice a day there is a brief period of time where the site throws Zeus errors.

Comment 5

[Corey Shields [:cshields]]

(In reply to Chris More [:cmore] from comment #4)
> We had about 25 similar errors last night at 7:15pm PT and then it went away
> and hasn't happened again. It seems like once or twice a day there is a
> brief period of time where the site throws Zeus errors.

yeah there was another network issue last night..  would have caused it.  :(