544515 - Connection refused and MySQL errors from wiki.mozilla.org

Status: RESOLVED FIXED

(mozilla.org Graveyard :: Server Operations, task)

Description

[Michael Hanson]

Several times (4-5) in the last 24 hours, I've received errors from wiki.mozilla.org.  Sometimes it manifests as a connection refused, and sometimes it manifests as an error message in text:

MySQL returned error "1205: Lock wait timeout exceeded; try restarting transaction (10.2.70.80)".

Comment 1

[Dave Miller [:justdave]]

Possibly fallout from the databases getting root passwords enforced.  We have a few maintenance scripts that assumed there were no passwords.  I just fixed the ones on that database server to read the config file like it's supposed to, so it should be cleaning up the db locks that reporter (which is on the same server) leaves behind again.

If you get any more of these please reopen.

Comment 2

[Chris Beard]

still happening

Comment 3

[Dave Miller [:justdave]]

ok, not related to the password lockdown thing then...  maybe something specific to mediawiki?

Comment 4

[Zandr Milewski [:zandr]]

Also saw a number of connection resets yesterday, reported both from MV and the community. Possibly unrelated.

Comment 5

[Dave Miller [:justdave]]

sounds like we've had a few of these on sites other than wikimo... maybe it's the Netscaler?

Comment 6

[Michael Hanson]

Chris, are you still seeing the MySQL lock wait timeouts?  If so, that's not the Netscaler.  Agreed that the connection resets could be from there.

Comment 7

[Chris Beard]

(In reply to comment #6)
> Chris, are you still seeing the MySQL lock wait timeouts?  If so, that's not
> the Netscaler.  Agreed that the connection resets could be from there.

yeah, i was seeing the same error message as in comment 1

it seems to be working now though....

Comment 8

[Phong Tran [:phong]]

closing this based on comment 7.