1338820 - mozillians.org has db problems

Status: VERIFIED FIXED

(Infrastructure & Operations :: IT-Managed Tools, task)

Description

[Salvador Espinoza [:sal]]

reported by user;

tasos> unixfairy: mozillians.org still has db problems
11:00:13 <unixfairy> tasos what kind
11:00:15 <tasos>  OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0")
11:00:36 <unixfairy> when performing a search or?
11:01:34 <tasos> I am trying to figure this out. 
11:01:57 <tasos> celery seems to be causing this issues
11:02:08 <tasos> is it possible to trigger a restart?
11:02:32 <unixfairy> sal^^
11:03:03 <unixfairy> we do not have any alerts so where are you seeing the issues
11:03:40 <tasos> I am getting email tracebacks. 
11:03:57 <tasos> also sentry is logging the errors here
11:03:57 <tasos> https://sentry.prod.mozaws.net/operations/mozilliansorg-prod/

Comment 1

[Tasos Katsoulas [:tasos]]

The initial error was:

django.db.utils:OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0") 

New relic no longer logs this issue so I am not sure if this is still a valid bug.

Comment 2

[Daniel Hartnell [:danielh]]

Thanks for creating a bug to track this. It looks like this corresponds with the page that WebOps received on Saturday. Looking at New Relic, we can see that this lasted from about 9am - 10:30am pacific on Feb 11th and the error rate has dropped back to normal since then.

I think it's reasonable to mark this as resolved for now. Is there anything else I can do on this bug to help out?

Comment 3

[Daniel Hartnell [:danielh]]

As mentioned in my previous message, I'm going to go ahead and mark this as resolved. If there's anything else I can do to help, please re-open this and let me know.

Comment 4

[Salvador Espinoza [:sal]]

thanks :danielh