mozillians.org has db problems

VERIFIED FIXED

Status

Infrastructure & Operations
WebOps: IT-Managed Tools
VERIFIED FIXED
11 months ago
11 months ago

People

(Reporter: sal, Assigned: danielh)

Tracking

Details

(Whiteboard: [kanban:https://webops.kanbanize.com/ctrl_board/2/4242])

(Reporter)

Description

11 months ago
reported by user;

tasos> unixfairy: mozillians.org still has db problems
11:00:13 <unixfairy> tasos what kind
11:00:15 <tasos>  OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0")
11:00:36 <unixfairy> when performing a search or?
11:01:34 <tasos> I am trying to figure this out. 
11:01:57 <tasos> celery seems to be causing this issues
11:02:08 <tasos> is it possible to trigger a restart?
11:02:32 <unixfairy> sal^^
11:03:03 <unixfairy> we do not have any alerts so where are you seeing the issues
11:03:40 <tasos> I am getting email tracebacks. 
11:03:57 <tasos> also sentry is logging the errors here
11:03:57 <tasos> https://sentry.prod.mozaws.net/operations/mozilliansorg-prod/

Updated

11 months ago
Whiteboard: [kanban:https://webops.kanbanize.com/ctrl_board/2/4242]
The initial error was:

django.db.utils:OperationalError: (2013, "Lost connection to MySQL server at 'reading initial communication packet', system error: 0") 

New relic no longer logs this issue so I am not sure if this is still a valid bug.
(Assignee)

Comment 2

11 months ago
Thanks for creating a bug to track this. It looks like this corresponds with the page that WebOps received on Saturday. Looking at New Relic, we can see that this lasted from about 9am - 10:30am pacific on Feb 11th and the error rate has dropped back to normal since then.

I think it's reasonable to mark this as resolved for now. Is there anything else I can do on this bug to help out?
Flags: needinfo?(sespinoza)

Updated

11 months ago
Assignee: server-ops-webops → dhartnell
(Assignee)

Comment 3

11 months ago
As mentioned in my previous message, I'm going to go ahead and mark this as resolved. If there's anything else I can do to help, please re-open this and let me know.
Status: NEW → RESOLVED
Last Resolved: 11 months ago
Resolution: --- → FIXED
(Reporter)

Comment 4

11 months ago
thanks :danielh
Status: RESOLVED → VERIFIED
Flags: needinfo?(sespinoza)
You need to log in before you can comment on or make changes to this bug.