Closed Bug 745238 Opened 13 years ago Closed 13 years ago

Unable to access certain tables due to broken temporary tables

Categories

(Data & BI Services Team :: DB: MySQL, task)

x86
macOS
task
Not set
critical

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: peterbe, Assigned: mpressman)

Details

Attachments

(1 file)

(note: Urgently helping Pike who's busy doing a brownbag so my frame of context is low) Here's the error: http://pastebin.mozilla.org/1567811 Apparently this can happen when you run out of memory. Here's the df output: http://pastebin.mozilla.org/1567825 Having "100% Use" on /dev/mapper/VolGroup00-LogVol00 looks just plain scary. The server is bm-l10n-db. We suspect that the join that causes the temp table to be created is running from tables: life_push and life_push_changesets
Assignee: nobody → server-ops-database
Component: Elmo → Server Operations: Database
Product: Webtools → mozilla.org
QA Contact: elmo → cshields
Version: 1.0 → other
I cleared out a couple 500MB sql dumps from /root/ Ganglia is unable to talk to its host and so is spamming /var/log/messages*, which was total about 5GB, which filled the disk I cleaned that up and restarted MySQL, seems ok from looking at attached show table status
Per :Pike on irc, ganglia is waiting on bug 739239 I've stopped gmond for now, so that it doesn't fill up / again [root@l10n-db1 log]# /etc/init.d/gmond stop Shutting down GANGLIA gmond: [ OK ]
Assignee: server-ops-database → bburton
:mpressman I attached the output of show table status, it seems ok, but your review would be great. I've added both your ssh keys from ldap to root's authorized_keys file, so you should be able to ssh bm-l10n-db.mozilla.org -l root and get in
Assignee: bburton → mpressman
Marking FIXED, Matt said on irc we're good, and there haven't been any problems since I started the services again. Thanks for the help.
Status: NEW → RESOLVED
Closed: 13 years ago
Resolution: --- → FIXED
Product: mozilla.org → Data & BI Services Team
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: