Closed Bug 885373 Opened 12 years ago Closed 12 years ago

mysql table checksums need a wrapper script to detect if it's already running

Categories

(Data & BI Services Team :: DB: MySQL, task, P2)

Product:
Data & BI Services Team
Component:
DB: MySQL
Platform:
x86
macOS
Type:
task

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: bjohnson, Assigned: bjohnson)

Details

(Whiteboard: [2013q3] July)

We run pt-table-checksum on most servers twice daily. While rare, I've seen it gum up on itself a few times and get itself stuck. Most recently was this morning with mysql1.metrics in scl3. We had some running from the 12th and on every day. With about 10 copies running, the server load was really high. Killing the checksums and restarting one manually fixed the issue. We should write a wrapper script that does the below: - Checks if the checksum is already running or not. - If it's running and less than 24 hours old, let it continue and die. - If it's running and older than 24 hours, kill it and continue. - If it's not running, continue.
potential Q3 goal?
Flags: needinfo?(scabral)
Flags: needinfo?(scabral)
Whiteboard: [2013q3]
Assignee: server-ops-database → bjohnson
Whiteboard: [2013q3] → [2013q3] July was [2013q2]
Whiteboard: [2013q3] July was [2013q2] → [2013q3] July
Priority: -- → P2
Committed. :)
Status: NEW → RESOLVED
Closed: 12 years ago
Resolution: --- → FIXED
Product: mozilla.org → Data & BI Services Team
You need to log in before you can comment on or make changes to this bug.