tp-socorro01-master02.phx1 Disk space Critical

RESOLVED FIXED

Status

RESOLVED FIXED
5 years ago
5 years ago

People

(Reporter: rwatson, Assigned: mpressman)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

5 years ago
Have been alerted on #sysadmins of critical disk:
Thu 04:56:21 PST tp-socorro01-master02.phx1.mozilla.com is DOWNTIMEEND (UP) :PING OK - Packet loss = 0%, RTA = 1.82 ms

Thu 04:59:55 PST [1191] tp-socorro01-master02.phx1.mozilla.com:Disk - All is CRITICAL: DISK CRITICAL - free space: / 0 MB (0% inode=53%):

I believe this machine is down timed so not sure how "critical" this is.
(Assignee)

Comment 1

5 years ago
This was due to /wal being expanded. After it came back up, the WAL from socorro1.db.phx1 was filling up / since the postgresql server wasn't running.
Assignee: nobody → mpressman
Status: NEW → RESOLVED
Last Resolved: 5 years ago
Resolution: --- → FIXED
/wal is 90% full again and alerting.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
(Assignee)

Comment 3

5 years ago
The recovery.conf archive cleanup variable was pointing to the previous location /var/lib/pgsql/wal_archive and not the new one: /wal/9.2 - I have reset and now it's being cleaned up

/dev/mapper/vg_dbsoc-lv_wal
               xfs    224G   65M  224G   1% /wal
Status: REOPENED → RESOLVED
Last Resolved: 5 years ago5 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.