1001537 - Disk /pgdata on socorro1.stage.db.phx1.mozilla.com is CRITICAL: DISK CRITICAL - free space: /pgdata 39501 MB (1% inode=99%):

Status: RESOLVED DUPLICATE of bug 996111

(Data & BI Services Team :: DB: MySQL, task)

Description

[MOC Nagios API]

Automated alert report from nagios1.private.phx1.mozilla.com:

Hostname: socorro1.stage.db.phx1.mozilla.com
Service:  Disk /pgdata
State:    CRITICAL
Output:   DISK CRITICAL - free space: /pgdata 39501 MB (1% inode=99%):

Runbook:  http://m.allizom.org/Disk+/pgdata

Comment 1

[Adrian J Fernandez [:Aj]]

Filesystem            Size  Used Avail Use% Mounted on
/dev/cciss/c0d0p1     2.0T  2.0T   39G  99% /pgdata

Comment 2

[Brandon Johnson [:cyborgshadow]]

This is legit postgres data only.

Gonna have to bring mpressman in on this to see where it came from. Since it did more than 10% of disk usage in under the interval of alert checks, I'm assuming this is something he may be aware of.

[[e-mail]1 ~]# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/vg_dbsoc-lv_root
                       60G   21G   36G  37% /
tmpfs                  12G     0   12G   0% /dev/shm
/dev/sda1             485M   94M  366M  21% /boot
/dev/mapper/vg_dbsoc-lv_wal
                       50G   33M   50G   1% /wal
/dev/cciss/c0d0p1     2.0T  2.0T   39G  99% /pgdata
[[e-mail]1 ~]# cd /pgdata/9.2/data/base/
[[e-mail]1 base]# du -sh 16408
2.0T	16408

Comment 3

[Brandon Johnson [:cyborgshadow]]

Closing as dupe of 996111 per sheeri's statement in irc.

Comment 4

[Matt Pressman [:mpressman]]

Dupe of 996111 - clearing needinfo