backup1.private.mtv2.mozilla.com:Disk CrashPlan - All is CRITICAL

RESOLVED FIXED

Status

Infrastructure & Operations
MOC: Problems
RESOLVED FIXED
2 years ago
2 years ago

People

(Reporter: sal, Assigned: Mark Jeffries)

Tracking

Details

(Reporter)

Description

2 years ago
<@nagios-scl3> Tue 16:08:51 PST [5021] backup1.private.mtv2.mozilla.com:Disk CrashPlan - All is CRITICAL: DISK CRITICAL - free space: / 473709 MB (98% inode=99%): /dev/shm 2920 MB (100% inode=99%): /boot 388 MB (86% inode=99%): /data 0 MB (0% inode=3%): /data0 1802 MB (0% inode=99%): (http://m.mozilla.org/Disk+CrashPlan+-+All)

Mark can you take a look? 


[root@backup1.private.mtv2 /]# du -chx --max-depth=1 .

2.9G	./home
1.6G	./usr
6.7G	total

[root@backup1.private.mtv2 home]# du -chx --max-depth=1 .
2.9G	./crashplan
2.9G	.
2.9G	total
(Reporter)

Updated

2 years ago
Flags: needinfo?(mjeffries)

Comment 1

2 years ago
[dgarvey@backup1.private.mtv2 ~]$ df -h
Filesystem      Size  Used Avail Use% Mounted on
/dev/sdb3       495G  6.8G  463G   2% /
tmpfs           2.9G     0  2.9G   0% /dev/shm
/dev/sdb1       477M   63M  389M  14% /boot
/dev/sda1        40T   40T  268K 100% /data
/dev/md127      917G  869G  1.8G 100% /data0
[dgarvey@backup1.private.mtv2 ~]$

Comment 2

2 years ago
<dgarvey> mjeffies ping https://bugzilla.mozilla.org/show_bug.cgi?id=1237126
<dgarvey> mjeffries_ ^
<mjeffries_> dgarvey: pong. I will check the MTV CP server tonight to see if I can free up some space.
◀━━ ━━▶
(Reporter)

Comment 3

2 years ago
Mark are you cleaning up more or should we close the bug? , alert recovered btw.

@nagios-scl3> Thu 16:22:44 PST backup1.private.mtv2.mozilla.com:Disk CrashPlan - All is DOWNTIMEEND (OK): DISK OK - free space: / 473714 MB (98% inode=99%): /dev/shm 2920 MB (100% inode=99%): /boot 388 MB (86% inode=99%): /data 116286 MB (0% inode=99%): /data0 88209 MB (9% inode=99%): (http://m.mozilla.org/Disk+CrashPlan+-+All) (notify-by-email) DISK OK - free space: / 473714 MB (98% inode=99%): /dev/shm 2920 MB (100% inode=99%): /boot 388 MB 


[root@backup1.private.mtv2 sespinoza]# df -h
Filesystem      Size  Used Avail Use% Mounted on
/dev/sdb3       495G  6.8G  463G   2% /
tmpfs           2.9G     0  2.9G   0% /dev/shm
/dev/sdb1       477M   63M  389M  14% /boot
/dev/sda1        40T   40T  109G 100% /data
/dev/md127      917G  785G   87G  91% /data0
[root@backup1.private.mtv2 sespinoza]#

Comment 4

2 years ago
Mark - disk space alerted again.  Can you free up some space?
(Assignee)

Comment 5

2 years ago
Let me see what I can free up.
Flags: needinfo?(mjeffries)

Comment 6

2 years ago
forgot to include the alert:

Tue 12:40:47 PST [5262] backup1.private.mtv2.mozilla.com:Disk CrashPlan - All is CRITICAL: DISK CRITICAL - free space: / 473655 MB (98% inode=99%): /dev/shm 2920 MB (100% inode=99%): /boot 388 MB (86% inode=99%): /data 0 MB (0% inode=3%): /data0 27758 MB (3% inode=99%): (http://m.mozilla.org/Disk+CrashPlan+-+All)
Assignee: nobody → mjeffries

Updated

2 years ago
Status: NEW → ASSIGNED
Component: MOC: Service Requests → MOC: Problems
(Assignee)

Comment 7

2 years ago
MTV's CrashPlan server is very space constrained, and we are tapped out on adding more drive space to it. I'm in the process of moving IT users who use a lot of capacity to our CP remote data server, which should free more space for regular users until we start mass movement to the Mozilla CP remote data server - which is targeted for Q2.
Looks like this was taken care of.  IIRC, this box was trimmed of CP users who were no longer with the company.  Thanks mjeffries!
Status: ASSIGNED → RESOLVED
Last Resolved: 2 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.