1237126 - backup1.private.mtv2.mozilla.com:Disk CrashPlan - All is CRITICAL

Status: RESOLVED FIXED

(Infrastructure & Operations :: MOC: Problems, task)

Description

[Salvador Espinoza [:sal]]

<@nagios-scl3> Tue 16:08:51 PST [5021] backup1.private.mtv2.mozilla.com:Disk CrashPlan - All is CRITICAL: DISK CRITICAL - free space: / 473709 MB (98% inode=99%): /dev/shm 2920 MB (100% inode=99%): /boot 388 MB (86% inode=99%): /data 0 MB (0% inode=3%): /data0 1802 MB (0% inode=99%): (http://m.mozilla.org/Disk+CrashPlan+-+All)

Mark can you take a look? 


[[e-mail]2 /]# du -chx --max-depth=1 .

2.9G	./home
1.6G	./usr
6.7G	total

[[e-mail]2 home]# du -chx --max-depth=1 .
2.9G	./crashplan
2.9G	.
2.9G	total

Comment 1

[david garvey:dgarvey]

[[e-mail]2 ~]$ df -h
Filesystem      Size  Used Avail Use% Mounted on
/dev/sdb3       495G  6.8G  463G   2% /
tmpfs           2.9G     0  2.9G   0% /dev/shm
/dev/sdb1       477M   63M  389M  14% /boot
/dev/sda1        40T   40T  268K 100% /data
/dev/md127      917G  869G  1.8G 100% /data0
[[e-mail]2 ~]$

Comment 2

[david garvey:dgarvey]

<dgarvey> mjeffies ping https://bugzilla.mozilla.org/show_bug.cgi?id=1237126
<dgarvey> mjeffries_ ^
<mjeffries_> dgarvey: pong. I will check the MTV CP server tonight to see if I can free up some space.
◀━━ ━━▶

Comment 3

[Salvador Espinoza [:sal]]

Mark are you cleaning up more or should we close the bug? , alert recovered btw.

@nagios-scl3> Thu 16:22:44 PST backup1.private.mtv2.mozilla.com:Disk CrashPlan - All is DOWNTIMEEND (OK): DISK OK - free space: / 473714 MB (98% inode=99%): /dev/shm 2920 MB (100% inode=99%): /boot 388 MB (86% inode=99%): /data 116286 MB (0% inode=99%): /data0 88209 MB (9% inode=99%): (http://m.mozilla.org/Disk+CrashPlan+-+All) (notify-by-email) DISK OK - free space: / 473714 MB (98% inode=99%): /dev/shm 2920 MB (100% inode=99%): /boot 388 MB 


[[e-mail]2 sespinoza]# df -h
Filesystem      Size  Used Avail Use% Mounted on
/dev/sdb3       495G  6.8G  463G   2% /
tmpfs           2.9G     0  2.9G   0% /dev/shm
/dev/sdb1       477M   63M  389M  14% /boot
/dev/sda1        40T   40T  109G 100% /data
/dev/md127      917G  785G   87G  91% /data0
[[e-mail]2 sespinoza]#

Comment 4

[Vinh Hua [:vinh]]

Mark - disk space alerted again.  Can you free up some space?

Comment 5

[Mark Jeffries]

Let me see what I can free up.

Comment 6

[Vinh Hua [:vinh]]

forgot to include the alert:

Tue 12:40:47 PST [5262] backup1.private.mtv2.mozilla.com:Disk CrashPlan - All is CRITICAL: DISK CRITICAL - free space: / 473655 MB (98% inode=99%): /dev/shm 2920 MB (100% inode=99%): /boot 388 MB (86% inode=99%): /data 0 MB (0% inode=3%): /data0 27758 MB (3% inode=99%): (http://m.mozilla.org/Disk+CrashPlan+-+All)

Comment 7

[Mark Jeffries]

MTV's CrashPlan server is very space constrained, and we are tapped out on adding more drive space to it. I'm in the process of moving IT users who use a lot of capacity to our CP remote data server, which should free more space for regular users until we start mass movement to the Mozilla CP remote data server - which is targeted for Q2.

Comment 8

[Justin Lazaro [:jlaz] (use needinfo)]

Looks like this was taken care of.  IIRC, this box was trimmed of CP users who were no longer with the company.  Thanks mjeffries!