627186 - need to automatically clean preproduction-stage

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Dustin J. Mitchell [:dustin] (he/him)]

I'm not sure how this is done on production stage or staging stage, but preproduction stage's /builds is at 158G, and most of that is in the /builds/data/ftp directory, mostly nightlies.  Since these builds aren't useful to anyone, can we just run a simple crontask to clean them out, similar to what's done for the local aus2?

Comment 1

[Rail Aliiev [:rail]]

Note, that there are already some cronjobs for cltbld and root, managed by puppet.

Comment 2

[Dustin J. Mitchell [:dustin] (he/him)]

Ah, I see

@daily find /data/ftp/pub/{firefox,xulrunner,mobile}/nightly/20??/ -mindepth 2 -maxdepth 2 -mtime +3 -exec rm -rf {} \;

but that seems to be missing all of the files in
  /data/ftp/pub/firefox/nightly/latest-mozilla-central-l10n

Can you add another crontask to take care of those?  They go back to September 16 right now.

Comment 3

[Rail Aliiev [:rail]]

Attachment: Updated crontab

* Added @daily find /data/ftp/pub/{firefox,xulrunner,mobile}/nightly/latest-* -type f -mtime +2 -exec rm -f {} \;
* s/-mtime +3/-mtime +2/

Comment 4

[Rail Aliiev [:rail]]

Comment on attachment 505352 [details] [diff] [review]
Updated crontab

As root@production-puppet
# cd /N/production/centos5-i686/stage/root
# wget -q -O - 'https://bugzilla.mozilla.org/attachment.cgi?id=505352' | patch -p0
patching file crontab

Also seen on preproduction-stage:

# crontab -l
MAILTO=[e-mail]

@daily find /data/ftp/pub/{firefox,xulrunner,mobile}/tinderbox-builds/ -mindepth 2 -maxdepth 2 -type d -mtime +2 -name 1????????? -exec rm -rf {} \;
@daily find /data/ftp/pub/firefox/tryserver-builds/ -mindepth 1 -maxdepth 1 -type d -mtime +2 -exec rm -rf {} \;
@daily find /data/ftp/pub/{firefox,xulrunner,mobile}/nightly/20??/ -mindepth 2 -maxdepth 2 -mtime +2 -exec rm -rf {} \;
@daily find /data/ftp/pub/{firefox,xulrunner,mobile}/nightly/ -type l -mtime +2 -exec rm -rf {} \;
@daily find /data/ftp/pub/{firefox,xulrunner,mobile}/nightly/latest-* -type f -mtime +2 -exec rm -f {} \;
@hourly find /data/symbols_*/ -type d -mindepth 2 -maxdepth 2  -mtime +1 -exec rm -rf {} \;
@hourly find /data/symbols_*/ -type f -maxdepth 0  -mtime +1 -exec rm -rf {} \;