514640 - Add cleanup job on aus2-staging so rsync's down to prometheus-vm stay snappy

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Nick Thomas [:nthomas] (UTC+12)]

Every day, each branch that produces l10n updates adds another 1.7M of snippets to aus2-staging:/opt/aus2/build, so it doesn't take long for the rsyncs from there to the partial generator to slow down. We already have an all-time backup of nightly snippets in build.old/, so we can update that then cull out of build/, using a cron job.

Comment 1

[Nick Thomas [:nthomas] (UTC+12)]

Root crontab:

@daily cd /opt/aus2/ && rsync -a build/ build.old/ && find build/ -type f -mtime +5 -exec rm {} \; && find build/ -depth -type d -empty -exec rmdir {} \;

Mail goes to release@m.c if there is any output, but normally there should be none.

Comment 2

[Nick Thomas [:nthomas] (UTC+12)]

In testing this chopped the dir down to 22M; it was 76M and was last cleaned early in July.

Comment 3

[Armen [:armenzg]]

I have also added this to staging-stage to be in sync with the production systems