725195 - Fix cron cleanup job on dev-stage01

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task, P4)

Description

[Nick Thomas [:nthomas] (UTC+12)]

We're looking in /builds/opt/aus2/build, which is the old place, rather than /builds/opt/aus2/incoming/2/

Comment 1

[[e-mail] (:bhearsum)]

I updated the crontab files on mpt-production-puppet and forced a puppet sync. Cleanup jobs now look like this:
@hourly cd /builds/opt/aus2/incoming/2 && for file in `find . -name 'complete.txt' -type f -mtime -10`; do url=`grep ^http $file`; if [ "$url" != "" ]; then echo $file `curl -sI $url | grep ^HTTP` | grep HTTP.*404 || continue; rm $file; fi; done >> snippets_removed.log
@hourly cd /builds/opt/aus2/incoming/2 && for file in `find . -name 'complete.txt' -type f -mtime -10`; do url=`grep ^url=http $file | grep -o http.*`; if [ "$url" != "" ]; then echo $file `curl -sI $url | grep ^HTTP` | grep HTTP.*404 || continue; rm $file; fi; done >> snippets_removed.log

Comment 2

[[e-mail] (:bhearsum)]

I had to adjust where the cleanup log went too because of permissions problems. The logs are now in: /builds/opt/aus2/snippets_removed.log

Comment 3

[[e-mail] (:bhearsum)]

Bah, cltbld doesn't have permission to clean up the snippets. This has gotten non-trivial, I don't have time to tackle it, so I backed out all of my changes.

Comment 4

[Aki Sasaki (not active)]

Pasted bhearsum's crontab entries from comment 1 into ffxbld@dev-stage01's crontab.

Comment 5

[Aki Sasaki (not active)]

Also commented out cltbld's corresponding crontab entries.