1044705 - Improve cleanup of tinderbox-builds

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Nick Thomas [:nthomas] (UTC+12)]

Attachment: [svn] Moar cleanup

* we create latest symlinks now, but don't remove them when the target is expired.
* we've never removed empty directories in tinderbox-builds, which makes it hard to find things by creating a long list

Comment 1

[Nick Thomas [:nthomas] (UTC+12)]

Comment on attachment 8463182 [details] [diff] [review]
[svn] Moar cleanup

rail is on pto, switching to hwine.

Comment 2

[Hal Wine [:hwine] use NI!]

Comment on attachment 8463182 [details] [diff] [review]
[svn] Moar cleanup

Review of attachment 8463182 [details] [diff] [review]:
-----------------------------------------------------------------

r- for uncertainty in last 'find' execution -- see notes

::: files/cron/ffxbld
@@ +4,4 @@
>  0 3 * * * (echo; date; nice -n 19 /usr/local/bin/archive-debug-builds.sh) >> $HOME/archive_debug_builds.log
>  
>  # Keep 30 days of on-change builds
> +@daily   for dir in /pub/mozilla.org/{firefox,mobile,b2g}/tinderbox-builds; do nice -n 19 find ${dir} -mindepth 2 -maxdepth 2 -type d -mtime +29 -name 1????????? -print0 | xargs -0 rm -rf && symlinks -d ${dir}/* > /dev/null && find ${dir} -mindepth 1 -maxdepth 1 -empty -delete; done

A few comments:
 - the 'nice' command now only applies to first 'find' command. Not sure that was intended.
 - I didn't see the exit codes of 'symlinks' defined, so it's unclear if the last 'find' will always be executed.
 - I don't understand why the statements are joined with '&&' instead of just ';' -- they shouldn't interact.

I wouldn't object at all if these issues were addressed and/or clarified by moving the logic to a script, and just invoking that from cron. :)

Comment 3

[Nick Thomas [:nthomas] (UTC+12)]

Attachment: [svn] Moar cleanup, v2

* drops the nice all over the file. These used to run on the same box that uploads are going onto but no longer
* swaps from '&&' to ';', as the jobs are independent of each other, and can't make any earlier fail worse
* cleans up b2g/nightly/ a little harder

Comment 4

[Hal Wine [:hwine] use NI!]

Comment on attachment 8466838 [details] [diff] [review]
[svn] Moar cleanup, v2

Review of attachment 8466838 [details] [diff] [review]:
-----------------------------------------------------------------

lgtm

Comment 5

[Nick Thomas [:nthomas] (UTC+12)]

Comment on attachment 8466838 [details] [diff] [review]
[svn] Moar cleanup, v2

Committed revision 91427