816826 - sync bmm images from puppet master (or elsewhere) using something other than puppet

Status: RESOLVED WONTFIX

(Infrastructure & Operations :: RelOps: General, task)

Description

[Dustin J. Mitchell [:dustin] (he/him)]

Puppet helpfully md5sums all of the Android artifacts and the squashfs on every run, which slows it down and eats up IO and CPU on the puppet masters.

We can keep syncing scripts directly with puppet - they're nice and small.

Comment 1

[Dustin J. Mitchell [:dustin] (he/him)]

I was hoping that checksum => mtime would help, but it doesn't work:

https://projects.puppetlabs.com/issues/13199

Ugh, puppet :(

Comment 2

[Dustin J. Mitchell [:dustin] (he/him)]

checksum => mtime works if you don't use recurse => true, though - jake, what do you think about explicitly listing all of the artifacts and squashfses?

Comment 3

[Jake Watkins [:dividehex]]

(In reply to Dustin J. Mitchell [:dustin] from comment #2)
> checksum => mtime works if you don't use recurse => true, though - jake,
> what do you think about explicitly listing all of the artifacts and
> squashfses?

Since android artifacts and squashfses shouldn't change often, I think this is manageable.

++

Comment 4

[Dustin J. Mitchell [:dustin] (he/him)]

Ugh, thwarted again by puppet:

  https://projects.puppetlabs.com/issues/18333

From what I can tell, the 'checksum' parameter to the file type is completely broken.  So we either do this with rsync, or just let puppet keep doing it with md5.  For the moment, I vote for puppet.

Comment 5

[Jake Watkins [:dividehex]]

 __     __   _  _  ____ 
(  )   / _\ ( \/ )(  __)
/ (_/\/    \/ \/ \ ) _) 
\____/\_/\_/\_)(_/(____)