Closed Bug 637551 Opened 9 years ago Closed 8 years ago

Reduce disk usage requirements for signing

Categories

(Release Engineering :: General, defect, P3)

x86
Windows Server 2003
defect

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: nthomas, Unassigned)

References

Details

(Whiteboard: [release][signing])

We have a ~100G partition for signing releases. It's easy to use that up when we have three active Firefox releases with multiple builds - we need about 23G for each Fx4 build, 18G for each Fx3.6 build. We should be able to use that space more efficiently which (at least) lets us hang on to all the builds for a release, and possibly the previous release, to allow for problems being discovered.

The main thing we can do is not copy the non-win32 dirs between unsigned-buildN/ and signed-buildN/. I've checked on the production box and we can hardlink all those files by making a call like this
 rsync -av --exclude '*unsigned*' --link-dest=`pwd`/unsigned-build1 \
   unsigned-build1/ signed-build1/

The --link-dest makes rsync do the magic of hardlinking as long as you give it an absolute path, and only takes a second instead of a few minutes. It does funny things to the disk usage as reported by du, as the space is assigned to the signed-build1 instead of unsigned-build1, but that's probably not a big deal.

We'd need to modify the signing Makefile (download target) and do a full signing run.
(In reply to comment #0)
> We have a ~100G partition for signing releases. It's easy to use that up when
> we have three active Firefox releases with multiple builds - we need about 23G
> for each Fx4 build, 18G for each Fx3.6 build. We should be able to use that
> space more efficiently which (at least) lets us hang on to all the builds for a
> release, and possibly the previous release, to allow for problems being
> discovered.
> 
> The main thing we can do is not copy the non-win32 dirs between
> unsigned-buildN/ and signed-buildN/. I've checked on the production box and we
> can hardlink all those files by making a call like this
>  rsync -av --exclude '*unsigned*' --link-dest=`pwd`/unsigned-build1 \
>    unsigned-build1/ signed-build1/
> 
> The --link-dest makes rsync do the magic of hardlinking as long as you give it
> an absolute path, and only takes a second instead of a few minutes. It does
> funny things to the disk usage as reported by du, as the space is assigned to
> the signed-build1 instead of unsigned-build1, but that's probably not a big
> deal.
> 
> We'd need to modify the signing Makefile (download target) and do a full
> signing run.

Wow, that works on windows?
NTFS supports hardlinks, and Cygwin knows how to tickle the right API, so yay!
This style of signing is going away.
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → WONTFIX
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.