472884 - add suitable buildSpace arguments release builders

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P2)

Description

[[e-mail] (:bhearsum)]

Especially right now when free space is scarce it's important to make sure release builders aren't failing out due to lack of space.

Comment 1

[[e-mail] (:bhearsum)]

Attachment: add sensible default buildSpace parameters to release factories

These are pretty sensible defaults, I think. For steps that grow as we add a locale, as sourceRepo gets bigger, etc. I've added some breathing room - we shouldn't have to update them for quite awhile. Eg, L10nVerify downloads all the builds - currently approx. 12G, but will grow quickly as we add more locales.

Comment 2

[Chris AtLee [:catlee]]

Comment on attachment 357351 [details] [diff] [review]
add sensible default buildSpace parameters to release factories

I'm pretty sure purge_builds doesn't support non-integer sizes at this point.

Comment 3

[[e-mail] (:bhearsum)]

Attachment: s/int/float/ for purge_builds

Comment 4

[[e-mail] (:bhearsum)]

Attachment: buildSpace + exclusion list fix

Comment 5

[[e-mail] (:bhearsum)]

Comment on attachment 357353 [details] [diff] [review]
s/int/float/ for purge_builds

changeset:   35:02c4d3fa5170

Comment 6

[[e-mail] (:bhearsum)]

Comment on attachment 357354 [details] [diff] [review]
buildSpace + exclusion list fix

Checking in process/factory.py;
/cvsroot/mozilla/tools/buildbotcustom/process/factory.py,v  <--  factory.py
new revision: 1.80; previous revision: 1.79
done

Comment 7

[[e-mail] (:bhearsum)]

master reconfig'ed

Comment 8

[Nick Thomas [:nthomas] (UTC+12)]

Need to provide a bit more space for the update generation step, it accumulates quite a lot of files as it goes along. Data and a patch coming up.

Comment 9

[Nick Thomas [:nthomas] (UTC+12)]

Attachment: Allow 13GB instead of 8

Before generating partials, you need
  651 MB   mozilla/ checkout 
  ~ 35MB   per locale for previous release's complete mars
  ~ 35MB   per locale for current release's complete mars

While producing partials, you need
 Linux:  54MB + (N-1)*24MB for N locales
 Mac:   100MB + (N-1)*42MB
 Win32:  54MB + (N-1)*29MB
for working space.

For the 64 locales for 3.1b3 (really 63, but we still process both ja locales), that means 2250MB for each set of complete mars, and roughly 6210MB in work space. About 600MB of partial updates are created, so you'd need about 11.7GB just before the work dir was cleared up.

Add a bit of padding to come up with 13GB - about 8 locales worth, it's about 175MB/locale all up.

Comment 10

[[e-mail] (:bhearsum)]

Comment on attachment 359684 [details] [diff] [review]
Allow 13GB instead of 8

Sounds good!