793087 - Use mozilla-central bundle to speed up hg share bootstrapping for try

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Nick Thomas [:nthomas] (UTC+12)]

catlee sketched this out on IRC. In
  http://ftp.mozilla.org/pub/mozilla.org/firefox/bundles/
we symlink mozilla-central.hg to try.hg, and comm-central.hg to try-comm-central.hg. Then in TryBuildFactory we remove the bundles=[] hardcode in
 http://hg.mozilla.org/build/buildbotcustom/file/default/process/factory.py#l1997

Then new slaves will first grab a the bundle which is pretty close and we save the hg servers a big headache. Even if it's a week old is much better than cloning from scratch.

Comment 2

[Rail Aliiev [:rail]]

Attachment: use bundles for try

Symlinks to be created on ftp

Comment 3

[Chris AtLee [:catlee]]

Comment on attachment 663418 [details] [diff] [review]
use bundles for try

Review of attachment 663418 [details] [diff] [review]:
-----------------------------------------------------------------

don't forget on dev-stage01 as well

Comment 4

[Rail Aliiev [:rail]]

Comment on attachment 663418 [details] [diff] [review]
use bundles for try

http://hg.mozilla.org/build/buildbotcustom/rev/4d7fc073fc6e

Comment 5

[Rail Aliiev [:rail]]

# ffxbld@stage and dev-stage01
 cd /pub/mozilla.org/firefox/bundles/
 ln -s mozilla-central.hg try.hg
# tbirdbld@stage (no such directory on dev-stage01)
 cd /pub/mozilla.org/thunderbird/bundles/
 ln -s comm-central.hg try-comm-central.hg

Comment 6

[Rail Aliiev [:rail]]

looks like working:

python /builds/slave/try-lnx/tools/buildfarm/utils/retry.py -s 1 -r 5 -t 3660 python /builds/slave/try-lnx/tools/buildfarm/utils/hgtool.py --clone-by-revision --mirror http://hg-internal.dmz.scl3.mozilla.com/try --bundle http://ftp.mozilla.org/pub/mozilla.org/firefox/bundles/try.hg http://hg.mozilla.org/try build

Comment 7

[Nick Thomas [:nthomas] (UTC+12)]

(In reply to Rail Aliiev [:rail] from comment #5)
Mayeb worth capturing in puppet ?

Comment 8

[Rail Aliiev [:rail]]

(In reply to Nick Thomas [:nthomas] from comment #7)
> (In reply to Rail Aliiev [:rail] from comment #5)
> Mayeb worth capturing in puppet ?

yeah, this a good idea.

Comment 9

[Rail Aliiev [:rail]]

Attachment: puppet-manifests

for dev-stage01

Comment 10

[Rail Aliiev [:rail]]

Attachment: [svn] productdelivery

for stage

Comment 11

[Nick Thomas [:nthomas] (UTC+12)]

Comment on attachment 665085 [details] [diff] [review]
[svn] productdelivery

Making these relative links is more tolerant of rearranging of mounts or prefixes in the future, r+ with that.

Comment 12

[Rail Aliiev [:rail]]

Comment on attachment 665083 [details] [diff] [review]
puppet-manifests

http://hg.mozilla.org/build/puppet-manifests/rev/19739ee0afb9

Comment 13

[Rail Aliiev [:rail]]

Comment on attachment 665085 [details] [diff] [review]
[svn] productdelivery

svn commit -m "Bug 793087 - Use mozilla-central bundle to speed up hg share bootstrapping for try. r=nthomas"
Sending        manifests/ftp.pp
Transmitting file data .
Committed revision 48776.