1229532 - Releng hg bundles are stale

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Nick Thomas [:nthomas] (UTC+12)]

http://hg.mozilla.org/build/tools/file/default/scripts/bundle/hg-bundle.sh expects that it can ssh files to stage and be done, which is no longer true since we migrated to S3 for the storage. Consequently the bundles are stale, and anything still using them is pulling more from hg to get up to date after unbundling.

We're in the middle of a transition where hg does this by itself, using server generated and published bundles on S3. There are places were we use hgtool with --bundle which overrides this, and may be some situations where we're not installing the bundleclone into older hg, or haven't updated hg where it's included by default.

Comment 1

[Nick Thomas [:nthomas] (UTC+12)]

I've refreshed the following branches using the gzip bundles from https://hg.cdn.mozilla.net/:

b2g-inbound, mozilla-inbound, fx-team, mozilla-central, try (copy of mozilla-central),
mozilla-aurora, mozilla-beta, mozilla-release, mozilla-esr38, mozilla-b2g44_v2_5

That should help the buildbot infra be nicer to hg.m.o until we complete bug 1232442.

Comment 2

[Nick Thomas [:nthomas] (UTC+12)]

We're going to disable the buildbot jobs which are trying to create new bundles, and move over to the gps's system where the hg server advertises bundles (which are from S3).

Comment 3

[Nick Thomas [:nthomas] (UTC+12)]

Attachment: [buildbotcustom] Remove support for builders

The list of builders removed is:
< alder hg bundle ScriptFactory
< b2g-inbound hg bundle ScriptFactory
< fx-team hg bundle ScriptFactory
< mozilla-inbound hg bundle ScriptFactory
< mozilla-central hg bundle ScriptFactory
< mozilla-beta hg bundle ScriptFactory
< mozilla-aurora hg bundle ScriptFactory
< mozilla-release hg bundle ScriptFactory
< mozilla-esr38 hg bundle ScriptFactory
< comm-central hg bundle ScriptFactory
< comm-beta hg bundle ScriptFactory
< comm-aurora hg bundle ScriptFactory
< comm-esr38 hg bundle ScriptFactory

Comment 4

[Nick Thomas [:nthomas] (UTC+12)]

Attachment: [buildbot-configs] Remove residiual config

Comment 5

[Nick Thomas [:nthomas] (UTC+12)]

Attachment: [tools] Remove script

Can't find anythign else using this.

Comment 6

[Nick Thomas [:nthomas] (UTC+12)]

gps has already updated https://developer.mozilla.org/en-US/docs/Mozilla/Developer_guide/Source_Code/Mercurial/Bundles to point at https://hg.cdn.mozilla.net/.

Comment 7

[[e-mail] (:bhearsum)]

Comment on attachment 8717672 [details] [diff] [review]
[tools] Remove script

Review of attachment 8717672 [details] [diff] [review]:
-----------------------------------------------------------------

I like code death.

Comment 8

[Nick Thomas [:nthomas] (UTC+12)]

Comment on attachment 8717669 [details] [diff] [review]
[buildbotcustom] Remove support for builders

https://hg.mozilla.org/build/buildbotcustom/rev/1b880a68c991

Comment 9

[Nick Thomas [:nthomas] (UTC+12)]

Comment on attachment 8717670 [details] [diff] [review]
[buildbot-configs] Remove residiual config

https://hg.mozilla.org/build/buildbot-configs/rev/f0c9c5b5a7b8

Comment 10

[Nick Thomas [:nthomas] (UTC+12)]

Comment on attachment 8717672 [details] [diff] [review]
[tools] Remove script

https://hg.mozilla.org/build/tools/rev/cc5b6d8e91ac

Comment 11

[Release Engineering SlaveAPI Service]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/f0c9c5b5a7b8

Comment 12

[Release Engineering SlaveAPI Service]

In production: https://hg.mozilla.org/build/buildbotcustom/rev/1b880a68c991

Comment 13

[Gregory Szorc [:gps]]

Can this bug be closed?

Comment 14

[Nick Thomas [:nthomas] (UTC+12)]

Still need to remove http://archive.mozilla.org/pub/firefox/bundles/ but should do bug 1247169 first.

Comment 15

[Nick Thomas [:nthomas] (UTC+12)]

I've finished up bug 1247169 and cleaned out pub/firefox/bundles/ on the ftp server.