608005 - split nightly repacks into N builders per platform

Status: RESOLVED DUPLICATE of bug 740142

(Release Engineering :: General, defect, P2)

Description

[[e-mail] (:bhearsum)]

Once bug 608004 is fixed we can find some way to divide nightly repack work (per platform) across multiple builders, triggering 1 build on each for a set of repacks.

Comment 1

[Armen [:armenzg]]

What is the ETA for this?

I would like to know if it is worth adding retry ability to the current L10n nightly code or wait for this to happen.

Comment 2

[Aki Sasaki (not active)]

Ben already got this working for mobile:
http://hg.mozilla.org/build/tools/file/default/scripts/l10n/nightly_mobile_repacks.sh

I think this should be a usable model for desktop.

Comment 3

[John O'Duinn [:joduinn] (please use "needinfo?" flag)]

found in triage.

Comment 4

[[e-mail] (:bhearsum)]

Part of the motivation behind this bug is to get the nightly l10n builders using the same code as the release ones again. We could fix _that_ part by using these scripts but not chunking: eg, 1 locale per job, just like the current nightly builders. That could be a nice way to do it until we figure out the Tinderbox reporting story.

Comment 5

[Chris Cooper [:coop] (he/him)]

Now that tinderbox is out of the picture for l10n, our reporting story is much simpler.

What I'd like to see here as an end state, which is an amalgam of many bugs:
* chunked nightly repacks (this bug)
* single script for nightly and release repacks, preferably in mozharness
* use pre-built mar and bsdiff (bug 785392)
* use mozconfigs (bug 774947)
* Windows release repacks on Win64 (bug 849019)

I don't want to explicitly block this bug on the above, but it seems like a logical (if large) chunk of work. It also seems pretty well-defined with known-good end states to match against. Intern project?

Comment 6

[[e-mail] (:bhearsum)]

bug 740142 is moving nightly l10n to mozharness, and chunking them.