Closed Bug 1210518 Opened 4 years ago Closed 2 years ago

Create chunked tasks for l10n partial updates

Categories

(Release Engineering :: Release Automation: Other, defect, P3)

defect

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: rail, Unassigned)

References

Details

We should generate partial updates in chunks instead of one funsize leaf (3 tasks atm). Possible scenarios:

1) Each l10n repack generates N chunks, where N == number of partials for a particular release. For example if we have 15 locales in a chunk and 3 partials, this will give us 3 leaves (9 tasks). One of the downsides it may take a lot of time (~2h on mac) to generate a single leaf. Also rerunning a failed task would be harder.

2) Chunkify the chunks! Each l10n repack generates NxM chunks, where N == number of partials for a particular release and M == amount of subchunks (partitions) we want to generate. For example if we have 15 locales in a chunk, 3 partials and 4 subchunks this will give us 12 leaves (36 tasks). This is how we chunkify nightly l10n partials.
Depends on: 1216160
:rail, still a thing with relpromo?
Flags: needinfo?(rail)
Yeah, we still may want chunkify the chunks to parallelize MAR generation.
Flags: needinfo?(rail)
Priority: -- → P3
Aiui funsize is chunked in TC relpromo.
Status: NEW → RESOLVED
Closed: 2 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.