Create chunked tasks for l10n partial updates

NEW
Unassigned

Status

Release Engineering
Release Automation
P3
normal
2 years ago
7 months ago

People

(Reporter: rail, Unassigned)

Tracking

(Blocks: 1 bug)

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

2 years ago
We should generate partial updates in chunks instead of one funsize leaf (3 tasks atm). Possible scenarios:

1) Each l10n repack generates N chunks, where N == number of partials for a particular release. For example if we have 15 locales in a chunk and 3 partials, this will give us 3 leaves (9 tasks). One of the downsides it may take a lot of time (~2h on mac) to generate a single leaf. Also rerunning a failed task would be harder.

2) Chunkify the chunks! Each l10n repack generates NxM chunks, where N == number of partials for a particular release and M == amount of subchunks (partitions) we want to generate. For example if we have 15 locales in a chunk, 3 partials and 4 subchunks this will give us 12 leaves (36 tasks). This is how we chunkify nightly l10n partials.
(Reporter)

Updated

2 years ago
Depends on: 1216160
:rail, still a thing with relpromo?
Flags: needinfo?(rail)
(Reporter)

Comment 2

a year ago
Yeah, we still may want chunkify the chunks to parallelize MAR generation.
Flags: needinfo?(rail)
(Reporter)

Updated

7 months ago
Priority: -- → P3
You need to log in before you can comment on or make changes to this bug.