Closed Bug 1849901 Opened 2 years ago Closed 2 years ago

allow setting the maximum number of workers to use for taskgraph operations

Categories

(Firefox Build System :: Task Configuration, task)

Product:
Firefox Build System
Component:
Task Configuration
Type:
task

Tracking

(firefox118 fixed)

Status:
RESOLVED FIXED
Milestone:
118 Branch
Tracking Flags:
Tracking Status
firefox118 --- fixed

People

(Reporter: bhearsum, Assigned: bhearsum)

Details

Attachments

(1 file)

Bug 1849901: allow setting the maximum number of workers to use for taskgraph operations r?#taskgraph-reviewers!
48 bytes, text/x-phabricator-request
Details | Review

Currently we always defer this to ProcessPoolExecutor. This is fine in most cases, but I've managed to OOM a few times on a system with a lot of CPU cores but not enough RAM to handle generating full task graphs for a large number of parameters at the same time.

Pushed by bhearsum@mozilla.com: https://hg.mozilla.org/integration/autoland/rev/9d2df5cf36fb allow setting the maximum number of workers to use for taskgraph operations r=taskgraph-reviewers,jcristau

https://hg.mozilla.org/mozilla-central/rev/9d2df5cf36fb

Status: NEW → RESOLVED
Closed: 2 years ago
status-firefox118: --- → fixed
Resolution: --- → FIXED
Target Milestone: --- → 118 Branch
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: