1573691 - Configure parallelism automatically when sccache-dist is in use

Status: NEW

(Firefox Build System :: General, enhancement)

Description

[Chris Manchester (limited bugmail, email directly)]

I added the --dist-status command to sccache recently, which will output the number of cores if distributed is configured and the client is in contact with a scheduler. The build system should consume this and configure parallelism automatically.

Comment 1

[Chris Manchester (limited bugmail, email directly)]

Attachment: Bug 1573691 - Use `sccache --dist-status` to determine parallelism for a build when available.

Comment 2

[BugBot [:suhaib / :marco/ :calixte]]

There's a r+ patch which didn't land and no activity in this bug for 2 weeks.
:chmanchester, could you have a look please?
For more information, please visit auto_nag documentation.

Comment 3

[Chris Manchester (limited bugmail, email directly)]

I will land this soon.

Comment 4

[Chris Manchester (limited bugmail, email directly)]

https://github.com/mozilla/sccache/issues/536 may be an issue with this patch, as it might force people into that failure mode (although passing -j is enough to override).

Bug 1615152 is the other issue here -- this may end up starting the local daemon, so can impact whether we share a jobserver between make and sccache. We should probably be more intentional about what happens there.

Un-assigning for now.