976104 - raise slaverebooter's parallelization

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[[e-mail] (:bhearsum)]

Attachment: increase possible number of workers

Since fixing a bug in slaverebooter where we weren't actually waiting for graceful shutdowns, slaverebooter takes a lot longer to run. One way to improve this is to make it parallelize more. I had to reduce it to 4 threads when it initially landed because of issues with buildapi getting overloaded. But now that we have a better buildapi, I think we can increase it more. I'm thinking 8 threads for now, and maybe more if things continue to look good.

I plan to land this early in the morning one day so that I can keep a close eye on it.

Comment 1

[[e-mail] (:bhearsum)]

Attachment: bump used workers to 8

Comment 2

[[e-mail] (:bhearsum)]

Attachment: bump to 12

8 seems to be working fine without breaking buildapi, let's try even more :).

Comment 3

[John Hopkins (:jhopkins)]

Comment on attachment 8382219 [details] [diff] [review]
bump to 12

sure, what could go wrong ;)

Comment 4

[[e-mail] (:bhearsum)]

Even at 12 workers things are going fine. I think this is good enough for now - slaverebooter runs much more quickly than before.