1387005 - Reduce number of OS X bld-lion-r5 machines

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task, P4)

Description

[Andrei Obreja [:aobreja NOT AVAILABLE][:buildduty]]

Currently we have 50 build machines OS X bld-lion-r5-([001-006],043,[050-054],[056-068],[070-094]) and 30 try machines OS X bld-lion-r5-([007-019],[021-030],[032-036],095,096)

And very few jobs lately(a peak for the last 7 days showed 26 jobs running) :
https://www.hostedgraphite.com/da5c920d/86a8384e-d9cf-4208-989b-9538a1a53e4b/grafana/dashboard/db/running?from=now-7d&to=now

This could change but I think that we still have to many machines in this pool so we can reduce the number to 60 for the moment to see how this work.

Comment 1

[Andrei Obreja [:aobreja NOT AVAILABLE][:buildduty]]

Chris what do you suggest,we can reduce even more?

Comment 2

[Chris AtLee [:catlee]]

We still need these for release l10n repacks. I'm not sure what our peak load there is. We should keep at least 30 there I think.

What's the load like for the try machines?

Comment 3

[Mihai Tabara [:mtabara]⌚️GMT]

Note explaining the priority level: P4 doesn't mean we've lowered the priority, but the contrary. However, we're aligning these levels to the buildduty quarterly deliverables, where P1-P3 are taken by our daily waterline KTLO operational tasks.

Comment 4

[Andrei Obreja [:aobreja NOT AVAILABLE][:buildduty]]

The status here taking in consideration latest updates in Bug 1393774 (check [1] and [2]) is the following:
- we have the patches prepared to do all the changes for bld-lion-r5 machines
- currently we only need those machines to be decommissioned from Inventory (Bug 1411194 was opened for this),after that we can do also the other changes. 


[1] https://bugzilla.mozilla.org/show_bug.cgi?id=1393774#c6
[2] https://bugzilla.mozilla.org/show_bug.cgi?id=1393774#c7

Comment 5

[Andrei Obreja [:aobreja NOT AVAILABLE][:buildduty]]

Following the latest updated from Bug 1393774(comment 10),the number of OS X bld-lion-r5 machines was reduced,the changes are in production and this cover all that was required for this bug.