857660 - move some bld-lion-r5 machines from try to production

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P1)

Description

[[e-mail] (:bhearsum)]

We consistently have more than double the number of "production" bld-lion-r5 jobs than try, but we only a few more slaves in that pool. It's at the point where we have some oft hese slaves idle for many days, when they could be used in the production pool. We should move 5 or 6 of these over to start with.

Comment 1

[[e-mail] (:bhearsum)]

Actually, we have 15 slaves that have been idle for  at least 3 days. Maybe we should move 10 or more.

Comment 2

[Armen [:armenzg]]

I will help with this.

Comment 3

[Armen [:armenzg]]

I hope that only changing keys and slavealloc is all that is needed in here.

Comment 4

[Armen [:armenzg]]

Yesterday we had a ratio of 308/132=2.333 Mac build jobs vs Mac try jobs.
We have 47/42=1.12 Mac build/try machines.
I see more than 20 Mac try machines idle yet we had 100% score for the try mac builds.
I have disabled the first 15 of them on slavealloc.

I will look in a couple of hours if the following idle machines are still idle.
bld-lion-r5-0{25,96,28,36,29,18,40,39,24,20,19,31,21,23,35,34,30,27,38,33}

Adding 15 try slaves to the build pool should bring our ratio to this:
62/27=2.3 ratio which is closer to our ratio for # of jobs.
We can review on Monday today's wait times and see if we're good.

Comment 5

[Armen [:armenzg]]

Attachment: move 15 first lion try machines to the build pool

Comment 6

[Armen [:armenzg]]

Attachment: move staging machines as well

No need for 7 staging machines. Bringing 2 to production.

Comment 7

[Aki Sasaki (not active)]

This is in production.

Comment 8

[Armen [:armenzg]]

We should see jobs on these machines in the next few hours:
https://build.mozilla.org/buildapi/recent/bld-lion-r5-001
https://build.mozilla.org/buildapi/recent/bld-lion-r5-002
https://build.mozilla.org/buildapi/recent/bld-lion-r5-003
https://build.mozilla.org/buildapi/recent/bld-lion-r5-004
https://build.mozilla.org/buildapi/recent/bld-lion-r5-005
https://build.mozilla.org/buildapi/recent/bld-lion-r5-006
https://build.mozilla.org/buildapi/recent/bld-lion-r5-007
https://build.mozilla.org/buildapi/recent/bld-lion-r5-008
https://build.mozilla.org/buildapi/recent/bld-lion-r5-009
https://build.mozilla.org/buildapi/recent/bld-lion-r5-010
https://build.mozilla.org/buildapi/recent/bld-lion-r5-011
https://build.mozilla.org/buildapi/recent/bld-lion-r5-012
https://build.mozilla.org/buildapi/recent/bld-lion-r5-013
https://build.mozilla.org/buildapi/recent/bld-lion-r5-014
https://build.mozilla.org/buildapi/recent/bld-lion-r5-015