950997 - buildbot-masters on ESX in scl3 have incorrect CPU count

Status: RESOLVED FIXED

(Infrastructure & Operations :: Virtualization, task)

Description

[Justin Wood (:Callek)]

So it looks like we may have used the incorrect VM template for bm89, and bm99->102

Buildbot-master88 has:

physicalprocessorcount => 1
processor0 => Intel(R) Xeon(R) CPU           X5690  @ 3.47GHz
processor1 => Intel(R) Xeon(R) CPU           X5690  @ 3.47GHz
processorcount => 2

while buildbot-master89 has:
physicalprocessorcount => 1
processor0 => Intel(R) Xeon(R) CPU           X5690  @ 3.47GHz
processorcount => 1

I noticed this while looking at ganglia graphs for these masters. I'm not certain on how much they will tax the CPU but I'd rather match the specs we thought we were getting here.

These machines are in production now though, so any change that requires downtime will need to be coordinated and staged over a period of time....

---

Unless we see major issues I don't forsee a need to fix this prior to 2014 though

Comment 1

[Justin Wood (:Callek)]

for reference current state for 89, 99-102 do match spec as :dustin said in bug 940659#c1

Comment 2

[Dustin J. Mitchell [:dustin] (he/him)]

virt team - is it OK to bump buildbot-master{89,99..102} to 2 vCPUs?  Does that need a host reboot to become effective, or a full power-down and power-up?

Comment 3

[Greg Cox [:gcox]]

Needs a full power down; hot-add isn't enabled on these guys.  Should be okay to add.

Comment 4

[Chris Knowles [:cknowles]]

Per IRC - We'll be doing a couple of them today and the rest early tomorrow morning.  

CJK

Comment 5

[Justin Wood (:Callek)]

I'm graceful stopping buildbot-master89 and buildbot-master99 right now, will give Chris a heads up in IRC when halted.

Comment 6

[Justin Wood (:Callek)]

(In reply to Justin Wood (:Callek) from comment #5)
> I'm graceful stopping buildbot-master89 and buildbot-master99 right now,
> will give Chris a heads up in IRC when halted.

These two are done, and we'll be doing the rest thursday (I'm on pto tomorrow, and briefly forgot that fact)

Comment 7

[Chris Knowles [:cknowles]]

I'm in and available, poke me when you need 100,101 and 102 reconfigured.

Comment 8

[Chris Knowles [:cknowles]]

Alright, we reconfigured 100,101, and 102 today. 

CJK