784850 - batch generate new hostnames, and pre-load them into systems

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[hwine]

We want to pre-complete all the paperwork to deploy the newly imaged machines in one go, to avoid the overhead of updates for each small batch.

There are at least 2 sets of such data:
 IT - DNS, etc
 RelEng - slavealloc, etc.

Feel free to open blocking bugs if you want for these, or we can just use this one. RelEng needs the hostnames before we can begin our part.

Comment 1

[hwine]

per MaRu in #infra, hostnames for first 10 (bug 780022 comment #4) will be:
 w64-ix-slave[101-110]

Comment 2

[hwine]

Attachment: slave alloc load for 101-110

Slave alloc load for first 10 boxes

Comment 3

[hwine]

Attachment: buildbot master load for 101-110

Comment 4

[Kim Moir [:kmoir] ET]

Hal, you asked in your email how to add slaves in a disabled state, can't you just add them like this

name, basedir, distro, bitlength, purpose, datacenter, trustlevel, speed, environment, pool,enabled
w64-ix-slave101,e:\builds\moz2_slave,win2k8,64,build,scl1,core,ix,prod,build-scl1,0
w64-ix-slave102,e:\builds\moz2_slave,win2k8,64,build,scl1,core,ix,prod,build-scl1,0
w64-ix-slave103,e:\builds\moz2_slave,win2k8,64,build,scl1,core,ix,prod,build-scl1,0
w64-ix-slave104,e:\builds\moz2_slave,win2k8,64,build,scl1,core,ix,prod,build-scl1,0
w64-ix-slave105,e:\builds\moz2_slave,win2k8,64,build,scl1,core,ix,prod,build-scl1,0
w64-ix-slave106,e:\builds\moz2_slave,win2k8,64,build,scl1,core,ix,prod,build-scl1,0
w64-ix-slave107,e:\builds\moz2_slave,win2k8,64,build,scl1,core,ix,prod,build-scl1,0
w64-ix-slave108,e:\builds\moz2_slave,win2k8,64,build,scl1,core,ix,prod,build-scl1,0
w64-ix-slave109,e:\builds\moz2_slave,win2k8,64,build,scl1,core,ix,prod,build-scl1,0
w64-ix-slave110,e:\builds\moz2_slave,win2k8,64,build,scl1,core,ix,prod,build-scl1,0

Comment 5

[Dustin J. Mitchell [:dustin] (he/him)]

that will work, yes

Comment 6

[Amy Rich [:arr] [:arich]]

Hal, you don't sepcify which hosts you're refering to in this bug, but based on comment 4, I'm taking this to mean the linux nodes we are reimaging as part of bug

dns, inventory, dhcp, nagios are all complete, passing this off to the releng queue since the IT work on getting the info staged is done.

Comment 7

[hwine]

(In reply to Amy Rich [:arich] [:arr] from comment #6)
> Hal, you don't sepcify which hosts you're refering to in this bug, but based
> on comment 4, I'm taking this to mean the linux nodes we are reimaging as
> part of bug

Amy - sorry I wasn't clearer - I meant all the scl1 linux boxes listed in bug 780022. atm, we only have info for 1st 10, so need for the rest of the machines.

Comment 8

[Amy Rich [:arr] [:arich]]

We just keep going sequentially, so if you want to pre-load things for the releng side, add up to w64-ix-slave183 to account for all of the linux 32 and 64 bit scl1 builder machines.  

We can't change inventory until we're ready to move machines since DHCP for the linux boxes is generated from inventory and that would break the remaining linux machines in production.

Comment 9

[hwine]

(In reply to Kim Moir [:kmoir] from comment #4)
> Hal, you asked in your email how to add slaves in a disabled state, can't
> you just add them like this
> 
> name, basedir, distro, bitlength, purpose, datacenter, trustlevel, speed,
> environment, pool,enabled
> w64-ix-slave101,e:\builds\moz2_slave,win2k8,64,build,scl1,core,ix,prod,build-scl1,0

Only in my dreams: bug 748970. For now, such a column is silently ignored

Comment 10

[hwine]

Comment on attachment 654462 [details]
slave alloc load for 101-110

deployed on slavealloc:
    [slavealloc@slavealloc ~]$ /tools/slavealloc/bin/slavealloc dbimport -D mysql: --slave-data bz784850_01.csv 
    [slavealloc@slavealloc ~]$ date
    Fri Aug 24 08:54:12 PDT 2012

Comment 11

[Chris Cooper [:coop] (he/him)]

In production.

Comment 12

[hwine]

Comment on attachment 654463 [details] [diff] [review]
buildbot master load for 101-110

http://hg.mozilla.org/build/buildbot-configs/rev/c69b3f23974b

Comment 13

[hwine]

Attachment: slave alloc load for w64-ix-slave 87-100

Comment 14

[hwine]

Attachment: buildbot master load for w64-ix-slave 87-100

prepare for new w64 builders from bug 774829

Comment 15

[Aki Sasaki (not active)]

Comment on attachment 657484 [details]
buildbot master load for w64-ix-slave 87-100

r=me with the closing parens after range(64,100)

Comment 16

[hwine]

Comment on attachment 657484 [details]
buildbot master load for w64-ix-slave 87-100

http://hg.mozilla.org/build/buildbot-configs/rev/a6480010748d

Comment 17

[hwine]

Comment on attachment 657483 [details]
slave alloc load for w64-ix-slave 87-100

deployed in slavealloc. Note: header line needed to have spaces removed

Comment 18

[Chris Cooper [:coop] (he/him)]

Comment on attachment 657484 [details]
buildbot master load for w64-ix-slave 87-100

This is in production now.