579111 - Add 5 linux32 build slaves to trybuild pool

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P2)

Description

[John O'Duinn [:joduinn] (please use "needinfo?" flag)]

After the VMs are created in bug#579110, this bug is to track any manual setup
we need to do in the slaves, and the matching buildbot masters setup.

This should improve our linux32 wait times on production-master02:8011

Comment 1

[Nick Thomas [:nthomas] (UTC+12)]

That's the try-as-a-branch master, so the hostnames on bug 579110 aren't right. Why don't we recycle some moz2-linux-slaveNN VMs to try ? Besides, I thought ESX was low on storage and resources.

Comment 2

[John O'Duinn [:joduinn] (please use "needinfo?" flag)]

(In reply to comment #1)
> That's the try-as-a-branch master, so the hostnames on bug 579110 aren't right.
Hostnames now fixed in dep.bug. Thanks for spotting that.


> Why don't we recycle some moz2-linux-slaveNN VMs to try ? 
I'd rather not delete moz2-linux-slaveNN VMs until we have a clearer picture of load on builders without any unittest jobs involved. Once we have that data, yes, we can juggle as appropriate.


> Besides, I thought
> ESX was low on storage and resources.
From audit with mrz earlier this week, we have space/capacity for these new slaves (combination of remaining space, and space freed up by deleting old/obsolete VMs).

Comment 3

[John O'Duinn [:joduinn] (please use "needinfo?" flag)]

(In reply to comment #2)
> (In reply to comment #1)
> > That's the try-as-a-branch master, so the hostnames on bug 579110 aren't right.
> Hostnames now fixed in dep.bug. Thanks for spotting that.

Tweaked summary to correct pool.

Comment 4

[Nick Thomas [:nthomas] (UTC+12)]

Armen, did you mean to undo the summary correction, assignee, and OS that joduinn set ?

Comment 5

[Armen [:armenzg]]

Nope... and back!

Comment 6

[Armen [:armenzg]]

I had to fix these on these slaves on buildbot.tac:
- buildmaster_host = 'sm-staging-try-master.mozilla.org'
+ buildmaster_host = 'production-master02.build.mozilla.org'
- port = 9982
+ port = 9011
and I had to remove the production keys and scp the try keys:
> rm .ssh/* && cd .ssh
> scp cltbld@try-linux-slave20:/home/cltbld/.ssh/* .

For the first block of changes on buildbot.tac were do I update the 0 -> staging scripts to fix this?

Anything we could wrt the try keys as well?

Comment 7

[Armen [:armenzg]]

Attachment: puppet changes for new set of try slaves

Comment 8

[Armen [:armenzg]]

Attachment: add new set of slaves to our configurations

Comment 9

[[e-mail] (:bhearsum)]

(In reply to comment #6)
> I had to fix these on these slaves on buildbot.tac:
> - buildmaster_host = 'sm-staging-try-master.mozilla.org'
> + buildmaster_host = 'production-master02.build.mozilla.org'
> - port = 9982
> + port = 9011
> and I had to remove the production keys and scp the try keys:
> > rm .ssh/* && cd .ssh
> > scp cltbld@try-linux-slave20:/home/cltbld/.ssh/* .
> 
> For the first block of changes on buildbot.tac were do I update the 0 ->
> staging scripts to fix this?
> 
> Anything we could wrt the try keys as well?

I'd prefer to wait until we have a general solution for ssh key management to anything about that. Could you update buildbot/buildbot-tac.py in the tools repo, though?

Comment 10

[Armen [:armenzg]]

Attachment: add new set of slaves to our configurations

Comment 11

[Armen [:armenzg]]

I won't have time to deploy this and check that everything is OK before EOD.
Putting back into the pool.
All patches are reviewed positively, though.

Comment 12

[Chris Cooper [:coop] (he/him)]

I'll try to get these deployed today.

Comment 13

[Chris Cooper [:coop] (he/him)]

Comment on attachment 460906 [details] [diff] [review]
add new set of slaves to our configurations

http://hg.mozilla.org/build/buildbot-configs/rev/b2be0970b7ba

Comment 14

[Chris Cooper [:coop] (he/him)]

Comment on attachment 460901 [details] [diff] [review]
puppet changes for new set of try slaves

http://hg.mozilla.org/build/puppet-manifests/rev/efef728cd3c1

Comment 15

[Chris Cooper [:coop] (he/him)]

These slaves are now connected to try.