716730 - spec and purchase 10gb cards for bm-vmware*

Status: RESOLVED WONTFIX

(mozilla.org Graveyard :: Server Operations, task)

Description

[Dustin J. Mitchell [:dustin] (he/him)]

As part of the scl3 move, we will be building new VMs on the generic vmware cluster in scl3, then moving the existing bm-vmware* (except bm-vmware03, which is too old to move), and migrating the instances back to bm-vmware*.

As part of this process, we should put 10gb cards in bm-vmware*.

Soo, let's get that hardware specc'd and ordered and shipped to scl3 so we can get it installed when the time comes.

Comment 1

[matthew zeier [:mrz]]

Is there really value in retrofitting these DL385s for this vs. buying new ESX hosts?

Bug 716710 is that.

Comment 2

[Dustin J. Mitchell [:dustin] (he/him)]

First, these are BL460c's.

Second, these will be a fairly temporary solution in scl3 -- we are leaning toward replacing all vmware build capacity with physical hardware.  So usage plans are actually well-aligned with the expected lifetime of this hardware.

For record, the move plan is

     build new VMs in scl3 on the generic VMWare infrastructure (bug 716710)
     transition those into production
     shut down the VMs in sjc1
     bring the nodes in sjc1 (bm-vmware*) to scl3 (all but 1 old unit)
         add 10gb cards (this bug)
     move VMs back to those nodes

this plan keeps releng's fairly heavy builder footprint (~100 instances, and we'll be looking for a lot more disk space each) off of the generic ESX cluster in the long term.

Comment 3

[Dustin J. Mitchell [:dustin] (he/him)]

:lerxst, it looks like it's not economical to put 10gb on these BL460's.  That leaves a few options:

 1 buy new hardware for releng's use (temporary)
 2 move the BL460's as-is, without 10gb
 3 run releng on the generic infra for longer than the duration of the move (which will probably require more hardware)

what do you think is the best course?  Will IO for 2 be slower than the current arrangement?

Comment 4

[matthew zeier [:mrz]]

Is the long term releng plan to vacate ESX?  I'm fine buying new hardware here if it makes sense.

Comment 5

[Dustin J. Mitchell [:dustin] (he/him)]

Yes - the plan of record is to build out DL120G7's as linux builders and stop using vmware.  That will not happen until some time after the scl3 move is complete, though.

I'm open to revisiting that plan, but I do not want to do so in the context of the scl3 move.

Comment 6

[Dan Parsons [:lerxst]]

Sounds good, shall we close this as WONTFIX for now and revisit after scl3?

Comment 7

[Dustin J. Mitchell [:dustin] (he/him)]

indeed.