721440 - Move or Clean up Mac Minis housed in QA lab on 2nd floor

Status: RESOLVED FIXED

(Infrastructure & Operations :: DCOps, task)

Description

[Marcia Knous [:marcia]]

Bug 552074 was filed a while back, but there are still Mac Minis in the QA lab that are causing issues:

1. The mess of tangled cables makes it impossible for QA to use the router ports that were dedicated to us.
2. The black storage cabinet is still not accessible due to ethernet cables dangling everywhere.

I believe these machines belong in a rack or could be better organized. If you want to rack them in the QA lab I am fine with it, but they should be better organized. If they are machines running continuous tests they might be better served someplace with a backup since we do have occasional power outages in MV.

Comment 1

[Marcia Knous [:marcia]]

This is still problematic and causing problems and I hope we can get this addressed.

Comment 2

[Marcia Knous [:marcia]]

We got a new switch in the lab today since we ran out of ports, but I don't even know how to begin to set it up because I don't want to disconnect any of the existing machines that are connected to ports above and below it. Everything is pretty tangled.

Comment 3

[Marcia Knous [:marcia]]

Adding Henry to the bug. This is still an issue and blocking us from connecting any other machines to ethernet.

Comment 4

[Henry Langi [:hlangi]]

Pushing this over to the DataCenter Ops.

Comment 5

[Marcia Knous [:marcia]]

Adding John since yesterday when someone from data ops was in the lab he said he was resetting a machine for Ben. So I assume there are Rel Eng machines still in the QA lab as well.

It was agreed in a conversation last week that Clint's machines would stay in the lab.

I am fine with machines remaining, but my current issue ATM is that I cannot add another switch due to the organization of the cables and the way the machines are stacked on top of all the switch boxes.

Comment 6

[Van Le [:van]]

:marcia, Can you provide us a list of what machines belong to QA and/or which doesn't and I can work with RelEng on moving their machines out?

Comment 7

[Marcia Knous [:marcia]]

Van: I have no idea which machines belong to Rel Engineering. Adding Ben Hearsum since last time someone was in the lab resetting the machine they mentioned he filed the ticket. Or John O'Duinn please chime in please if you know where there is a list.

The QA machines for the most part are all the ones that are the lower level and those are the ones where I have been short on ethernet ports since this bug was filed nearly a year ago.

Clint Talbert's A-Team has machines on the top level of the lab as well, he should be able to provide a list of which machines he has in there.

All: Please provide Van a list asap so we can move forward on getting me some ports in the lab. Thanks.


(In reply to Van Le [:van] from comment #6)
> :marcia, Can you provide us a list of what machines belong to QA and/or
> which doesn't and I can work with RelEng on moving their machines out?

Comment 8

[[e-mail] (:bhearsum)]

I don't think we have any machines in the QA lab anymore. I think Amy can confirm that.

Comment 9

[Amy Rich [:arr] [:arich]]

There are definitely still releng machines in AFK (which is what I presume you mean by the QA lab).  At the very least, this is where all of the mac minis that are supporting ESR (moz2-darwin10 and try-mac64) are located.  Those specific machines will be decommissioned as soon as this version of ESR is replaced with a new one.  There may be a handful of other releng machines in there as well.

Comment 10

[Amy Rich [:arr] [:arich]]

https://inventory.mozilla.org/en-US/systems/racks/?rack=151

Those are the machines in AFK that I know of that belong to releng (anything that says .build.mtv1.mozilla.com) and I think the tools machines are ateam?  The byob-repack machines are... sort of releng and sort of Kev Needham's, I think..?  You have a better idea on that one bhearsum?

After this version of ESR is deprecated, I think the byob-repack machines are the only ones in the build domain that are slated to remain in AFK.  I'm not sure what the plans are for replacing those, since we're eliminating space for r3 minis in data centers, not adding more.

Comment 11

[Marcia Knous [:marcia]]

Amy: I don't know the exact dates machines are going to be decommissioned, but I still cannot install a new switch for my ports until the tangled cords that are plugged in above and below my main switch are cleaned up. As you can imagine, I don't want to mess with anything since I don't know which machines are running continuously.

Comment 12

[cmtalbert]

The machines the A*team are using are the ones on top of the black cabinent which can likely be moved/unplugged with minimal notice. The other machines we're using are over on the mail shelf with the other minis all stacked atop one another. These cannot be unplugged at any time as they are running critical software and we need to manage them going down. I think it would work best if we set up a time in zimbra to go down and clean things out. Perhaps 3PM Monday Oct 1?

Comment 13

[Marcia Knous [:marcia]]

I would be up for getting time on calendar - probably we need someone from Rel Eng or IT to help as well since some of the machines belong to them.

Comment 14

[Vinh Hua [:vinh]]

I know we've decommissioned a handful of mac minis from bug 842615.  Not sure what is happening with the rest of the mac minis.  Are we leaving them untouched and wait till we move to our new office next year?

Comment 15

[Vinh Hua [:vinh]]

I went to take a look at the QA lab and saw only 5 mac minis (r4/r5) left in there. All the unnecessary cables have been cleaned out also. Considering this bug completed. Please re-open bug if further assistance is needed.