please rack and cable 73 mobile chassis in the scl1 expansion

RESOLVED FIXED

Status

Infrastructure & Operations
DCOps
RESOLVED FIXED
5 years ago
3 years ago

People

(Reporter: arr, Unassigned)

Tracking

Details

(Reporter)

Description

5 years ago
Please rack and cable 73 mobile chassis in the scl1 expansion.  Will adjust blocker bug when we have one to figure out how these are being assembled.
(Reporter)

Updated

5 years ago
Summary: please rack and cable → please rack and cable 73 mobile chassis in the scl1 expansion
(Reporter)

Updated

5 years ago
Blocks: 799922
(Reporter)

Updated

5 years ago
Depends on: 800074

Updated

5 years ago
colo-trip: --- → scl1

Updated

5 years ago
Depends on: 802311

Comment 1

5 years ago
The first 3 racks are complete. Please let me know if there is anything missing from inventory (this should include the pandas, pdu, foopies, imager, switches). 

https://inventory.mozilla.org/en-US/systems/racks/?location=13&status=&rack=248&allocation=
https://inventory.mozilla.org/en-US/systems/racks/?location=13&status=&rack=249&allocation=
https://inventory.mozilla.org/en-US/systems/racks/?location=13&status=&rack=250&allocation=

Comment 2

5 years ago
We were able to complete an additional 3 racks this week (Racks 201-[456]).
Please let me know if there is anything missing from inventory (this should include the pandas, pdu, foopies, imager, switches). 

This brings a total of 48/73 panda chassis racked/cabled/inventoried in the new cage. 

Can someone confirm these numbers? We also have 4 more chassis on site so we *should* be expecting 21 more from D.J. Grey.

Thanks,
Van
I was at SCL1 yesterday and noticed the chassis in rack 201-6 do not have the top cover correctly installed.  This is pushing on the back panel on the chassis and putting stress on it.  We need to put at least one screw in the rear of the top panel for proper structural integrity of the chassis.  I know that we have been putting in only one screw to secure the top cover for convenient internal access but we really should use more screws.

I would suggest 1 screw in the top rear center and 2 side screws.  One on each side towards the rear.  This should be the bare minimum.
Also noticed, some of the chassis aren't powered on.  Is there a reason?  If not, can we get them powered up. Thanks.
Can we have panda-relay-042.p5.releng.scl1.mozilla.com looked at?  I cannot ping it.

Comment 6

5 years ago
>We need to put at least one screw in the rear of the top panel for proper structural integrity of the chassis.  I know that we have been putting in only one screw to secure the top cover for convenient internal access but we really should use more screws.

The reason this was done is because we are currently on back order for 4' IEC power cables. We only have 3' power cables and the current work around to get them all powered on was to use 1 or 2 screws on the side that we can get to and slide the cover off without having to pull the chassis out all the way. We can swap the power cables once they come in but it's going to be a while before they come in. I'll try to get an update.

Comment 7

5 years ago
Jake,
Panda-relay-042.p5.releng.scl1.mozilla.com should now be pingable.

vhua$ sudo fping panda-relay-042.p5.releng.scl1.mozilla.com
panda-relay-042.p5.releng.scl1.mozilla.com is alive

Comment 8

5 years ago
we received all the panda chassis today. I have sent Amy the inventory spread sheet for another rack of pandas. We have 2 racks (16 chassis) left to install, which should be completed by end of next unless something unexpected comes up.

Van
(Reporter)

Comment 9

5 years ago
We still have one chassis left to be delivered.  DJGrey is waiting on RMAed panda boards.
(Reporter)

Comment 10

5 years ago
panda-relay-061 is not pingable.  Please power cycle it.
(Reporter)

Comment 11

5 years ago
Just checking in to see if you guys can get the info for p8 and p9 to me by EOB Thursday so I can get all of the info imported into inventory before I got on PTO for the rest of the year.  If not, let me know, and I can make other arrangements.

Comment 12

5 years ago
panda-relay-061 has a bad Digi ME Ethernet module. 

:dividehex, do you have any spares? 

:arr, we definitely can.

Comment 13

5 years ago
73 chassis (72@scl1, 1@scl3) have been racked, cabled, uboot image installed and inventoried.

Remaining issues:

-pending 1 chassis to be delivered by DJGrey with Panda boards that have been RMA'd (any ETA?)
-panda-relay-061 has a bad Digi Ethernet module (waiting for Jake's response)
-panda-0662 isn't booting up and has no serial output (we have a spare panda we pulled from chassis 6, let me know if we should swap)
:van, contact NCD and see if you can get a replacement ME module without sending back the entire board.  It will be time consuming to replace the entire board due to the wiring.  If they need the entire board for a RMA, then just order a new ME module.

Comment 15

5 years ago
:dividehex, I tried googling NCD and I'm not finding the company. Will ordering a module straight from Digi work? I wasn't sure if the modules sold on the Digi site had the correct pin outs.
:van,

http://www.controlanything.com/Relay/Relay/CONTACT

Do not order it from Digi directly.  Try to RMA it first through NCD otherwise order a new one from NCD.

Updated

5 years ago
Depends on: 821419

Comment 17

5 years ago
Unfortunately they claim since they don't manufacture the Digi ethernet module, it's not covered under their warranty. Ordering a replacement module in bug 821419.
Where are we at for racking the remaining chassis?

Comment 19

5 years ago
The remaining chassis has not been delivered. I just checked with the SCL1 NOC. 

Van
(Reporter)

Comment 20

5 years ago
What's the status on panda-relay-061?  I saw that the new ethernet module has been delivered, but it doesn't look like it's online yet.
(Reporter)

Comment 21

5 years ago
Have we received the last chassis from DJ Grey at this point (I see the last update on that was 2012-12-17)?
(Reporter)

Comment 22

5 years ago
panda-relay-061 is now up and configured.

Comment 23

5 years ago
We received the last chassis from DJ Grey on Friday and we racked, cabled, inventoried it today. The csv has been sent to Amy to batchload.

Van
(Reporter)

Comment 24

5 years ago
Information has been entered for the last chassis.  Please power cycle it so that the relay comes online.

Comment 25

5 years ago
Panda chassis 079 has been power cycled.

sudo fping panda-relay-079.p10.releng.scl1.mozilla.com
panda-relay-079.p10.releng.scl1.mozilla.com is alive
(Reporter)

Comment 26

5 years ago
The last chassis has been configured, installed with android, and been added to nagios.
Status: NEW → RESOLVED
Last Resolved: 5 years ago
Resolution: --- → FIXED

Updated

5 years ago
Assignee: server-ops → server-ops-dcops
Product: mozilla.org → Infrastructure & Operations
You need to log in before you can comment on or make changes to this bug.