1017126 - Replace HDDs with SSDs in seamicro-c1.r101-3.console.scl3.mozilla.com

Status: RESOLVED FIXED

(Infrastructure & Operations :: DCOps, task)

Description

[Mark Cornmesser [:markco]]

The remaining HDDs in seamicro-c1.r101-3.console.scl3.mozilla.com should be replaced with SSDs. It will be one SSD shared between 2 nodes. The same way disk 0/2 has been set up in this machine. The 1 TB SSDs should start arriving at the end of this week. At this time I do not have additional info on the delivery. Please let me know when the SSDs arrive and a time frame in which they can be installed.

Comment 1

[Amy Rich [:arr] [:arich]]

The incoming SSDs should replace the lower numbered 80G SSDs and the 1T SATA drive already in the machine.  Go ahead and leave the additional 80G SSDs in the chassis, or remove them if they can be used elsewhere.  We'll be splitting up the 1T SSD drives to be used amongst all of the nodes and not using the original 80G SSDs.

When it's removed, please return the 1T SATA drive to the machine it originally came from (dan, if you have a specific slot it goes in, please let dcops know).

Comment 2

[Amy Rich [:arr] [:arich]]

According to Taras in bug 1002634:

Had to break up order due to availability.
This week:
4ssds 1Z602AW24216628636
1ssd 1Z602AW24216628636
1ssd 94055036993003046639
Next week:
10ssds 1Z74E33W4247908876

Comment 3

[Daniel Maher [:phrawzty]]

> When it's removed, please return the 1T SATA drive to the machine it
> originally came from (dan, if you have a specific slot it goes in, please
> let dcops know).

All I know is that the drive got pulled out of node0.  I am confident that DCOps knows where it was removed from and can thus replace it in kind. :)

Comment 4

[(dormant account)]

Van,
can you confirm that the first 6 ssds have been received? The rest seem to be due on Wednesday.

Comment 5

[Van Le [:van]]

weird that they were delivered/signed for on Thursday but we havent received them as far as I know. I'll check with Vantage and let you know soon.

Comment 6

[Van Le [:van]]

received 5 SSDs thus far. please let me know who I should work with to swap out the drives or let me know which drives to swap out if coordination isn't necessary.

Comment 7

[Amy Rich [:arr] [:arich]]

Please put the disks in at the following slots without needing to ask for downtime:

Disk0/0
Disk0/3
Disk0/4
Disk0/5
Disk0/6
Disk0/7
Disk1/0
Disk1/1
Disk1/2
Disk1/3
Disk1/4
Disk1/5
Disk1/6
Disk1/7


We'll need to coordinate with releng and relops for the last two disks in slots:

Disk0/1
Disk0/2

Since those have three running systems on them which will need to be shut down and reinstalled after the new disks have been added.

Comment 8

[(dormant account)]

Van, I got the correct USPS tracking number. It looks like it got received too: https://tools.usps.com/go/TrackConfirmAction?qtc_tLabels1=9405503699300304663917

Comment 9

[Van Le [:van]]

>All I know is that the drive got pulled out of node0.  I am confident that DCOps knows where it was removed from and can thus replace it in kind. :)

just a note: we moved disk 0/0 from seamicro-a1.r102-3 to disk 0/1 of seamicro-c1.r101-3. we'll replace it when we're given the green light as we'll need coordination per c#7.

since we've received 5 drives, ive swapped them in the following nodes:

Disk0/0
Disk0/3
Disk0/4
Disk0/5
Disk0/6

Comment 10

[Van Le [:van]]

>Van, I got the correct USPS tracking number. It looks like it got received too: https://tools.usps.com/go/TrackConfirmAction?qtc_tLabels1=9405503699300304663917

found it in another lobby at Vantage. I've installed this drive into Disk0/7.

Comment 11

[Van Le [:van]]

the following disks have been installed:

Disk1/0
Disk1/1
Disk1/2
Disk1/3
Disk1/4
Disk1/5
Disk1/6
Disk1/7

I need downtime/coordination to replace and return the remaining 2 disks.

Disk0/1
Disk0/2

Comment 12

[Amy Rich [:arr] [:arich]]

You are clear to replace the disks in 0/1 and 0/2

Comment 13

[Van Le [:van]]

drive swap complete. returned drive to seamicro-a1.r102-3.console.scl3 as well.