Replace HDDs with SSDs in seamicro-c1.r101-3.console.scl3.mozilla.com

RESOLVED FIXED

Status

Infrastructure & Operations
DCOps
RESOLVED FIXED
4 years ago
3 years ago

People

(Reporter: markco, Unassigned)

Tracking

Details

(Reporter)

Description

4 years ago
The remaining HDDs in seamicro-c1.r101-3.console.scl3.mozilla.com should be replaced with SSDs. It will be one SSD shared between 2 nodes. The same way disk 0/2 has been set up in this machine. The 1 TB SSDs should start arriving at the end of this week. At this time I do not have additional info on the delivery. Please let me know when the SSDs arrive and a time frame in which they can be installed.
(Reporter)

Updated

4 years ago
Blocks: 1014700

Updated

4 years ago
colo-trip: --- → scl3
The incoming SSDs should replace the lower numbered 80G SSDs and the 1T SATA drive already in the machine.  Go ahead and leave the additional 80G SSDs in the chassis, or remove them if they can be used elsewhere.  We'll be splitting up the 1T SSD drives to be used amongst all of the nodes and not using the original 80G SSDs.

When it's removed, please return the 1T SATA drive to the machine it originally came from (dan, if you have a specific slot it goes in, please let dcops know).
According to Taras in bug 1002634:

Had to break up order due to availability.
This week:
4ssds 1Z602AW24216628636
1ssd 1Z602AW24216628636
1ssd 94055036993003046639
Next week:
10ssds 1Z74E33W4247908876
Blocks: 1002634
Blocks: 1014703
> When it's removed, please return the 1T SATA drive to the machine it
> originally came from (dan, if you have a specific slot it goes in, please
> let dcops know).

All I know is that the drive got pulled out of node0.  I am confident that DCOps knows where it was removed from and can thus replace it in kind. :)

Comment 4

4 years ago
Van,
can you confirm that the first 6 ssds have been received? The rest seem to be due on Wednesday.
Flags: needinfo?(vle)

Comment 5

4 years ago
weird that they were delivered/signed for on Thursday but we havent received them as far as I know. I'll check with Vantage and let you know soon.
Flags: needinfo?(vle)

Comment 6

4 years ago
received 5 SSDs thus far. please let me know who I should work with to swap out the drives or let me know which drives to swap out if coordination isn't necessary.
Please put the disks in at the following slots without needing to ask for downtime:

Disk0/0
Disk0/3
Disk0/4
Disk0/5
Disk0/6
Disk0/7
Disk1/0
Disk1/1
Disk1/2
Disk1/3
Disk1/4
Disk1/5
Disk1/6
Disk1/7


We'll need to coordinate with releng and relops for the last two disks in slots:

Disk0/1
Disk0/2

Since those have three running systems on them which will need to be shut down and reinstalled after the new disks have been added.

Comment 8

4 years ago
Van, I got the correct USPS tracking number. It looks like it got received too: https://tools.usps.com/go/TrackConfirmAction?qtc_tLabels1=9405503699300304663917

Comment 9

4 years ago
>All I know is that the drive got pulled out of node0.  I am confident that DCOps knows where it was removed from and can thus replace it in kind. :)

just a note: we moved disk 0/0 from seamicro-a1.r102-3 to disk 0/1 of seamicro-c1.r101-3. we'll replace it when we're given the green light as we'll need coordination per c#7.

since we've received 5 drives, ive swapped them in the following nodes:

Disk0/0
Disk0/3
Disk0/4
Disk0/5
Disk0/6

Comment 10

4 years ago
>Van, I got the correct USPS tracking number. It looks like it got received too: https://tools.usps.com/go/TrackConfirmAction?qtc_tLabels1=9405503699300304663917

found it in another lobby at Vantage. I've installed this drive into Disk0/7.

Comment 11

4 years ago
the following disks have been installed:

Disk1/0
Disk1/1
Disk1/2
Disk1/3
Disk1/4
Disk1/5
Disk1/6
Disk1/7

I need downtime/coordination to replace and return the remaining 2 disks.

Disk0/1
Disk0/2
You are clear to replace the disks in 0/1 and 0/2

Comment 13

4 years ago
drive swap complete. returned drive to seamicro-a1.r102-3.console.scl3 as well.
Status: NEW → RESOLVED
Last Resolved: 4 years ago
Resolution: --- → FIXED
Product: mozilla.org → Infrastructure & Operations
You need to log in before you can comment on or make changes to this bug.