Closed Bug 826828 Opened 12 years ago Closed 12 years ago

Replace failing drive in vm1-6.phy.labs.scl3.mozilla.com (asset 2650)

Categories

(Infrastructure & Operations :: DCOps, task)

Product:
Infrastructure & Operations
Component:
DCOps
Platform:
x86
macOS
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: gozer, Assigned: sal)

References

(
URL
)

Details

(Whiteboard: [Waiting on drive to arrive])

/dev/sdc is starting to fail with errors and needs replacing: [20053110.418832] sd 1:0:0:0: [sdc] Unhandled sense code [20053110.418836] sd 1:0:0:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [20053110.418842] sd 1:0:0:0: [sdc] Sense Key : Medium Error [current] [descriptor] [20053110.418864] sd 1:0:0:0: [sdc] Add. Sense: Unrecovered read error - auto reallocate failed [20053110.418870] sd 1:0:0:0: [sdc] CDB: Read(10): 28 00 58 ac c1 cf 00 00 08 00 [20053110.418879] end_request: I/O error, dev sdc, sector 1487716819 ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000f 056 041 044 Pre-fail Always In_the_past 184202387 Device Model: ST31000340NS Serial Number: 9QJ6GGX3 Firmware Version: SN06 User Capacity: 1,000,204,886,016 bytes Device is: Not in smartctl database [for details use: -P showall] ATA Version is: 8 ATA Standard is: ATA-8-ACS revision 4
Ashlee, please process the RMA and then hand off for the install.
Assignee: server-ops-dcops → achavez
RMA has been requested. Ticket ID: ZXC-863966
Status: NEW → ASSIGNED
colo-trip: --- → scl3
I was just informed from ix systems that this drive was shipped today.
Whiteboard: [Waiting on drive to arrive]
Since this particular disk isn't part of a RAID set, would it be possible to install it side-by-side with the old one so I can attempt to migrate data off the dying drive gracefully?
Depends on: 829343
Drive was replaced, but we found out that they're not hot swappable. Other drives failed in the procces of getting /dev/sdc replaced. Currenty the host only has /dev/sd installed, waiting on the RMA for sdb and sdc
Assignee: achavez → sespinoza
Drives arrived at scl3, Waiting in :gozer to proceed with the install.
vm1-6 is powered off, install the 2 drives at your convenience.
Drives installed. Please reopen if any problems.
Status: ASSIGNED → RESOLVED
Closed: 12 years ago
Resolution: --- → FIXED
Product: mozilla.org → Infrastructure & Operations
You need to log in before you can comment on or make changes to this bug.