1115901 - syslog1.private.scl3.mozilla.com bad drive

Status: RESOLVED FIXED

(Infrastructure & Operations :: DCOps, task)

Description

[Van Le [:van]]

syslog1.private.scl3.mozilla.com:HP RAID is CRITICAL: RAID
                     CRITICAL - HP Smart Array Failed:  Smart Array P410 in
                     Slot 2 array A logicaldrive 1 (558.9 GB, RAID 1, OK) array
                     B logicaldrive 2 (3.3 TB, RAID 50, Interim Recovery Mode)
                     array C logicaldrive 3 (55.9 GB, RAID 1, OK) physicaldrive
                     2I:1:6 (port 2I:box 1:bay 6, SAS, 600 GB, Failed)
                     (http://m.mozilla.org/HP+RAID)


host is out of warranty, will see if we have a spare 600GB SAS drive lying around. if not we'll need to renew warranty

Comment 1

[Van Le [:van]]

actually host has been out of warranty since april and this is our syslog server so i've emailed vendor to renew warranty. will check for available spare pool for 600GB SAS on Monday.

Comment 2

[Greg Cox [:gcox]]

There's a p2v bug for this guy, bug 1036499, but it's got some process blockers to it.  Mentioned the drive drop over there.

Comment 3

[Van Le [:van]]

i didnt see any response in the other bug so i went ahead and renewed the warranty for another year in case another drive fails or the host crashes before we can p2v. it's cheaper than buying a new drive and replacing it ourselves. i think HP might have made a typo and renewed our warranty until 2016 instead of 2015. Attached CarePaq and updated inventory.


Case ID 4650288739 opened for drive RMA.

Comment 4

[Van Le [:van]]

Attachment: DL 180 certificates.pdf

Comment 5

[Van Le [:van]]

they sent us the wrong drive. contacted HP to receive correct drive.

Comment 7

[Ashlee Nguyen [:ashlee]]

Do you have an eta on this replacement?

Comment 8

[Vinh Hua [:vinh]]

Drive has been replaced and is rebuilding.

logicaldrive 2 (3.3 TB, RAID 50, Recovering, 0% complete)

      physicaldrive 2I:1:3 (port 2I:box 1:bay 3, SAS, 600 GB, OK)
      physicaldrive 2I:1:4 (port 2I:box 1:bay 4, SAS, 600 GB, OK)
      physicaldrive 2I:1:5 (port 2I:box 1:bay 5, SAS, 600 GB, OK)
      physicaldrive 2I:1:6 (port 2I:box 1:bay 6, SAS, 600 GB, Rebuilding)
      physicaldrive 2I:1:7 (port 2I:box 1:bay 7, SAS, 600 GB, OK)
      physicaldrive 2I:1:8 (port 2I:box 1:bay 8, SAS, 600 GB, OK)
      physicaldrive 2I:1:9 (port 2I:box 1:bay 9, SAS, 600 GB, OK)
      physicaldrive 2I:1:10 (port 2I:box 1:bay 10, SAS, 600 GB, OK)

Comment 9

[Van Le [:van]]

rebuild complete.

[[e-mail]3 ~]$ sudo hpacucli controller slot=2 show config

Smart Array P410 in Slot 2                (sn: PACCR9SXYMJ4  )

   array A (SAS, Unused Space: 0  MB)


      logicaldrive 1 (558.9 GB, RAID 1, OK)

      physicaldrive 2I:1:1 (port 2I:box 1:bay 1, SAS, 600 GB, OK)
      physicaldrive 2I:1:2 (port 2I:box 1:bay 2, SAS, 600 GB, OK)

   array B (SAS, Unused Space: 0  MB)


      logicaldrive 2 (3.3 TB, RAID 50, OK)

      physicaldrive 2I:1:3 (port 2I:box 1:bay 3, SAS, 600 GB, OK)
      physicaldrive 2I:1:4 (port 2I:box 1:bay 4, SAS, 600 GB, OK)
      physicaldrive 2I:1:5 (port 2I:box 1:bay 5, SAS, 600 GB, OK)
      physicaldrive 2I:1:6 (port 2I:box 1:bay 6, SAS, 600 GB, OK)
      physicaldrive 2I:1:7 (port 2I:box 1:bay 7, SAS, 600 GB, OK)
      physicaldrive 2I:1:8 (port 2I:box 1:bay 8, SAS, 600 GB, OK)
      physicaldrive 2I:1:9 (port 2I:box 1:bay 9, SAS, 600 GB, OK)
      physicaldrive 2I:1:10 (port 2I:box 1:bay 10, SAS, 600 GB, OK)

   array C (Solid State SATA, Unused Space: 0  MB)


      logicaldrive 3 (55.9 GB, RAID 1, OK)

      physicaldrive 2I:1:11 (port 2I:box 1:bay 11, Solid State SATA, 60 GB, OK)
      physicaldrive 2I:1:12 (port 2I:box 1:bay 12, Solid State SATA, 60 GB, OK)

   Enclosure SEP (Vendor ID HP, Model DL18xG6BP) 248 (WWID: 50014380065D68E3, Port: 2I, Box: 1)

   Expander 250 (WWID: 50014380065D68D0, Port: 2I, Box: 1)

   SEP (Vendor ID PMCSIERA, Model  SRC 8x6G) 249 (WWID: 50014380061773DF)