If you think a bug might affect users in the 57 release, please set the correct tracking and status flags for Release Management.

HP RAID on graphite6.private.phx1.mozilla.com is CRITICAL: RAID CRITICAL - HP Smart Array Failed: Smart Array P220i in Slot 0 (Embedded) array A logicaldrive 1 (279.4 GB, RAID 1, OK) Smart Array P410i in Slot 3 array A logicaldrive 1 (4.9 TB, RAID 1+0, I

RESOLVED FIXED

Status

Infrastructure & Operations
DCOps
RESOLVED FIXED
3 years ago
3 years ago

People

(Reporter: dgarvey, Unassigned)

Tracking

Details

(Whiteboard: [id=nagios1.private.phx1.mozilla.com:413647] CaseID:4650218584, URL)

(Reporter)

Description

3 years ago
+++ This bug was initially created as a clone of Bug #1112475 +++

Automated alert report from nagios1.private.phx1.mozilla.com:

Hostname: graphite6.private.phx1.mozilla.com
Service:  HP RAID
State:    CRITICAL
Output:   RAID CRITICAL - HP Smart Array Failed:  Smart Array P220i in Slot 0 (Embedded) array A logicaldrive 1 (279.4 GB, RAID 1, OK) Smart Array P410i in Slot 3 array A logicaldrive 1 (4.9 TB, RAID 1+0, Interim Recovery Mode) physicaldrive 1I:1:3 (port 1I:box 1:bay 3, SAS, 900.1 GB, Failed)

Runbook:  http://m.allizom.org/HP+RAID
(Reporter)

Comment 1

3 years ago
[root@graphite6.private.phx1 ~]# hpacucli ctrl all show config

Smart Array P220i in Slot 0 (Embedded)    (sn: PCQVU0CRH5H273)


      logicaldrive 1 (279.4 GB, RAID 1, OK)
   array A (SAS, Unused Space: 0  MB)


      physicaldrive 1I:1:1 (port 1I:box 1:bay 1, SAS, 300 GB, OK)
      physicaldrive 1I:1:2 (port 1I:box 1:bay 2, SAS, 300 GB, OK)

   SEP (Vendor ID PMCSIERA, Model SRCv4x6G) 380 (WWID: 50014380284EE98F)


Smart Array P410i in Slot 3               (sn: 50014380259052A0)


      logicaldrive 1 (4.9 TB, RAID 1+0, Interim Recovery Mode)
   array A (SAS, Unused Space: 0  MB)


      physicaldrive 1I:1:1 (port 1I:box 1:bay 1, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:2 (port 1I:box 1:bay 2, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:3 (port 1I:box 1:bay 3, SAS, 900.1 GB, Failed)
      physicaldrive 1I:1:4 (port 1I:box 1:bay 4, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:5 (port 1I:box 1:bay 5, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:6 (port 1I:box 1:bay 6, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:7 (port 1I:box 1:bay 7, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:8 (port 1I:box 1:bay 8, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:9 (port 1I:box 1:bay 9, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:10 (port 1I:box 1:bay 10, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:11 (port 1I:box 1:bay 11, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:12 (port 1I:box 1:bay 12, SAS, 900.1 GB, OK)

   Expander 250 (WWID: 50014380251EE766, Port: 1I, Box: 1)

   Enclosure SEP (Vendor ID HP, Model D2200sbx12) 248 (WWID: 50014380251EE765, Port: 1I, Box: 1)

   SEP (Vendor ID PMCSIERA, Model  SRC 8x6G) 249 (WWID: 50014380259052AF)

[root@graphite6.private.phx1 ~]#

Updated

3 years ago
colo-trip: --- → scl3

Updated

3 years ago
colo-trip: scl3 → phx1

Comment 2

3 years ago
CaseID:4650218584 opened for HP tech to come out and swap 900GB SAS drive on storage blade.
Whiteboard: [id=nagios1.private.phx1.mozilla.com:413647] → [id=nagios1.private.phx1.mozilla.com:413647] CaseID:4650218584

Comment 3

3 years ago
rebuild complete.

[vle@graphite6.private.phx1 ~]$ sudo hpacucli ctrl all show config

Smart Array P220i in Slot 0 (Embedded)    (sn: PCQVU0CRH5H273)


      logicaldrive 1 (279.4 GB, RAID 1, OK)
   array A (SAS, Unused Space: 0  MB)


      physicaldrive 1I:1:1 (port 1I:box 1:bay 1, SAS, 300 GB, OK)
      physicaldrive 1I:1:2 (port 1I:box 1:bay 2, SAS, 300 GB, OK)

   SEP (Vendor ID PMCSIERA, Model SRCv4x6G) 380 (WWID: 50014380284EE98F)


Smart Array P410i in Slot 3               (sn: 50014380259052A0)


      logicaldrive 1 (4.9 TB, RAID 1+0, OK)
   array A (SAS, Unused Space: 0  MB)


      physicaldrive 1I:1:1 (port 1I:box 1:bay 1, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:2 (port 1I:box 1:bay 2, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:3 (port 1I:box 1:bay 3, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:4 (port 1I:box 1:bay 4, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:5 (port 1I:box 1:bay 5, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:6 (port 1I:box 1:bay 6, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:7 (port 1I:box 1:bay 7, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:8 (port 1I:box 1:bay 8, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:9 (port 1I:box 1:bay 9, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:10 (port 1I:box 1:bay 10, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:11 (port 1I:box 1:bay 11, SAS, 900.1 GB, OK)
      physicaldrive 1I:1:12 (port 1I:box 1:bay 12, SAS, 900.1 GB, OK)

   Expander 250 (WWID: 50014380251EE766, Port: 1I, Box: 1)

   Enclosure SEP (Vendor ID HP, Model D2200sbx12) 248 (WWID: 50014380251EE765, Port: 1I, Box: 1)

   SEP (Vendor ID PMCSIERA, Model  SRC 8x6G) 249 (WWID: 50014380259052AF)
Status: NEW → RESOLVED
Last Resolved: 3 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.