Closed Bug 1318227 Opened 8 years ago Closed 7 years ago

RCA 2016-11-16 SalesForce Down

Categories

(Infrastructure & Operations :: MOC: Root Cause Analysis, task)

Product:
Infrastructure & Operations
Component:
MOC: Root Cause Analysis
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: ryanc, Assigned: amora)

Details

(Whiteboard: [filled] [team:app-dev] [vendor outage])

Assignee: nobody → amorales
Status: NEW → ASSIGNED
Please fill in outage details to the doc linked above.
Whiteboard: [not filled]
Component: MOC: Incidents → MOC: Problems
Component: MOC: Problems → MOC: Root Cause Analysis
Whiteboard: [not filled] → [partly filled]
:amorales This was a P1 outage but I don't see anything about outage timeline, what happened, why it happened and any steps to try and prevent it happening again. Can we get some information filled in here? This RCA has been sitting for a long time.
Flags: needinfo?(amorales)
Whiteboard: [partly filled] → [partly filled] [team:app-services]
(In reply to Peter Radcliffe [:pir] from comment #2)
> :amorales This was a P1 outage but I don't see anything about outage
> timeline, what happened, why it happened and any steps to try and prevent it
> happening again. Can we get some information filled in here? This RCA has
> been sitting for a long time.

Many apologies Peter. I didnt circle back to the writeup after I had the postmortem with our Rep. I filled out the rest. Let me know if you need anything else from me or if you were expecting more detail. This is the first time I have had to fill one of these out. This is the only time I have seen Salesforce go down during my time here at Mozilla.
Flags: needinfo?(amorales)
(In reply to Andrew Morales :amora from comment #3)
> I filled out the rest. Let me know if you need
> anything else from me or if you were expecting more detail. This is the
> first time I have had to fill one of these out. 

Hi Andrew. Thanks for filling in the details there.

We've been asked by IT management to track action items on RCAs and our fledgeling process for that involves bugs that we link as requirements to an RCA bug like this one. You have an action item in the document (documentation for the MOC) that I don't see a bug for, would you point me at one if it exists or mind creating one if not? Thanks!
Flags: needinfo?(amorales)
Whiteboard: [partly filled] [team:app-services] → [filled] [team:app-services]
Whiteboard: [filled] [team:app-services] → [ready for cab] [team:app-services]
Whiteboard: [ready for cab] [team:app-services] → [ready for cab] [team:app-services] [vendor outage]
Whiteboard: [ready for cab] [team:app-services] [vendor outage] → [ready for cab] [team:app-dev] [vendor outage]
:amora ping?
Whiteboard: [ready for cab] [team:app-dev] [vendor outage] → [waiting on action items] [team:app-dev] [vendor outage]
(In reply to Peter Radcliffe [:pir] from comment #5)
> :amora ping?

Hello Peter. I started the convo w Linda re the alert and runbook action on my part (cc'd you). I will create the bug once I hear back from her.
Flags: needinfo?(amorales)
Created MOC Services Bug 1343377 to get the Monitoring and Runbook request started.
Status: ASSIGNED → RESOLVED
Closed: 7 years ago
Resolution: --- → FIXED
Whiteboard: [waiting on action items] [team:app-dev] [vendor outage] → [filled] [team:app-dev] [vendor outage]
You need to log in before you can comment on or make changes to this bug.