Status

Infrastructure & Operations
RelOps
--
blocker
RESOLVED FIXED
8 years ago
5 years ago

People

(Reporter: coop, Assigned: fox2mike)

Tracking

Details

Attachments

(2 attachments)

(Reporter)

Description

8 years ago
I cannot ssh to staging-master via the VPN or via the jumphost(s).

The host is responding to ping requests, but ssh and web are down.
(Assignee)

Comment 1

8 years ago
Looking
Assignee: server-ops → shyam
(Assignee)

Comment 2

8 years ago
Created attachment 457847 [details]
CPU Graph for staging-master
(Assignee)

Comment 3

8 years ago
Created attachment 457848 [details]
Console Output for staging-master
(Assignee)

Comment 4

8 years ago
Chris,

As you can see from the attachments, staging-master is hammered. It's run out of swap space and I don't see a way of getting it back without a hard reset. Can I go ahead and do that?
(Reporter)

Comment 5

8 years ago
Rebooting is a viable option here. No one has anything important running there right now, so I'm curious why the load is so high.
(Assignee)

Comment 6

8 years ago
Alright, staging-master has been hard reset and it's back up.

You might want to poke through the logs and see if you can find out what caused it to run out of swap.

Reopen in case you run into the same issue again.
Status: NEW → RESOLVED
Last Resolved: 8 years ago
Resolution: --- → FIXED
Component: Server Operations: RelEng → RelOps
Product: mozilla.org → Infrastructure & Operations
You need to log in before you can comment on or make changes to this bug.