946846 - bugzilla1.community.scl3 is refusing ssh connections, and the console is also in accessible

Status: RESOLVED FIXED

(Infrastructure & Operations :: DCOps, task)

Description

[Dave Miller [:justdave]]

This machine is in inventory at:

https://inventory.mozilla.org/en-US/systems/show/1729/

Trying to ssh into the public IP gets
ssh_exchange_identification: Connection closed by remote host

Out-of-band console is refusing connections on the web interface, and ssh to the out-of-band console connects, but just sits there and never provides a prompt nor prompts for a password.

Need the entire thing forcibly power-cycled most likely (like remove power and put it back, not just flipping the switch).

Comment 1

[Van Le [:van]]

bad drive: port 0 device error during POST and I/O errors during boot up. This host is out of warranty but we might have some spare drives. if we replace the drive, will you be able to reimage the host?

Comment 2

[Dave Miller [:justdave]]

We appear to have backups from November 30 which is plenty recent enough to be useful.  Let's go ahead and do the drive swap.

Comment 3

[Salvador Espinoza [:sal]]

Swapped a 1tb drive, please open a separate bug to get the host reimaged.
please reopen if u need further assistance