Closed Bug 435927 Opened 17 years ago Closed 17 years ago

cb-xserve01 possible hardware failure: "Help, I've fallen and I can't get up"

Categories

(mozilla.org Graveyard :: Server Operations, task)

Product:
mozilla.org Graveyard
Component:
Server Operations
Platform:
x86
macOS
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: mark, Assigned: phong)

References

(
URL
)

Details

cb-xserve01 got sick over the weekend. It stopped doing useful tinderbox work, and while it accepted connections on port 22, it wouldn't negotiate an SSH connection. We had it rebooted this morning, and I was able to SSH in (and VNC in over that). While working on it to test it out before restarting tinderbox, it wound up getting stuck again. It's now in the same state: it can't do any new work, although sshd is still accepting connections. It's wedged again. A "top" running at the time that it got stuck doesn't indicate any funny business. I ran fsck_hfs to verify the volume and it didn't turn up anything weird, and it completed successfully before cb-xserve01 got stuck again. mrz said that IT will run the hardware diagnostics on cb-xserve01 and take it from there.
Assignee: server-ops → mrz
Assignee: mrz → phong.tran
Flags: colo-trip+
This box was frozen during the software update. It has been on the apple boot screen for the past 15 minutes. It's getting late so I've attached it back to the console.
The cdrom is dented to the extent that I can't even get a CD in there to boot off of. Need to go back to Mountain View.
URL: https://inventory.mozilla.org/systems...
sean will call apple tonight on this.
sorry - phong I mean.
Status: NEW → ASSIGNED
There was a DVD mounted in the server. I was able to eject the DVD and boot to the install disc. Disk Utility did not report any error. I called Apple and they believe the problem to be an OS corruption. Case ID: 99751271
Phong, is this something you'll do (reinstall the OS)? If the machine has 10.4 setup on it I can take it from there via VNC/SSH. If not, we need this in the office so I can start working on it.
Do we have an image of a server on the same hardware that we can restore from? I can install a fresh copy from a 10.4.x disc.
Samuel, do you want to go with a clean install?
Whoops, sorry. Yes a clean install will be fine. Please create a caminobld user with a general password (you can email it to me) and turn on Remote Login and Apple Remote Desktop (and the VNC part of it) in the Sharing preferences. I should be able to access it at that point.
Phong, any update on this? Did the clean install work out?
This server is not picking up a DHCP address? What should it address be?
63.245.210.11 / 255.255.255.224, gateway 63.245.210.1, nameserver 63.245.208.161
Phong, I can SSH to this machine, but VNC access isn't turned on. Can you please go to System Preferences, Sharing, check the "Apple Remote Desktop" box, and, in the preferences, enable VNC sharing?
I thought I did that with the same password I sent you. I will verify the settings again.
VNC is enabled.
Just talked to Phong. I'm definitely still seeing an error when trying to connect over VNC. "Please configure Apple Remote Desktop to allow VNC Viewers to control the screen. Unknown authType 30" My client seems to know that ARD is on, but can't get to VNC. Phong said he'd look next time he was at the colo.
Host rebooted.
flipped ARD back on.
This looks good to me. I guess a reboot was all it needed. Thanks!
Status: ASSIGNED → RESOLVED
Closed: 17 years ago
Resolution: --- → FIXED
Product: mozilla.org → mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.