1475747 - (t-yosemite-r7-322) [MDC1] t-yosemite-r7-322 problem tracking

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Bogdan Crisan [:bcrisan] (EEST - GMT + 3)]

Tried to ssh into it: Stdio forwarding request failed: Session open refused by peer

bcrisan@bcrisan-P6198:~$ fping t-yosemite-r7-322.test.releng.mdc1.mozilla.com
t-yosemite-r7-322.test.releng.mdc1.mozilla.com is alive

Appears in taskcluster but didn't take task for more than 2 days.

Comment 1

[Zsolt Fay [:zfay]]

Hey Dhouse,

This is another machine relops should have a deeper look at.

Comment 2

[:dhouse]

Responds to ping but denies ssh:
```
[[e-mail] moonshot]$ ssh [e-mail]
ssh: connect to host t-yosemite-r7-322.test.releng.mdc1.mozilla.com port 22: Connection refused
[[e-mail] moonshot]$ ping t-yosemite-r7-322.test.releng.mdc1.mozilla.com
PING t-yosemite-r7-322.test.releng.mdc1.mozilla.com (10.49.56.106) 56(84) bytes of data.
64 bytes from t-yosemite-r7-322.test.releng.mdc1.mozilla.com (10.49.56.106): icmp_seq=1 ttl=63 time=0.765 ms
64 bytes from t-yosemite-r7-322.test.releng.mdc1.mozilla.com (10.49.56.106): icmp_seq=2 ttl=63 time=0.794 ms
64 bytes from t-yosemite-r7-322.test.releng.mdc1.mozilla.com (10.49.56.106): icmp_seq=3 ttl=63 time=0.847 ms
^C
--- t-yosemite-r7-322.test.releng.mdc1.mozilla.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2192ms
rtt min/avg/max/mdev = 0.765/0.802/0.847/0.033 ms
```

Logs when attemping ssh show.
https://papertrailapp.com/groups/1223184?filter=t-yosemite-r7-322
```

Jul 25 15:38:28 t-yosemite-r7-322.test.releng.mdc1.mozilla.com digest-service: krb5_kdc_set_dbinfo: Failed to find KerberosKDC node
Jul 25 15:38:28 t-yosemite-r7-322.test.releng.mdc1.mozilla.com opendirectoryd: 13825.318404, Node: /Local/Default - ODNodeRelease completed
Jul 25 15:38:28 t-yosemite-r7-322.test.releng.mdc1.mozilla.com opendirectoryd: 13825 - Client: 'digest-service', exited with 0 session(s), 0 node(s) and 0 active request(s) 
```

Comment 3

[:dhouse]

rebooted with roller and same behavior after reboot (ping, ssh refused. same log entries)
hasn't been reimaged since March. Maybe needs reimaged

https://tools.taskcluster.net/provisioners/releng-hardware/worker-types/gecko-t-osx-1010/workers/mdc1/t-yosemite-r7-322

Comment 4

[:dhouse]

I've created bug 1478513 for DCOps to physically netboot+reimage this machine.

Comment 5

[:dhouse]

worker looks good (many tasks completed since the reimage)