1475744 - [MDC1] t-yosemite-r7-357 problem tracking

Status: VERIFIED DUPLICATE of bug 1474299

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Bogdan Crisan [:bcrisan] (EEST - GMT + 3)]

Tried to ssh into it and returns: ssh_exchange_identification: Connection closed by remote host

bcrisan@bcrisan-P6198:~$ fping t-yosemite-r7-357.test.releng.mdc1.mozilla.com
t-yosemite-r7-357.test.releng.mdc1.mozilla.com is unreachable

Host is unreachable.

Ping it does work on the other side..

Comment 1

[Bogdan Crisan [:bcrisan] (EEST - GMT + 3)]

(In reply to Bogdan Crisan [:bcrisan] (UTC +3, EEST) from comment #0)

> Ping it does work on the other side..
ping doesn't work either ^^

Comment 2

[:dhouse]

No response to ping or ssh.
```
[[e-mail] ~]$ ssh [e-mail]
ssh: connect to host t-yosemite-r7-357.test.releng.mdc1.mozilla.com port 22: Connection timed out
[[e-mail] ~]$ ping t-yosemite-r7-357.test.releng.mdc1.mozilla.com
PING t-yosemite-r7-357.test.releng.mdc1.mozilla.com (10.49.56.141) 56(84) bytes of data.
^C
--- t-yosemite-r7-357.test.releng.mdc1.mozilla.com ping statistics ---
32 packets transmitted, 0 received, 100% packet loss, time 31425ms
```

found in logs: https://papertrailapp.com/groups/1223184?filter=t-yosemite-r7-357

cycled power, and system started responding to ping
```
[[e-mail] ~]$ ping t-yosemite-r7-357.test.releng.mdc1.mozilla.com
PING t-yosemite-r7-357.test.releng.mdc1.mozilla.com (10.49.56.141) 56(84) bytes of data.
64 bytes from t-yosemite-r7-357.test.releng.mdc1.mozilla.com (10.49.56.141): icmp_seq=1 ttl=63 time=0.566 ms
64 bytes from t-yosemite-r7-357.test.releng.mdc1.mozilla.com (10.49.56.141): icmp_seq=2 ttl=63 time=0.609 ms
^C
--- t-yosemite-r7-357.test.releng.mdc1.mozilla.com ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1521ms
rtt min/avg/max/mdev = 0.566/0.587/0.609/0.032 ms
```

and ssh works now.

the logs show it is claiming work (no work to claim right now), tc worker explorer display doesn't work for it (looks like a missing task id error), but the worker is running correctly:
https://tools.taskcluster.net/provisioners/releng-hardware/worker-types/gecko-t-osx-1010/workers/mdc1/t-yosemite-r7-357
```
[[e-mail] ~]# ps -ef|grep worker
   29  1473     1   0  1:23PM ??         0:00.00 /bin/bash /usr/local/bin/run-generic-worker.sh run --config /etc/generic-worker.config
   29  1475  1473   0  1:23PM ??         0:00.09 /usr/local/bin/generic-worker run --config /etc/generic-worker.config
   29  1476  1473   0  1:23PM ??         0:00.01 logger -t generic-worker -s
    0  1487  1483   0  1:23PM ttys000    0:00.00 grep worker
```
```
Jul 23 13:24:16 t-yosemite-r7-357.test.releng.mdc1.mozilla.com generic-worker: 2018/07/23 13:24:16 No task claimed. Idle for 1m4.109733202s (will exit if no task claimed in 95h58m55.890266798s). 1 more tasks to run before exiting. 
```