1498993 - [MDC2] t-yosemite-r7-225 Stdio

Status: RESOLVED FIXED

(Infrastructure & Operations :: RelOps: Hardware, task)

Description

[Adrian Pop]

Tried to log on the machine this morning, but I've received the following error : 

Stdio forwarding request failed: Session open refused by peer
ssh_exchange_identification: Connection closed by remote host

Also, by checking the  papertrail logs, I've only found the following line :

Oct 15 00:38:49 rejh1.srv.releng.mdc2.mozilla.com sshd: error: connect_to t-yosemite-r7-225.test.releng.mdc2.mozilla.com port 22: failed.
Oct 15 00:40:39 rejh1.srv.releng.mdc2.mozilla.com sshd: error: connect_to t-yosemite-r7-225.test.releng.mdc2.mozilla.com port 22: failed. 

On taskcluster is missing. Can you please take a look ?

Comment 1

[:dhouse]

No logs in papertrail
No response to ping/ssh
Turned off power, waited 30s and turned it back on.
Machine showed up in papertrail and responds to ping/ssh.

Comment 2

[Zsolt Fay [:zfay]]

SSh hangs again , worker is missing from TC explorer and ping isn't possible:
--- t-yosemite-r7-225.test.releng.mdc2.mozilla.com ping statistics ---
3 packets transmitted, 0 received, 100% packet loss, time 2053ms

Could you take a look at this as well dhouse?

Comment 4

[:dhouse]

no logs for 4 days https://papertrailapp.com/groups/1223184?filter=t-yosemite-r7-225
last logs show it had crashed:
```
Nov 02 14:41:57 t-yosemite-r7-225 com.apple.xpc.launchd: (com.apple.ReportCrash[2038]): Endpoint has been activated through legacy launch(3) APIs. Please switch to XPC or bootstrap_check_in(): com.apple.ReportCrash
Nov 02 14:41:58 t-yosemite-r7-225 kernel: CODE SIGNING: cs_invalid_page(0x1005cb000): p=2039[spindump] final status 0x2000000, allowing (remove VALID) page
Nov 02 14:41:58 t-yosemite-r7-225 kernel: firefox (map: 0xffffff8022dca3c0) triggered DYLD shared region unnest for map: 0xffffff8022dca3c0, region 0x7fff93200000->0x7fff93400000. While not abnormal for debuggers, this increases system memory footprint until the target exits.
Nov 02 14:42:12 t-yosemite-r7-225 kernel: process python[1922] caught causing excessive wakeups. Observed wakeups rate (per sec): 263; Maximum permitted wakeups rate (per sec): 150; Observation period: 300 seconds; Task lifetime number of wakeups: 45078 
```

powered off for 1 minute
powered back on
came up and is took a task from taskcluster