1483746 - (t-yosemite-r7-092) [MDC2] t-yosemite-r7-092 problem tracking

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, defect)

Description

[Roland Mutter Michael (:rmutter)]

When trying to ssh into machine, we're facing stdio error.

Comment 1

[Adrian Pop]

the problem still persists. 
Today, I've tried to connect to it and I've received the following error :

Stdio forwarding request failed: Session open refused by peer
ssh_exchange_identification: Connection closed by remote host

Comment 3

[Radu Iman[:riman]]

This machine is running tasks.

Comment 4

[Adrian Pop]

machine seems to be up and running tasks. we will close the bug for now. If the problem will persist in the future, we will re-open the bug.

Comment 5

[Adrian Pop]

the machine seems to be up and running and taking jobs 

https://tools.taskcluster.net/provisioners/releng-hardware/worker-types/gecko-t-osx-1010/workers/mdc2/t-yosemite-r7-092

We will close the bug for now. If the problem will persist in the future, we will re-open this bug.

Comment 6

[Roland Mutter Michael (:rmutter)]

Worker is in a bad state once again. I'm unable to ssh and machine is not responding to ping.

Comment 7

[:dhouse]

reimaged

Comment 8

[Bogdan Crisan [:bcrisan] (EEST - GMT + 3)]

Machine is in a bad state and has been quarantined.
Taskcluster link
The worker is burning tests and cause is not known ATM.

Comment 9

[Bogdan Crisan [:bcrisan] (EEST - GMT + 3)]

Compared to other workers, this is the only odd thing I can see in the logs atm:
Mar 23 04:30:25 t-yosemite-r7-092.test.releng.mdc2.mozilla.com identityservicesd: [Warning] DeviceHeartbeat - Failed loading device heartbeat data from keychain -25300
I'm going to reimage the machine for the moment and I'll see the outcome.

Comment 10

[Roland Mutter Michael (:rmutter)]

Few hours later, everything looks green.

Comment 11

[Radu Iman[:riman]]

I've quarantined this machine, it was running multiple tasks at the same time:

https://tools.taskcluster.net/provisioners/releng-hardware/worker-types/gecko-t-osx-1010/workers/mdc2/t-yosemite-r7-092

Comment 12

[Adrian Pop]

removed from quarantine,rebooted and blessed the machine...will keep on monitoring it

Comment 13

[Adrian Pop]

I've reimaged the machine and removed it from quarantine. Monitored it.
It didn't took multiple jobs any longer.

https://tools.taskcluster.net/provisioners/releng-hardware/worker-types/gecko-t-osx-1010/workers/mdc2/t-yosemite-r7-092

I will close the bug for now. If the issue will persist in the future, we will re-open the bug.