650297 - Remove try-mac-slave35 from our configs and slavealloc

Status: RESOLVED DUPLICATE of bug 700705

(Release Engineering :: General, defect, P4)

Description

[Chris AtLee [:catlee]]

It hung another reconfig on pm02-try

Comment 1

[Dustin J. Mitchell [:dustin] (he/him)]

Is it possible that there's some state on the master that's killing this, or has the master been restarted in the interim?

Comment 2

[Chris AtLee [:catlee]]

(In reply to comment #1)
> Is it possible that there's some state on the master that's killing this, or
> has the master been restarted in the interim?

The master has been restarted several times to work around this slave

Comment 3

[Chris AtLee [:catlee]]

Attachment: remove try-mac-slave35 from configs

Comment 4

[Chris AtLee [:catlee]]

Comment on attachment 526283 [details] [diff] [review]
remove try-mac-slave35 from configs

http://hg.mozilla.org/build/buildbot-configs/rev/2d7fcc8eb4e4

Comment 5

[John Ford [:jhford] CET/CEST Berlin Time]

It looks like this is fixed.  Checked a try master to verify

Comment 6

[Dustin J. Mitchell [:dustin] (he/him)]

How is this fixed?  Has the slave already been reimaged?

Comment 7

[Chris AtLee [:catlee]]

(In reply to comment #5)
> It looks like this is fixed.  Checked a try master to verify

Shut down the slave ASAP por favor.

Comment 8

[Dustin J. Mitchell [:dustin] (he/him)]

A shutdown slave is a waste of resources - this needs to get driven to an actual resolution, but I'm not sure what the current state is..

Comment 9

[Chris AtLee [:catlee]]

(In reply to comment #8)
> A shutdown slave is a waste of resources - this needs to get driven to an
> actual resolution, but I'm not sure what the current state is..

I want it shut down now to avoid the slave hanging again.  This machine needs inspection before hooking up again to production or staging.

Comment 10

[Dustin J. Mitchell [:dustin] (he/him)]

OK, from the looks of it, it is shut down.  It's also disabled in slavealloc.  I filed bug 650842 to re-image it.  We can bring it up in preproduction at that point, and see what it does.

Comment 11

[Chris Cooper [:coop] (he/him)]

This slave popped back up today and started trying to login to bm09. I've disabled it in slavealloc until bug 650842 happens.

Comment 12

[Dustin J. Mitchell [:dustin] (he/him)]

Curious that it had been re-enabled..

Comment 13

[Chris Cooper [:coop] (he/him)]

(In reply to Dustin J. Mitchell [:dustin] from comment #12)
> Curious that it had been re-enabled..

Yeah. :/

There was no note with the bug # in slavealloc (or if there was, it was cleared), so I added one back.

Comment 14

[Armen [:armenzg]]

This slave is being decommissioned by IT in bug 650842.

I will make sure we remove it from slavealloc as well.

Comment 15

[Armen [:armenzg]]

To help me track removal of slaves I'm going to be doing all of it in bug 700705.