890895 - (bld-linux64-ix-051) bld-linux64-ix-051 problem tracking

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task, P3)

Description

[[e-mail] (:bhearsum)]

Seems to be talking to the wrong puppet server:
puppet-agent[2873]: Could not request certificate: Error 400 on SERVER: this master is not a CA

Comment 1

[[e-mail] (:bhearsum)]

Indeed, /etc/puppet/puppetmasters.txt has:
puppet
releng-puppet1.build.mtv1.mozilla.com
releng-puppet1.build.scl1.mozilla.com
releng-puppet1.srv.releng.scl3.mozilla.com

vs a working slave, which has:
releng-puppet2.build.scl1.mozilla.com
releng-puppet2.build.mtv1.mozilla.com
releng-puppet2.srv.releng.scl3.mozilla.com
releng-puppet1.srv.releng.use1.mozilla.com
releng-puppet2.srv.releng.use1.mozilla.com
releng-puppet1.srv.releng.usw2.mozilla.com
releng-puppet2.srv.releng.usw2.mozilla.com


However, even after changing that and rebooting the same error still comes up.

Looking a little further I noticed that the last time this slave connected to a master was 06-20-2013, and that's also the last time that puppetize.log was touched. That log has this in it:
Resolved client IP 10.250.49.199 to hostname bld-linux64-ix-051.build.mtv1.mozilla.com
Got incorrect certificates (!?)

Repuppetizing fixed it up, it's back in production now.

Comment 2

[[e-mail] (:bhearsum)]

Offline, IPMI reboot didn't work.

Comment 3

[Salvador Espinoza [:sal]]

I tried rebooting this and a few other things, only oob seems to be up.
Can this machine get repuppetized? maybe that will fix it? said in comment#1

Also the raritan dcim-usb seems to be working.

Comment 4

[Justin Wood (:Callek)]

It's actually taking jobs today. So didn't bother reimaging/repuppetizing

Comment 5

[[e-mail] (:bhearsum)]

(In reply to Justin Wood (:Callek) from comment #4)
> It's actually taking jobs today. So didn't bother reimaging/repuppetizing

Indeed, it's been working away happily for awhile.

Comment 6

[[e-mail] (:bhearsum)]

Down and not responding to IPMI reboots.

Comment 7

[Armen [:armenzg]]

I tried to bring it down and up with the IPMI web page but did not work.
Trying to load Console Redirection did not work either.

Comment 8

[Armen [:armenzg]]

Back online taking jobs.