735512 - relabs08 in an infinite reboot loop

Status: RESOLVED FIXED

(Infrastructure & Operations :: RelOps: General, task)

Description

[Amy Rich [:arr] [:arich]]

relabs08 is in an infinite reboot loop.  When starting to boot centos, it prints this error:

http://bugs.centos.org/view.php?id=5493

Which is supposedly harmless... and then claims it's restarting the system.  Please take a look at it.  I have left the machine powered off for now.

Comment 1

[Matthew Larrain[:MaRu]]

This is due to puppet stating that it is already running and then failing to start. Machine starts up fine in single user mode also.

Comment 2

[John Ford [:jhford] CET/CEST Berlin Time]

i wonder if this is a stale lock file from puppet?  It might be a good idea to remove the puppet lock file very early on in the system startup, way before puppet would be invoked.

Comment 3

[Dustin J. Mitchell [:dustin] (he/him)]

Should be fixed in

changeset:   124:ebb3fb861486
tag:         tip
user:        Dustin J. Mitchell <[e-mail]>
date:        Thu Mar 15 23:22:46 2012 -0500
summary:     Bug 735512: wait 10 minutes between puppet-failure reboots

From later discussions it doesn't sound like this actually was a stale lockfile.  Newer versions of puppet are supposed to be better about that, so I don't want to hack around such a bug until I've seen it.

I've stood relabs08 back on its feet (fixing the corrupt repo in the process)