Closed Bug 1289855 Opened 9 years ago Closed 9 years ago

buildbot-master69 failed reconfig [at least] three days in a row

Categories

(Infrastructure & Operations Graveyard :: CIDuty, task)

Product:
Infrastructure & Operations Graveyard
Component:
CIDuty
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED WONTFIX

People

(Reporter: mozilla, Unassigned)

Details

https://papertrailapp.com/groups/1223224/events?q=(%22Reconfig+completed%22+OR+%22Reconfig+failed%22) Jul 25 08:00:15 buildbot-master69.bb.releng.use1.mozilla.com maybe_reconfig.sh: ERROR - Reconfig failed. - 1469458801 Jul 25 16:00:23 buildbot-master69.bb.releng.use1.mozilla.com maybe_reconfig.sh: ERROR - Reconfig failed. - 1469487601 Jul 26 14:00:24 buildbot-master69.bb.releng.use1.mozilla.com maybe_reconfig.sh: ERROR - Reconfig failed. - 1469566801 Jul 27 10:00:17 buildbot-master69.bb.releng.use1.mozilla.com maybe_reconfig.sh: ERROR - Reconfig failed. - 1469638801 From today: Jul 27 10:00:01 buildbot-master69.bb.releng.use1.mozilla.com CROND: (cltbld) CMD (/builds/buildbot/tests1-windows/tools/buildfarm/maintenance/maybe_reconfig.sh /builds/buildbot/tests1-windows 2>&1 | logger -t maybe_reconfig.sh) Jul 27 10:00:01 buildbot-master69.bb.releng.use1.mozilla.com CROND: (root) CMD (/sbin/mig-agent -q=pid 2>&1 1>/dev/null || /sbin/mig-agent) Jul 27 10:00:01 buildbot-master69.bb.releng.use1.mozilla.com CROND: (root) CMD (/usr/local/bin/buildmaster-retry_dead_queue.sh 2>&1 | logger -t retry_dead_queue) Jul 27 10:00:17 buildbot-master69.bb.releng.use1.mozilla.com maybe_reconfig.sh: ERROR - Reconfig failed. - 1469638801 There are no other log messages about the reconfig other than it failed.
13:09 <•nthomas> aki: bm69 is an old windows test master which is disabled 13:10 <•nthomas> we should just kill it, or turn it into a real boy 13:10 <aki> ah. i wonder why it's being reconfiged
Aki,the reason why this disabled master is still been reconfiged is because there are some cronjobs which are been appplied by Puppet,see the link bellow: (http://hg.mozilla.org/build/puppet/file/tip/modules/buildmaster/templates/buildmaster-cron.erb).
I pinned this master to my puppet environment and disabled the cronjobs responsible for running puppet and reconfig. Andrei is using this master for testing some improvements on the master restart script. I'll mark this as resolved for now, please feel free to reopen if needed.
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → WONTFIX
Product: Release Engineering → Infrastructure & Operations
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.