828023 - release runner died when trying to update status

Status: RESOLVED FIXED

(Release Engineering :: Release Automation, defect)

Description

[[e-mail] (:bhearsum)]

I hit this today when kicking off 19.0b1build2:
2013-01-08 16:01:16,767 - INFO - updating status for Fennec-19.0b1-build2 to Failed: TypeError('%d format: a number is required, not NoneType',)
============================== Remaining masters ==============================
bm49-build1
================================================================================
2013-01-08 16:01:18,328 - INFO - updating status for Firefox-19.0b1-build2 to Failed: TypeError('%d format: a number is required, not NoneType',)
Traceback (most recent call last):
  File "/home/bhearsum/Mozilla/checkouts/github/tools/buildfarm/release/release-runner.py", line 345, in <module>
    update_and_reconfig(masters_json, callback=callback)
  File "/home/bhearsum/Mozilla/checkouts/github/tools/buildfarm/release/release-runner.py", line 171, in update_and_reconfig
    fabric_helper.update_and_reconfig()
  File "/home/bhearsum/Mozilla/checkouts/github/tools/lib/python/util/fabric/common.py", line 57, in update_and_reconfig
    self.reconfig(**cmdKwargs)
  File "/home/bhearsum/Mozilla/checkouts/github/tools/lib/python/util/fabric/common.py", line 52, in reconfig
    self.fabric_cmd(['reconfig'], **cmdKwargs)
  File "/home/bhearsum/Mozilla/checkouts/github/tools/lib/python/util/fabric/common.py", line 41, in fabric_cmd
    **cmdKwargs)
  File "/home/bhearsum/Mozilla/checkouts/github/tools/lib/python/util/commands.py", line 111, in run_cmd_periodic_poll
    elapsed))
TypeError: %d format: a number is required, not NoneType


Not sure what happened, but it caused me to have to comment out a bunch of stuff to skip config bumping/sanity/etc.

Comment 1

[[e-mail] (:bhearsum)]

When I landed release runner, this test failed with the same problem:
======================================================================
ERROR: testSuccess3secsWith2secsPoll (mozilla_buildtools.test.test_util_commands.TestRunCmdiPeriodicPoll)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/builds/buildbot/preproduction/slave/test-masters/tools/lib/python/mozilla_buildtools/test/test_util_commands.py", line 61, in testSuccess3secsWith2secsPoll
    warning_interval=2),
  File "/builds/buildbot/preproduction/slave/test-masters/tools/lib/python/util/commands.py", line 111, in run_cmd_periodic_poll
    elapsed))
TypeError: %d format: a number is required, not NoneType
-------------------- >> begin captured logging << --------------------
util.commands: INFO: command: START
util.commands: INFO: command: bash -c "sleep 3 && true"
util.commands: INFO: command: cwd: /builds/buildbot/preproduction/slave/test-masters/tools/lib/python
util.commands: INFO: command: output:
--------------------- >> end captured logging << ---------------------

Comment 2

[[e-mail] (:bhearsum)]

99% sure that this is fixed by https://hg.mozilla.org/build/tools/rev/af5ad327a18b