925002 - Please increase the buildbot timeout for builds

Status: RESOLVED WONTFIX

(Release Engineering :: General, defect)

Description

[(no longer active)]

I've been trying very hard to get try results for my patches in bug 915735 but I keep hitting either of the 7200 second or the 16200 second timeout that seems to be imposed by buildbot on build jobs.  I've ran out of ideas to work around this without increasing the timeout on buildbot, please see an example of my efforts here: <https://tbpl.mozilla.org/?tree=Try&rev=3a79c1775830>.

Ben, is there any chance that you can bump up that limit at least temporarily?  We can being it back down if bug 915735 proves to be infeasible...

I think all I need is an additional half an hour on both of those timeouts, (maybe an hour to be safe?)  It basically depends on how stringent we want to be on these limits.  :-)

Thanks a lot!

Comment 1

[[e-mail] (:bhearsum)]

OK, so this is the idle timeout (not the maximum step time), which is not terribly difficult to adjust, but doing so does cause eat extra slave time on real runaway jobs. However, it looks like you should be able to get a little noisy in expandlibs_exec.py or link.py to work around this. In fact, I think the most recent build on that Try job does that already?

If there's actual useful status that could be printed from time to time that might be better from a debugging standpoint too.

If we need to bump up the time we can, but I think there's a better way here.

Comment 2

[Phil Ringnalda (:philor)]

He was also hitting max time, wasn't he, https://tbpl.mozilla.org/php/getParsedLog.php?id=28903273&tree=Try "command timed out: 16200 seconds elapsed, attempting to kill"?

Comment 3

[[e-mail] (:bhearsum)]

Seems so. I didn't expect all of the logs to have different errors....

Comment 4

[(no longer active)]

I don't need this any longer.