659656 - when a build times out when removing "build" directory it should halt and retry the job

Status: RESOLVED INCOMPLETE

(Release Engineering :: General, enhancement, P4)

Description

[Jeff Muizelaar [:jrmuizel]]

rm -rf timed out on this build:
http://tinderbox.mozilla.org/showlog.cgi?log=Try/1306281908.1306299396.12250.gz&fulltext=1

Comment 1

[Armen [:armenzg]]

This was run on a VM and the step timed out without stopping the build (i.e. it run all the steps through until the end).

I would like two things to happen:
1) halting and retrying
2) bumping the timeout

Sounds good?

command timed out: 3600 seconds without output
program finished with exit code 1
elapsedTime=3600.125000

Comment 2

[Chris Cooper [:coop] (he/him)]

(In reply to comment #1)
> 2) bumping the timeout

Please, not this. If we're not getting output for 3600s, I don't think extending it will help.

Comment 3

[Aki Sasaki (not active)]

I changed this to rm -rfv in one of the tegra factories, with the assumption that by listing every file removed, it would have to hang on a single file for /timeout/ seconds to time out.

A side effect is that the log gets a lot larger, though.

Comment 4

[Armen [:armenzg]]

I won't have time to work on this.

Comment 5

[[e-mail] (:bhearsum)]

I don't think this is a buildduty issue, this is a regular old bug.

Comment 6

[Chris AtLee [:catlee]]

p4 enhancement based on the fact this doesn't seem to happen very often