465776 - "MacOSX Darwin 8.8.1 talos try trunk" is perma-red with "exceptions.IOError: [Errno 2] No such file or directory"

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P2)

Description

[Daniel Holbert [:dholbert]]

The "MacOSX Darwin 8.8.1 talos try trunk" machine just had 19 red cycles, each on the order of a minute long, each with this error message:

<p class="error">exceptions.IOError: [Errno 2] No such file or directory: '/build/tryperfmaster/mac-trunk/1154-log-shell-stdio'</p>

(with "1028" being replaced with a different ID in each log)

Master tinderbox page:
http://tinderbox.mozilla.org/showbuilds.cgi?tree=MozillaTry

Here are some of the red logs:
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1227119406.1227119419.26129.gz
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1227119420.1227119465.26854.gz
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1227119421.1227119464.26847.gz
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1227119422.1227119462.26828.gz
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1227119419.1227119458.26789.gz
http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1227119423.1227119457.26775.gz

I'm not sure whether it needs a reboot or a clobber, but it needs something.

Comment 1

[alice nodelman [:alice] [:anode]]

This was a resurrection from bug 462312.

I think that it failed out all in a row like that from attempting to process stale builds once it got flipped back on.

I'm just waiting on a new build to appear to see if I'm right.

Comment 2

[Daniel Holbert [:dholbert]]

It just had another 1-minute red cycle, starting at 11:20  (after a 50-minute period of quiet)

http://tinderbox.mozilla.org/showlog.cgi?log=MozillaTry/1227122452.1227122454.2807.gz

Comment 3

[alice nodelman [:alice] [:anode]]

The machine was offline for long enough that our buildbot cleanup scripts had removed its working directory from the master.  I've restarted the try buildbot master and it has recreated the directory structure.

Should go green on next cycle.