1092902 - (talos-mtnlion-r5-093) talos-mtnlion-r5-093 problem tracking

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task, P3)

Description

[Nick Thomas [:nthomas] (UTC+12)]

Burning a lot of builds, errors like:

bash -c 'basename "$PWD"'
 in dir /builds/slave/talos-slave/test/. (timeout 1200 secs)
...
command timed out: 1200 seconds without output running ['bash', '-c', 'basename "$PWD"'], attempting to kill
SIGKILL failed to kill process
using fake rc=-1
program finished with exit code -1

remoteFailed: [Failure instance: Traceback from remote host -- Traceback (most recent call last):
Failure: exceptions.RuntimeError: SIGKILL failed to kill process

and:
rm -rf scripts
 in dir /builds/slave/talos-slave/test/. (timeout 1200 secs)
...
rm: scripts/.gitignore: Invalid argument
rm: scripts/.hg/00changelog.i: Invalid argument
...
rm: scripts: Directory not empty
program finished with exit code 1

Trying a reboot, may have a disk issue.

Comment 1

[Release Engineering SlaveAPI Service]

Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1092903)

Comment 2

[Nick Thomas [:nthomas] (UTC+12)]

Buildbot is stopped at least; it's still enabled in slavealloc.

Comment 3

[Phil Ringnalda (:philor)]

Maybe all it really wanted was a reboot.

Comment 4

[Nick Thomas [:nthomas] (UTC+12)]

Could be, the reimage it got in bug 1092903 was requested explicitly.