778835 - (tegra-194) tegra-194 problem tracking

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task, P3)

Comment 1

[Phil Ringnalda (:philor)]

Did okay for a while, but now it's on a streak of 8 reds in a row, which isn't headed in any good direction.

Comment 2

[Justin Wood (:Callek)]

ran stop_cp on it, will need to get added to next recovery bug

Comment 3

[[e-mail] (:bhearsum)]

Back in production.

Comment 4

[Phil Ringnalda (:philor)]

23 timeouts in verify.py in a row.

Comment 5

[Justin Wood (:Callek)]

Last job 2 days, 2:13:26 ago (which is probably skewed given philor's note about timeouts)

had a hung proc:
cltbld          8911   0.0  0.5  2566572  45392   ??  S    Thu07AM   0:05.77 /builds/tegra-194/test/build/hostuti
ls/bin/xpcshell -g /builds/tegra-194/test/build/hostutils/xre -v 170 -f ./httpd.js -e const _PROFILE_PATH = '/tmp
/tmp9XRUKW';const _SERVER_PORT = '30194'; const _SERVER_ADDR = '10.250.48.221';^J                     const _TEST
_PREFIX = undefined; const _DISPLAY_RESULTS = false; -f ./server.js

Can telnet no prompt:

PDU Cycled

Comment 6

[[e-mail] (:bhearsum)]

This tegra is burning jobs all over the place. Dunno what to do with it. Callek?

Comment 7

[[e-mail] (:bhearsum)]

Oh, and i ran stop_cp on it.

Comment 8

[Justin Wood (:Callek)]

Ran ./stop_cp.sh

Comment 9

[Justin Wood (:Callek)]

Back up

Comment 10

[Phil Ringnalda (:philor)]

It's somehow lost the ability to run robocop tests (https://tbpl.mozilla.org/php/getParsedLog.php?id=23448487&tree=Mozilla-Inbound, https://tbpl.mozilla.org/php/getParsedLog.php?id=23461957&tree=Mozilla-Inbound "java-exception | java.lang.RuntimeException: Unable to instantiate application com.android.browser.Browser: java.lang.InstantiationException: com.android.browser.Browserat android.app.ActivityThread$PackageInfo.makeApplication(ActivityThread.java:649)"), please disable it.

Comment 11

[Phil Ringnalda (:philor)]

https://tbpl.mozilla.org/php/getParsedLog.php?id=23477149&tree=Mozilla-Inbound

Comment 12

[Geoff Brown [:gbrown]]

tegra-194 is the only device reporting failures in bug 880299.

Please disable tegra-194 and re-image it before returning to service.

Comment 13

[Kim Moir [:kmoir] ET]

disabled.  I can't connect to the data port to reimage it.

Comment 14

[Justin Wood (:Callek)]

Sending this slave to recovery
-->Automated message.

Comment 15

[Justin Wood (:Callek)]

Successfully recovered.

Comment 16

[Justin Wood (:Callek)]

Thursday, October 31, 2013 2:26:39 PM

Comment 17

[Eric Ramirez [:Eric]]

SD card has been replaced and reimaged/flashed.

Comment 18

[[e-mail] (:bhearsum)]

Back in production

Comment 19

[Geoff Brown [:gbrown]]

tegra-194 is the only device reporting failures in bug 1011788.

Please disable tegra-194 and re-image it before returning to service.

Comment 20

[Phil Ringnalda (:philor)]

Disabled in slavealloc.

Comment 21

[Van Le [:van]]

formatted SD card, flashed and reimaged tegra.

vle@vle-10516 ~ $ telnet tegra-194.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.148...
Connected to tegra-194.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]
telnet> q