778886 - (tegra-091) tegra-091 problem tracking

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task, P3)

Description

[Justin Wood (:Callek)]

Last Job 3 days, 17:52:32 ago

Comment 1

[Justin Wood (:Callek)]

Sending this slave to recovery
-->Automated reopening of bug

Comment 2

[Vinh Hua [:vinh]]

flashed and reimaged.

Comment 3

[John Hopkins (:jhopkins)]

Power cycled, waited a day.

error.flg: Automation Error: Unable to connect to device after 5 attempts

SD card reformat successful:

$>exec newfs_msdos -F 32 /dev/block/vold/179:9
newfs_msdos: warning, /dev/block/vold/179:9 is not a character device
newfs_msdos: Skipping mount checks
/dev/block/vold/179:9: 15520000 sectors in 242500 FAT32 clusters (32768 bytes/cluster)
bps=512 spc=64 res=32 nft=2 mid=0xf0 spt=16 hds=4 hid=0 bsec=15523840 bspf=1895 rdcl=2 infs=1 bkbs=2
return code [0]
$>exec rebt
$>^]

Comment 4

[Jordan Lund (:jlund)]

looks like it's been running pretty green bar this one orange mochitest-6 suite:
http://buildbot-master99.srv.releng.scl3.mozilla.com:8201/builders/Android%202.2%20Armv6%20Tegra%20try%20opt%20test%20mochitest-6/builds/1169

<snippet>
TEST-UNEXPECTED-FAIL | remoteautomation.py | application timed out after 330 seconds with no output
INFO | automation.py | Application ran for: 0:05:45.220273
INFO | zombiecheck | Reading PID log: /tmp/tmpKjDG5Ypidlog
/data/anr/traces.txt not found
PROCESS-CRASH | java-exception | java.lang.Exception: Error loading gecko libraries at org.mozilla.gecko.mozglue.GeckoLoader.loadGeckoLibsNative(Native Method)
WARNING | leakcheck | refcount logging is off, so leaks can't be detected!
runtests.py | Running tests: end.
Mochi-Remote WARNING | Unable to retrieve log file (/mnt/sdcard/tests/logs/mochitest.log) from remote device
</snippet>

Comment 5

[Jordan Lund (:jlund)]

looks like we hit a xpcshell fail:

reconnecting socket
Pushing assets/libmozalloc.so..
Pushing assets/libnss3.so..
Pushing assets/libxul.so..
Pushing assets/libnssckbi.so..
Pushing assets/libfreebl3.so..
Pushing assets/libsoftokn3.so..
Pushing assets/libomxplugin.so..
Pushing assets/libomxplugingb.so..
Pushing assets/libomxplugingb235.so..
Pushing assets/libomxpluginhc.so..
Pushing assets/libomxpluginfroyo.so..
Pushing assets/libomxpluginkk.so..
Pushing lib/armeabi-v7a/libplugin-container.so..
Pushing lib/armeabi-v7a/libmozglue.so..
pushing directory: modules to /mnt/sdcard/tests/xpcshell/m
pushing /builds/tegra-091/test/build/tests/xpcshell/tests
pushing directory: /builds/tegra-091/test/build/tests/xpcshell/tests to /mnt/sdcard/tests/xpcshell

and this added an error.flg to the device stopping further jobs:

watcher log snippet: 8023 04/08/2014 15:25:08: INFO: Connecting to: tegra-091
8024 04/08/2014 15:25:09: INFO: INFO: attempting to create file /mnt/sdcard/writetest
8025 04/08/2014 15:25:09: INFO: INFO: updateSUT.py: We're running SUTAgentAndroid Version 1.20
8026 04/08/2014 15:25:09: INFO: INFO: Got expected SUTAgent version '1.20'
8027 04/08/2014 15:25:10: INFO: devroot /mnt/sdcard/tests
8028 04/08/2014 15:25:10: INFO: removeDir() returned [Deleting file(s) from /mnt/sdcard/tests
8029 Deleting file(s) from /mnt/sdcard/tests/xpcshell
8030     Unable to delete  ÷1^C.?>■
8031     Unable to delete ª.V
8032     Unable to delete    .¥^¼
8033     Unable to delete ┐÷$^±Ω].Tm╪
8034     Unable to delete s╕ª┬║·╝%.╟u
8035     Unable to delete ü▄cJ╒ⁿÇI.\╢i
8036     Unable to delete .ªV
8037     Unable to delete ⌐F├. 6v
8038     Unable to delete s╕ª┬║·╝%.╟u
8039     Unable to delete ü▄cJ╒ⁿÇI.\╢i
8040     Unable to delete .ªV
8041     Unable to delete ⌐F├. 6v
8042     Unable to delete ⌡*á╨y╔.^_9Ä
8043     Unable to delete ±xàñl·êì.┤è
8044     Unable to delete ªV
8045 Deleting file(s) from /mnt/sdcard/tests/xpcshell/m
8046     Unable to delete #p¬à\╠║^Q.Σÿî
8047     Unable to delete .▒^C╣
8048     Unable to delete ╔*.∞   ∞
8049     Unable to delete ^W╫^K_╝R.f=╒
8050     Unable to delete ^F╝.^R√R
8051     Unable to delete .û┬`
8052 Unable to delete directory /mnt/sdcard/tests/xpcshell/m
8053 Unable to delete directory /mnt/sdcard/tests/xpcshell
8054 Unable to delete directory /mnt/sdcard/tests]
8055 04/08/2014 15:25:10: INFO: /builds/tegra-091/error.flg
8056 04/08/2014 15:25:40: INFO: verifyDevice: failing to cleanup device
8057 reconnecting socket
8058 removing file: /mnt/sdcard/writetest
8059 Remote Device Error: Unable to properly remove /mnt/sdcard/tests

I would imagine this sdcard needs to be re-imaged at least, maybe sdcard replaced

Comment 6

[Phil Ringnalda (:philor)]

Reenabled.

Comment 7

[Phil Ringnalda (:philor)]

Still busted, differently: slaveapi and I have rebooted it three times now, and it hasn't even taken one job.

Comment 8

[Phil Ringnalda (:philor)]

Then it got ever so slightly better.