Closed Bug 778894 (tegra-117) Opened 12 years ago Closed 10 years ago

tegra-117 problem tracking

Categories

(Infrastructure & Operations Graveyard :: CIDuty, task, P3)

ARM
Android

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: Callek, Unassigned)

References

()

Details

(Whiteboard: [buildduty][buildslaves][capacity])

Last Job 3 days, 21:06:21 ago
Status: NEW → RESOLVED
Closed: 12 years ago
Resolution: --- → FIXED
Product: mozilla.org → Release Engineering
2014-01-16 10:24:45 tegra-117 p    online   active  OFFLINE :: error.flg [Automation Error: Unable to connect to device after 5 attempts] 

pdu reboot didn't help
Status: RESOLVED → REOPENED
Depends on: 960642
Resolution: FIXED → ---
SD card swapped & reimaged/flashed.
(In reply to Eric Ramirez [:Eric] from comment #2)
> SD card swapped & reimaged/flashed.

can we try a second one? the first didn't work
Depends on: 974917
SD card formatted, tegra reimaged and flashed.

[vle@admin1a.private.scl3 ~]$ fping tegra-117.tegra.releng.scl3.mozilla.com
tegra-117.tegra.releng.scl3.mozilla.com is alive
Taking jobs again
Status: REOPENED → RESOLVED
Closed: 12 years ago10 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 986778)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
sd card formatted, tegra flashed and reimaged.


[vle@admin1a.private.scl3 ~]$ telnet tegra-117.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.91...
Connected to tegra-117.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]q

telnet> q
Power cycled, waited a day.

error.flg: Automation Error: Unable to connect to device after 5 attempts

SD card reformat failed:

$>exec newfs_msdos -F 32 /dev/block/vold/179:9
newfs_msdos: /dev/block/vold/179:9: No such file or directory
return code [1]
Depends on: 991259
after SD card was replaced and re-imaged in 991259 it is still not running jobs:

./check.sh -t tegra-117
    2014-04-07 12:32:34,509 tegra-117 p    online   active  OFFLINE :: error.flg [Automation Error: Unable to connect to device after 5 attempts]

from watcher.log:
    1832 04/07/2014 12:29:36: INFO: INFO: Unable to connect to device after 4 try
    1833 04/07/2014 12:29:36: INFO: We're going to sleep for 90 seconds
    1834 2014-04-07 12:30:01 -- *** ERROR *** failed to aquire lockfile
    1835 04/07/2014 12:31:06: INFO: Connecting to: tegra-117
    1836 04/07/2014 12:31:06: INFO: /builds/tegra-117/error.flg
    1837 04/07/2014 12:31:36: INFO: verifyDevice: failing to telnet
    1838 reconnecting socket

not sure what to do?
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 994770)
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1003656)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
formatted, flashed and reimaged.

[vle@admin1a.private.scl3 ~]$ telnet tegra-117.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.91...
Connected to tegra-117.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]q
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1008637)
formatted, flashed and reimaged.

[vle@admin1a.private.scl3 ~]$ telnet tegra-117.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.91...
Connected to tegra-117.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]q
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
QA Contact: armenzg → bugspam.Callek
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1015020)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
formatted, flashed and reimaged.

[vle@admin1a.private.scl3 ~]$ telnet tegra-117.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.91...
Connected to tegra-117.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]q
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1016164)
SD card replaced, reflashed, and reimaged.


telnet tegra-117.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.91...
Connected to tegra-117.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]
telnet> q
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1017402)
SD card replaced, reflashed, and reimaged.


telnet tegra-117.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.91...
Connected to tegra-117.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]
telnet> q
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1021745)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
SD card replaced, reflashed, and reimaged.


telnet tegra-117.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.91...
Connected to tegra-117.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]
telnet> q
Frequency's a little worrisome, but it did take a job.
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1022304)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
formatted SD card, flashed and reimaged tegra.

vle@vle-10516 ~ $ telnet tegra-117.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.91...
Connected to tegra-117.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]
telnet> q
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1029964)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → FIXED
foopy117 is going away, and these tegras are attached to it.

They are being decomissioned in Bug 1043938, and I just disabled all of them in slavealloc and marked them as decom with a comment pointing at Bug 1043938
Product: Release Engineering → Infrastructure & Operations
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.