Closed Bug 887798 (tegra-160) Opened 11 years ago Closed 10 years ago

tegra-160 problem tracking

Categories

(Infrastructure & Operations Graveyard :: CIDuty, task, P3)

ARM
Android

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: kmoir, Unassigned)

References

()

Details

(Whiteboard: [buildduty][buildslaves][capacity])

needs a recovery, cannot connect to dataport. I rebooted it
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → FIXED
Product: mozilla.org → Release Engineering
Status: RESOLVED → REOPENED
Depends on: 971099
Resolution: FIXED → ---
SD card replaced, host reimaged and flashed

[vle@admin1a.private.scl3 ~]$ fping tegra-160.tegra.releng.scl3.mozilla.com
tegra-160.tegra.releng.scl3.mozilla.com is alive
Status: REOPENED → RESOLVED
Closed: 11 years ago10 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 980662)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
swapped SD card, reimaged and reflashed. host is pingable but im not able to telnet to port 20701. if host continually fails, we should probably decommission.

[vle@admin1a.private.scl3 ~]$ fping tegra-160.tegra.releng.scl3.mozilla.com
tegra-160.tegra.releng.scl3.mozilla.com is alive

[vle@admin1a.private.scl3 ~]$ telnet tegra-160.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.121...
telnet: connect to address 10.26.85.121: Connection refused
Taking jobs again
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 986779)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
sd card formatted, tegra flashed and reimaged.


[vle@admin1a.private.scl3 ~]$ telnet tegra-160.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.121...
Connected to tegra-160.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]q

telnet> q
back in prod running green :)
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1008657)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
sd card formatted, tegra flashed and reimaged.


[vle@admin1a.private.scl3 ~]$ telnet tegra-160.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.121...
Connected to tegra-160.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]q

telnet> q
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1013243)
QA Contact: armenzg → bugspam.Callek

sd card formatted, tegra flashed and reimaged.


[vle@admin1a.private.scl3 ~]$ telnet tegra-160.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.121...
Connected to tegra-160.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]q

telnet> q
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1017199)
SD card replaced, reflashed, and reimaged.


telnet tegra-160.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.121...
Connected to tegra-160.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]
telnet> q
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1022876)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
sd card formatted, tegra flashed and reimaged.


[vle@admin1a.private.scl3 ~]$ telnet tegra-160.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.121...
Connected to tegra-160.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]q

telnet> q
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1028975)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Was not.
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → FIXED
formatted SD card, flashed and reimaged tegra.

vle@vle-10516 ~ $ telnet tegra-160.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.121...
Connected to tegra-160.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]
telnet> q
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1029901)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Something must be wrong with this tegra, since it takes jobs wonderfully well, but when we run out of jobs (note how most of the "unreachable" claims are on a Monday morning, after Sunday drains the entire backlog of jobs) and slaverebooter gets an excuse to reboot it, it's even money whether it'll reboot just fine or get a (bogus, note how it rebooted perfectly well a few minutes after this most recent one) unreachable bug filed on it. However, that still makes it better than and less in need of attention than most of the tegra pool.
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1031937)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
sd card formatted, tegra flashed and reimaged.

vle@vle-10516 ~ $ telnet tegra-160.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.121...
Connected to tegra-160.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]
telnet> q
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1035081)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
replaced SD card, flashed and reimaged tegra.

vle@vle-10516 ~ $ telnet tegra-160.tegra.releng.scl3.mozilla.com 20701
Trying 10.26.85.121...
Connected to tegra-160.tegra.releng.scl3.mozilla.com.
Escape character is '^]'.
$>^]
telnet> q
And for those keeping track, the 06-29 one was on a Sunday, and was totally bogus, it continued taking jobs after that; the 07-07 one was on a Monday, and was totally bogus, it continued taking jobs after that, including the burned one that it was trying to run at the time of that recovery.
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → FIXED
Attempting SSH reboot...Failed.
Attempting PDU reboot...Failed.
Filed IT bug for reboot (bug 1036302)
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
All tegras are being decommissioned.
Status: REOPENED → RESOLVED
Closed: 10 years ago10 years ago
Resolution: --- → WONTFIX
Product: Release Engineering → Infrastructure & Operations
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in before you can comment on or make changes to this bug.