Closed
Bug 747694
(tegra-159)
Opened 12 years ago
Closed 10 years ago
tegra-159 problem tracking
Categories
(Infrastructure & Operations Graveyard :: CIDuty, task)
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: philor, Unassigned)
References
()
Details
(Whiteboard: [buildduty][capacity])
Hit four retries yesterday afternoon, and since then has been pure red (which seems to be the new pattern for Tegra failures).
Comment 1•12 years ago
|
||
I gracefulled from the webUI on the master, and powercycled while connected to foopy05. Hopefully one or both of those fix this up, otherwise someone will be tasked for officially bringing this tegra offline
Comment 2•12 years ago
|
||
Mike, FYI for when you start on my deploys for this, look at the log to see what went wrong here. 2012-04-21 23:20:02 tegra-159 p INACTIVE active OFFLINE :: SUTAgent not present; 2012-04-21 23:24:04 tegra-159 p online INACTIVE OFFLINE :: CP 0d 511s; Right after I did the above.
Comment 3•12 years ago
|
||
This is restarted, and my deploy should solve (most?) of the chances for CP to go inactive.
Status: NEW → RESOLVED
Closed: 12 years ago
Resolution: --- → FIXED
Reporter | ||
Updated•12 years ago
|
Component: Release Engineering → Release Engineering: Machine Management
QA Contact: armenzg
Reporter | ||
Comment 4•12 years ago
|
||
I don't know exactly what it means is busted, but this has taken over the job of being every single instance in bug 789751 - if a reftest fails to load, then it's because it's running on tegra-159. Something's wrong with it.
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
Reporter | ||
Comment 5•12 years ago
|
||
https://tbpl.mozilla.org/php/getParsedLog.php?id=15742721&tree=Mozilla-Inbound
Reporter | ||
Comment 6•12 years ago
|
||
https://tbpl.mozilla.org/php/getParsedLog.php?id=16172478&tree=Mozilla-Inbound https://tbpl.mozilla.org/php/getParsedLog.php?id=16167591&tree=Mozilla-Aurora https://tbpl.mozilla.org/php/getParsedLog.php?id=16137441&tree=Mozilla-Aurora https://tbpl.mozilla.org/php/getParsedLog.php?id=16081647&tree=Mozilla-Inbound https://tbpl.mozilla.org/php/getParsedLog.php?id=16030563&tree=Mozilla-Inbound https://tbpl.mozilla.org/php/getParsedLog.php?id=16032159&tree=Mozilla-Inbound https://tbpl.mozilla.org/php/getParsedLog.php?id=15983228&tree=Firefox https://tbpl.mozilla.org/php/getParsedLog.php?id=15875696&tree=Mozilla-Beta https://tbpl.mozilla.org/php/getParsedLog.php?id=15848128&tree=Mozilla-Inbound https://tbpl.mozilla.org/php/getParsedLog.php?id=15730486&tree=Mozilla-Inbound https://tbpl.mozilla.org/php/getParsedLog.php?id=15723773&tree=Mozilla-Inbound https://tbpl.mozilla.org/php/getParsedLog.php?id=15687286&tree=Mozilla-Aurora https://tbpl.mozilla.org/php/getParsedLog.php?id=15677457&tree=Mozilla-Inbound https://tbpl.mozilla.org/php/getParsedLog.php?id=15670397&tree=Mozilla-Inbound https://tbpl.mozilla.org/php/getParsedLog.php?id=15653082&tree=Mozilla-Beta
Reporter | ||
Comment 7•12 years ago
|
||
https://tbpl.mozilla.org/php/getParsedLog.php?id=16182068&tree=Firefox
Reporter | ||
Comment 8•12 years ago
|
||
https://tbpl.mozilla.org/php/getParsedLog.php?id=16180455&tree=Mozilla-Aurora
Reporter | ||
Updated•12 years ago
|
Blocks: 438871
Whiteboard: [buildduty][capacity] → [buildduty][capacity][orange]
Comment 9•12 years ago
|
||
Actively running jobs.
Status: REOPENED → RESOLVED
Closed: 12 years ago → 12 years ago
Resolution: --- → FIXED
Reporter | ||
Comment 10•12 years ago
|
||
(In reply to Ben Hearsum [:bhearsum] from comment #9) > Actively running jobs. Typo there, it's spelled "ruining" with an i and only one n.
Comment 11•12 years ago
|
||
OK, I pulled it out again. Let's get it into recovery and see if that helps.
Comment 12•12 years ago
|
||
(In reply to Ben Hearsum [:bhearsum] from comment #11) > OK, I pulled it out again. Let's get it into recovery and see if that helps. I'm 95% sure I'll regret this, but now that it's back from recovery I started it again and it's back in the production pool.
Status: REOPENED → RESOLVED
Closed: 12 years ago → 12 years ago
Resolution: --- → FIXED
Reporter | ||
Updated•12 years ago
|
No longer blocks: 438871
Whiteboard: [buildduty][capacity][orange] → [buildduty][capacity]
Updated•12 years ago
|
Comment 15•11 years ago
|
||
back to life
Status: REOPENED → RESOLVED
Closed: 12 years ago → 11 years ago
Resolution: --- → FIXED
Comment 16•11 years ago
|
||
...but needs cpr again, please reimage.
Comment 17•11 years ago
|
||
Tegra-159 reimaged --- tegra-159.build.mtv1.mozilla.com ping statistics --- 3 packets transmitted, 3 packets received, 0.0% packet loss
Status: REOPENED → RESOLVED
Closed: 11 years ago → 11 years ago
Resolution: --- → FIXED
Updated•11 years ago
|
Comment 18•11 years ago
|
||
Rebooted but still cannot connect.
Comment 19•11 years ago
|
||
Back in production running jobs.
Status: REOPENED → RESOLVED
Closed: 11 years ago → 11 years ago
Resolution: --- → FIXED
Updated•11 years ago
|
Assignee | ||
Updated•11 years ago
|
Product: mozilla.org → Release Engineering
Comment 20•10 years ago
|
||
agent check failing, pdu reboot didn't help
Comment 21•10 years ago
|
||
SD card is wiped. flashed and reimaged.
Comment 22•10 years ago
|
||
jobs are green
Status: REOPENED → RESOLVED
Closed: 11 years ago → 10 years ago
Resolution: --- → FIXED
Updated•6 years ago
|
Product: Release Engineering → Infrastructure & Operations
Updated•4 years ago
|
Product: Infrastructure & Operations → Infrastructure & Operations Graveyard
You need to log in
before you can comment on or make changes to this bug.
Description
•