848564 - stone-ridge-panda-02 went awol

Status: VERIFIED FIXED

(Infrastructure & Operations :: DCOps, task)

Description

[Dustin J. Mitchell [:dustin] (he/him)]

I'm not seeing anything - not even a live boot - from this panda.  Can you examine it for hardware flaws, and if you see nothing, replace the sdcard?

Thanks!

Comment 1

[Dustin J. Mitchell [:dustin] (he/him)]

2013-03-06T14:43:28 bmm clearing PXE config
2013-03-06T14:44:30 syslog getting B2G_URL from http://10.22.92.127/api/device/stone-ridge-panda-06/bootconfig/
2013-03-06T14:44:30 syslog Submitting lifeguard event at http://10.22.92.127/api/device/stone-ridge-panda-06/event/b2g_downloading/
2013-03-06T14:44:30 syslog beginning b2g-second-stage.sh
2013-03-06T14:44:30 syslog Executing second-stage.sh
2013-03-06T14:44:30 syslog wget success: --2013-03-06 14:44:30-- http://10.22.92.127/scripts/b2g-second-stage.sh#012Connecting to 10.22.92.127:80... connected.#012HTTP request sent, awaiting response... 200 OK#012Length: 3124 (3.1K) [application/x-sh]#012Saving to: `/opt/scripts/second-stage.sh'#012#012 0K ... 100% 5819G=0s#012#0122013-03-06 14:44:30 (5819 GB/s) - `/opt/scripts/second-stage.sh' saved [3124/3124]
2013-03-06T14:44:30 syslog Submitting lifeguard event at http://10.22.92.127/api/device/stone-ridge-panda-06/event/mobile_init_started/
2013-03-06T14:44:30 syslog syslog/imaging server IP found: 10.22.92.127
2013-03-06T14:44:30 syslog second stage URL found: http://10.22.92.127/scripts/b2g-second-stage.sh
2013-03-06T14:44:30 syslog Reading boot args.
2013-03-06T14:44:30 syslog mobile-init.sh starting.
2013-03-06T14:44:33 syslog fetching http://pvtbuilds.pvt.build.mozilla.org/pub/mozilla.org/b2g/tinderbox-builds/mozilla-inbound-panda/20130306135513/system.tar.bz2
2013-03-06T14:44:33 syslog B2G URL: http://pvtbuilds.pvt.build.mozilla.org/pub/mozilla.org/b2g/tinderbox-builds/mozilla-inbound-panda/20130306135513

And looking in the DB, the above order is the reverse of the id order:

mysql> select id, left(message, 50) from device_logs where source='syslog' and device_id=19 order by id;
+-------+----------------------------------------------------+
| id    | left(message, 50)                                  |
+-------+----------------------------------------------------+
| 12539 | mobile-init.sh starting.                           |
| 12541 | Reading boot args.                                 |
| 12543 | second stage URL found: http://10.22.92.127/script |
| 12545 | syslog/imaging server IP found: 10.22.92.127       |
| 12547 | Submitting lifeguard event at http://10.22.92.127/ |
| 12553 | wget success: --2013-03-06 14:40:10--  http://10.2 |
| 12555 | Executing second-stage.sh                          |
| 12557 | beginning b2g-second-stage.sh                      |
| 12559 | Submitting lifeguard event at http://10.22.92.127/ |
| 12565 | getting B2G_URL from http://10.22.92.127/api/devic |
| 12567 | B2G URL: http://pvtbuilds.pvt.build.mozilla.org/pu |
| 12569 | fetching http://pvtbuilds.pvt.build.mozilla.org/pu |
| 12603 | mobile-init.sh starting.                           |
| 12605 | Reading boot args.                                 |
| 12607 | second stage URL found: http://10.22.92.127/script |
| 12609 | syslog/imaging server IP found: 10.22.92.127       |
| 12611 | Submitting lifeguard event at http://10.22.92.127/ |
| 12617 | wget success: --2013-03-06 14:44:30--  http://10.2 |
| 12619 | Executing second-stage.sh                          |
| 12621 | beginning b2g-second-stage.sh                      |
| 12623 | Submitting lifeguard event at http://10.22.92.127/ |
| 12629 | getting B2G_URL from http://10.22.92.127/api/devic |
| 12631 | B2G URL: http://pvtbuilds.pvt.build.mozilla.org/pu |
| 12633 | fetching http://pvtbuilds.pvt.build.mozilla.org/pu |
+-------+----------------------------------------------------+
24 rows in set (0.00 sec)

Comment 2

[Dustin J. Mitchell [:dustin] (he/him)]

er, comment 1 was for another bug, sorry

Comment 3

[Van Le [:van]]

dustin, how does this panda look now?

[[e-mail]3 ~]$ fping stone-ridge-panda-02.sec.scl3.mozilla.com
stone-ridge-panda-02.sec.scl3.mozilla.com is alive

Comment 4

[Gary Kwong [:gkw] [:nth10sd] (NOT official MoCo now)]

This looks good now. What happened?

Comment 5

[Dustin J. Mitchell [:dustin] (he/him)]

18:39 < van> sal said he gave it a kick 

No less than it deserved..