Closed Bug 704159 Opened 13 years ago Closed 13 years ago

Slaves requiring manual reboot (most likely)

Categories

(Release Engineering :: General, defect, P2)

Product:
Release Engineering
Component:
General
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED INCOMPLETE

People

(Reporter: armenzg, Assigned: coop)

Details

(Whiteboard: [buildduty][buildslaves])

These are slaves that will most likely require manual reboot or be added to the reboots-scl1 bug. This list was created by: 1) load up http://build.mozilla.org/builds/last-job-per-slave.html#test 2) Copy/paste the list of slaves that have not taken jobs for more than 2 days 3) Remove the tegras and slaves that had not slavealloc note * I used to ignore r4 slaves but jhford tells me we're ready for them talos-r4-snow-007 20 days, 8:35:27 talos-r4-snow-003 19 days, 16:10:38 talos-r4-snow-045 19 days, 7:37:32 talos-r4-snow-012 11 days, 17:59:55 talos-r4-snow-025 11 days, 17:37:15 talos-r4-snow-020 9 days, 2:28:28 talos-r4-snow-039 7 days, 0:10:38 talos-r4-snow-046 6 days, 1:23:04 talos-r4-lion-058 4 days, 18:36:08 talos-r3-w7-052 4 days, 10:30:03 talos-r4-snow-042 4 days, 6:53:21 talos-r4-snow-058 3 days, 21:35:57 talos-r3-fed-057 3 days, 0:53:47
Assignee: nobody → bhearsum
Here's the updated list (as of 2011-11-29 13:00:06): NOTE: This time I've also included the tegras talos-r4-snow-045 27 days, 12:37:270 talos-r4-snow-012 19 days, 22:59:500 talos-r4-snow-025 19 days, 22:37:101 tegra-033 17 days, 20:27:43 talos-r4-snow-020 17 days, 7:28:23 talos-r4-snow-039 15 days, 5:10:33 tegra-043 15 days, 2:00:21 talos-r4-snow-046 14 days, 6:22:59 0 tegra-077 14 days, 2:59:09 tegra-047 13 days, 23:54:40 tegra-044 13 days, 15:36:35 tegra-048 12 days, 21:01:41 tegra-039 12 days, 20:54:55 tegra-146 12 days, 20:23:24 talos-r3-w7-052 12 days, 15:29:58 talos-r4-snow-021 12 days, 7:58:43 tegra-070 12 days, 7:19:58 tegra-072 12 days, 7:15:35 tegra-066 12 days, 6:50:54 tegra-068 12 days, 7:00:38 tegra-155 12 days, 2:44:58 talos-r4-snow-058 12 days, 2:35:52 talos-r4-snow-030 11 days, 6:43:08 talos-r3-fed-057 11 days, 5:53:42 talos-r4-snow-032 10 days, 19:31:150 talos-r4-snow-054 10 days, 18:29:270 talos-r3-leopard-019 10 days, 9:07:40 talos-r4-snow-015 10 days, 8:26:25 talos-r4-snow-017 9 days, 7:09:50 talos-r4-snow-029 8 days, 12:20:10 talos-r4-snow-018 8 days, 5:05:10 talos-r4-snow-040 7 days, 23:43:04 tegra-065 7 days, 18:57:40 talos-r3-leopard-023 7 days, 12:10:24 talos-r4-lion-016 7 days, 6:42:32 tegra-113 7 days, 4:44:13 tegra-138 6 days, 19:19:43 tegra-085 6 days, 17:30:00 tegra-100 5 days, 22:31:11 tegra-086 5 days, 21:32:21 tegra-154 5 days, 21:28:18 tegra-115 5 days, 6:23:43 talos-r3-fed64-024 5 days, 4:45:09 tegra-109 4 days, 19:10:57 tegra-153 4 days, 16:15:04 talos-r3-leopard-045 4 days, 3:04:23 talos-r4-lion-037 3 days, 15:16:58 talos-r4-lion-074 3 days, 5:27:22 talos-r4-lion-039 2 days, 23:36:52 talos-r4-lion-017 1 day, 14:51:33 talos-r3-fed-038 1 day, 9:48:54 talos-r4-snow-013 1 day, 3:44:20
it's a minor nit... but can you sort them by hostname? I'll start looking at the tegras
I've filed bug 706289 to research this new tegra failure mode
Didn't get to this last week, back to the pool with 'ye.
Assignee: bhearsum → nobody
(In reply to Armen Zambrano G. [:armenzg] - Release Engineer from comment #0) > These are slaves that will most likely require manual reboot or be added to > the reboots-scl1 bug. Why create this bug then? Please add the slaves directly to the reboot bugs. If you need to maintain a list, please do so in an etherpad or somesuch. Especially when the bugs aren't tagged or prioritized, they clog up the triage tubes.
OS: Mac OS X → All
Priority: -- → P3
Hardware: x86 → All
Whiteboard: [buildduty][buildslaves]
This is me trying to help buildduty the problem that we have slaves that get hung and that require releng's-ssh&reboot-love and *not* IT's-visit2colo-to-reboot. These slaves are not necessarily PING down (we could have 1 or 2 out of it) but they have not taken jobs for days. Our wait times deteriorate because these slaves are not been taken care of. Up until now I have been going and taking care of hung slaves as I know how important they are for healthy wait times but filing this type of bugs is to help others start remembering that this is a task of buildduty and not of Armen/Nick AFAIK. Notice that some of these slaves could have an issue that IT would be needed but not necessarily. talos-r3-fed-038 4 days, 1:48:57 talos-r3-fed-057 13 days, 21:53:45 talos-r3-fed64-004 1 day, 14:03:12 talos-r3-fed64-024 7 days, 20:45:12 talos-r3-leopard-019 13 days, 1:07:43 talos-r3-leopard-023 10 days, 4:10:27 talos-r3-leopard-045 6 days, 19:04:26 talos-r3-w7-011 1 day, 13:14:54 talos-r3-xp-016 1 day, 17:58:40 talos-r4-lion-009 2 days, 14:46:44 talos-r4-lion-011 1 day, 10:46:57 talos-r4-lion-033 3 days, 12:32:58 talos-r4-lion-037 1 day, 10:36:39 talos-r4-lion-039 5 days, 15:36:55 talos-r4-lion-040 1 day, 1:04:27 talos-r4-lion-043 1 day, 10:32:28 talos-r4-lion-074 5 days, 21:27:25 talos-r4-snow-006 2 days, 9:55:53 talos-r4-snow-007 2 days, 12:53:30 talos-r4-snow-012 22 days, 14:59:53 talos-r4-snow-013 3 days, 19:44:23 talos-r4-snow-015 13 days, 0:26:28 talos-r4-snow-017 11 days, 23:09:53 talos-r4-snow-020 19 days, 23:28:26 talos-r4-snow-025 22 days, 14:37:13 talos-r4-snow-032 13 days, 11:31:18 talos-r4-snow-039 17 days, 21:10:36 talos-r4-snow-045 30 days, 4:37:30 talos-r4-snow-046 16 days, 22:23:02 talos-r4-snow-058 14 days, 18:35:55 talos-r4-snow-063 2 days, 9:45:40 talos-r4-snow-068 2 days, 18:48:58 talos-r4-snow-074 22 days, 12:40:28 talos-r4-snow-079 2 days, 8:02:28 tegra-033 20 days, 12:27:46 tegra-036 2 days, 10:57:08 tegra-038 1 day, 16:38:32 tegra-039 15 days, 12:54:58 tegra-043 17 days, 18:00:24 tegra-044 16 days, 7:36:38 tegra-047 16 days, 15:54:43 tegra-048 15 days, 13:01:44 tegra-065 10 days, 10:57:43 tegra-066 14 days, 22:50:57 tegra-067 2 days, 16:14:26 tegra-068 14 days, 23:00:41 tegra-070 14 days, 23:20:01 tegra-072 14 days, 23:15:38 tegra-077 16 days, 18:59:12 tegra-085 9 days, 9:30:03 tegra-086 8 days, 13:32:24 tegra-087 1 day, 15:39:24 tegra-106 2 days, 11:16:17 tegra-138 9 days, 11:19:46 tegra-146 15 days, 12:23:27 tegra-148 2 days, 9:55:20 tegra-153 7 days, 8:15:07 tegra-156 2 days, 13:24:30 tegra-175 2 days, 10:01:00
(In reply to Armen Zambrano G. [:armenzg] - Release Engineer from comment #6) > This is me trying to help buildduty the problem that we have slaves that get > hung and that require releng's-ssh&reboot-love and *not* > IT's-visit2colo-to-reboot. OK, perhaps the bug just needs a better summary to indicate that then, although I notice that comment #0 also talks about adding the slaves to reboots-scl1. FWIW, if we have a way to detect that these slaves haven't taken a job in a while, and a method to reboot them over ssh, I smell automation in our future for this.
This is the updated list for this week. This machines either need to: 1) ssh'ed into and reboot it (this can be done by releng) 2) it might be PING down 3) it might need a note to point to a bug 4) the machine had long been DNRed Assigning to jhford as this week's buildduty. Please pass this to the next buildduty at the end of your week with the updated list. Here's the command I run: wget -O- http://build.mozilla.org/builds/last-job-per-slave.txt | grep day | sed 's/[bB]ug.*$//' | sed 's/201.*$//' | sort > slaves.log bm-xserve12 2 days, 2:59:35 bm07-build1 bm-xserve12 2 days, 2:59:35 bm07-build1 bm-xserve17 1 day, 9:19:09 bm07-build1 bm-xserve17 1 day, 9:19:09 bm07-build1 bm-xserve22 1 day, 23:03:28 bm07-build1 bm-xserve22 1 day, 23:03:28 bm07-build1 linux64-ix-slave14 116 days, 23:17:27 bm05-builder linux64-ix-slave16 89 days, 1:37:04 bm12-build1 linux64-ix-slave22 3 days, 15:55:26 bm14-try1 linux64-ix-slave24 2 days, 15:54:30 bm14-try1 linux64-ix-slave25 4 days, 15:57:45 bm14-try1 linux64-ix-slave26 4 days, 10:52:36 bm14-try1 linux64-ix-slave29 4 days, 15:49:01 bm14-try1 linux64-ix-slave34 1 day, 0:17:47 bm14-try1 linux64-ix-slave35 1 day, 0:19:04 bm14-try1 linux64-ix-slave38 4 days, 15:51:09 bm14-try1 linux64-ix-slave39 1 day, 0:23:50 bm14-try1 linux64-ix-slave40 3 days, 15:48:25 bm14-try1 linux-ix-slave25 6 days, 20:58:28 bm13-build1 linux-ix-slave25 6 days, 20:58:28 bm13-build1 linux-ix-slave25 6 days, 20:58:28 bm13-build1 linux-ix-slave25 6 days, 20:58:28 bm13-build1 linux-ix-slave25 6 days, 20:58:28 bm13-build1 linux-ix-slave29 6 days, 22:48:04 bm12-build1 linux-ix-slave29 6 days, 22:48:04 bm12-build1 linux-ix-slave29 6 days, 22:48:04 bm12-build1 linux-ix-slave29 6 days, 22:48:04 bm12-build1 linux-ix-slave29 6 days, 22:48:04 bm12-build1 linux-ix-slave33 6 days, 19:03:50 bm13-build1 linux-ix-slave33 6 days, 19:03:50 bm13-build1 linux-ix-slave33 6 days, 19:03:50 bm13-build1 linux-ix-slave33 6 days, 19:03:50 bm13-build1 linux-ix-slave33 6 days, 19:03:50 bm13-build1 linux-ix-slave37 6 days, 21:54:15 bm12-build1 linux-ix-slave37 6 days, 21:54:15 bm12-build1 linux-ix-slave37 6 days, 21:54:15 bm12-build1 linux-ix-slave37 6 days, 21:54:15 bm12-build1 linux-ix-slave37 6 days, 21:54:15 bm12-build1 linux-ix-slave41 6 days, 22:03:28 bm12-build1 linux-ix-slave41 6 days, 22:03:28 bm12-build1 linux-ix-slave41 6 days, 22:03:28 bm12-build1 linux-ix-slave41 6 days, 22:03:28 bm12-build1 linux-ix-slave41 6 days, 22:03:28 bm12-build1 moz2-darwin10-slave14 2 days, 16:03:09 bm09-try1 moz2-darwin9-slave02 3 days, 21:27:54 bm08-build1 moz2-darwin9-slave02 3 days, 21:27:54 bm08-build1 moz2-darwin9-slave12 3 days, 6:39:34 bm08-build1 moz2-darwin9-slave12 3 days, 6:39:34 bm08-build1 moz2-darwin9-slave15 3 days, 23:25:22 bm08-build1 moz2-darwin9-slave15 3 days, 23:25:22 bm08-build1 moz2-darwin9-slave19 2 days, 4:19:50 bm08-build1 moz2-darwin9-slave19 2 days, 4:19:50 bm08-build1 moz2-darwin9-slave22 3 days, 23:04:35 bm08-build1 moz2-darwin9-slave22 3 days, 23:04:35 bm08-build1 moz2-darwin9-slave23 4 days, 1:10:18 bm08-build1 moz2-darwin9-slave23 4 days, 1:10:18 bm08-build1 moz2-darwin9-slave38 2 days, 20:47:05 bm07-build1 moz2-darwin9-slave38 2 days, 20:47:05 bm07-build1 moz2-darwin9-slave41 2 days, 4:24:39 bm08-build1 moz2-darwin9-slave41 2 days, 4:24:39 bm08-build1 moz2-darwin9-slave43 3 days, 23:24:32 bm08-build1 moz2-darwin9-slave43 3 days, 23:24:32 bm08-build1 moz2-darwin9-slave47 4 days, 1:10:12 bm08-build1 moz2-darwin9-slave47 4 days, 1:10:12 bm08-build1 moz2-darwin9-slave48 3 days, 21:08:50 bm08-build1 moz2-darwin9-slave48 3 days, 21:08:50 bm08-build1 moz2-darwin9-slave49 2 days, 4:32:02 bm08-build1 moz2-darwin9-slave49 2 days, 4:32:02 bm08-build1 moz2-darwin9-slave52 3 days, 17:26:36 bm07-build1 moz2-darwin9-slave52 3 days, 17:26:36 bm07-build1 moz2-darwin9-slave53 4 days, 1:11:49 bm08-build1 moz2-darwin9-slave53 4 days, 1:11:49 bm08-build1 moz2-darwin9-slave54 3 days, 17:42:54 bm07-build1 moz2-darwin9-slave54 3 days, 17:42:54 bm07-build1 moz2-linux64-slave09 5 days, 9:06:57 bm07-build1 moz2-linux-slave22 3 days, 16:38:26 bm08-build1 moz2-linux-slave22 3 days, 16:38:26 bm08-build1 moz2-linux-slave22 3 days, 16:38:26 bm08-build1 moz2-linux-slave22 3 days, 16:38:26 bm08-build1 moz2-linux-slave22 3 days, 16:38:26 bm08-build1 moz2-linux-slave24 3 days, 2:24:15 bm08-build1 moz2-linux-slave24 3 days, 2:24:15 bm08-build1 moz2-linux-slave24 3 days, 2:24:15 bm08-build1 moz2-linux-slave24 3 days, 2:24:15 bm08-build1 moz2-linux-slave24 3 days, 2:24:15 bm08-build1 moz2-linux-slave31 2 days, 20:01:22 bm07-build1 moz2-linux-slave31 2 days, 20:01:22 bm07-build1 moz2-linux-slave31 2 days, 20:01:22 bm07-build1 moz2-linux-slave31 2 days, 20:01:22 bm07-build1 moz2-linux-slave31 2 days, 20:01:22 bm07-build1 moz2-linux-slave41 1 day, 9:12:11 bm07-build1 moz2-linux-slave41 1 day, 9:12:11 bm07-build1 moz2-linux-slave41 1 day, 9:12:11 bm07-build1 moz2-linux-slave41 1 day, 9:12:11 bm07-build1 moz2-linux-slave41 1 day, 9:12:11 bm07-build1 moz2-linux-slave45 2 days, 19:02:25 bm07-build1 moz2-linux-slave45 2 days, 19:02:25 bm07-build1 moz2-linux-slave45 2 days, 19:02:25 bm07-build1 moz2-linux-slave45 2 days, 19:02:25 bm07-build1 moz2-linux-slave45 2 days, 19:02:25 bm07-build1 moz2-linux-slave47 3 days, 8:42:02 bm09-try1 moz2-linux-slave49 3 days, 8:47:17 bm09-try1 mw32-ix-slave02 55 days, 3:06:41 bm07-build1 mw32-ix-slave02 55 days, 3:06:41 bm07-build1 mw32-ix-slave08 13 days, 6:04:28 bm08-build1 mw32-ix-slave08 13 days, 6:04:28 bm08-build1 mw32-ix-slave17 3 days, 16:22:13 bm09-try1 talos-r3-fed-009 4 days, 1:08:22 bm17-tests1-linux talos-r3-fed-014 4 days, 1:07:11 bm17-tests1-linux talos-r3-fed-038 7 days, 9:49:00 bm18-tests1-linux talos-r3-fed-057 17 days, 5:53:48 bm18-tests1-linux talos-r3-fed64-004 4 days, 22:03:15 bm17-tests1-linux talos-r3-fed64-005 61 days, 17:01:51 bm04-tests1-macosx talos-r3-fed64-024 11 days, 4:45:15 bm18-tests1-linux talos-r3-fed64-027 19 days, 17:21:45 bm18-tests1-linux talos-r3-fed64-034 33 days, 19:08:47 bm17-tests1-linux talos-r3-fed64-035 60 days, 0:03:17 bm04-tests1-macosx talos-r3-fed64-041 6 days, 7:33:32 bm18-tests1-linux talos-r3-fed64-049 4 days, 1:07:00 bm17-tests1-linux talos-r3-fed64-056 18 days, 16:24:50 bm18-tests1-linux talos-r3-leopard-007 212 days, 5:07:58 Tests Master 03 talos-r3-leopard-007 212 days, 5:07:58 Tests Master 03 talos-r3-leopard-019 16 days, 9:07:46 bm11-tests1-macosx talos-r3-leopard-019 16 days, 9:07:46 bm11-tests1-macosx talos-r3-leopard-023 13 days, 12:10:30 bm06-tests1-macosx talos-r3-leopard-023 13 days, 12:10:30 bm06-tests1-macosx talos-r3-leopard-033 55 days, 21:09:03 bm04-tests1-macosx talos-r3-leopard-033 55 days, 21:09:03 bm04-tests1-macosx talos-r3-leopard-045 10 days, 3:04:29 bm06-tests1-macosx talos-r3-leopard-045 10 days, 3:04:29 bm06-tests1-macosx talos-r3-leopard-058 7 days, 10:33:34 bm06-tests1-macosx talos-r3-leopard-058 7 days, 10:33:34 bm06-tests1-macosx talos-r3-w7-011 4 days, 21:14:57 bm15-tests1-windows talos-r3-w7-024 45 days, 0:02:51 bm15-tests1-windows talos-r3-w7-036 89 days, 10:50:48 bm16-tests1-windows talos-r3-w7-053 17 days, 1:34:36 bm15-tests1-windows talos-r3-xp-012 2 days, 20:21:51 bm15-tests1-windows talos-r3-xp-013 2 days, 20:18:33 bm16-tests1-windows talos-r3-xp-016 5 days, 1:58:43 bm15-tests1-windows talos-r3-xp-019 2 days, 20:21:39 bm15-tests1-windows talos-r3-xp-020 5 days, 20:01:34 bm15-tests1-windows talos-r3-xp-022 3 days, 22:05:35 bm15-tests1-windows talos-r3-xp-025 2 days, 20:20:55 bm15-tests1-windows talos-r3-xp-028 1 day, 22:46:02 bm16-tests1-windows talos-r3-xp-031 2 days, 20:18:49 bm16-tests1-windows talos-r3-xp-036 12 days, 21:46:58 bm16-tests1-windows talos-r3-xp-039 2 days, 20:18:33 bm15-tests1-windows talos-r3-xp-042 2 days, 20:21:10 bm15-tests1-windows talos-r3-xp-043 2 days, 20:19:56 bm15-tests1-windows talos-r3-xp-044 2 days, 19:09:17 bm16-tests1-windows talos-r3-xp-045 189 days, 0:20:41 Tests Master 03 talos-r4-lion-009 2 days, 12:22:15 bm06-tests1-macosx talos-r4-lion-011 4 days, 18:47:00 bm06-tests1-macosx talos-r4-lion-013 2 days, 23:44:49 bm04-tests1-macosx talos-r4-lion-016 13 days, 6:42:38 bm04-tests1-macosx talos-r4-lion-017 3 days, 17:05:11 bm06-tests1-macosx talos-r4-lion-018 2 days, 20:17:42 bm06-tests1-macosx talos-r4-lion-031 27 days, 11:14:43 bm04-tests1-macosx talos-r4-lion-039 1 day, 20:04:28 bm06-tests1-macosx talos-r4-lion-040 4 days, 9:04:30 bm04-tests1-macosx talos-r4-lion-047 1 day, 23:34:25 bm04-tests1-macosx talos-r4-lion-050 3 days, 18:08:16 bm04-tests1-macosx talos-r4-lion-057 3 days, 6:47:19 bm06-tests1-macosx talos-r4-lion-069 5 days, 4:54:10 bm04-tests1-macosx talos-r4-lion-074 2 days, 19:41:22 bm11-tests1-macosx talos-r4-lion-075 2 days, 2:35:37 bm04-tests1-macosx talos-r4-snow-003 33 days, 21:10:39 bm11-tests1-macosx talos-r4-snow-004 3 days, 9:02:23 bm04-tests1-macosx talos-r4-snow-005 8 days, 16:07:59 bm11-tests1-macosx talos-r4-snow-006 1 day, 22:59:19 bm04-tests1-macosx talos-r4-snow-009 3 days, 18:41:40 bm06-tests1-macosx talos-r4-snow-012 25 days, 22:59:56 bm11-tests1-macosx talos-r4-snow-013 7 days, 3:44:26 bm06-tests1-macosx talos-r4-snow-015 16 days, 8:26:31 bm11-tests1-macosx talos-r4-snow-016 2 days, 9:16:18 bm04-tests1-macosx talos-r4-snow-017 15 days, 7:09:56 bm04-tests1-macosx talos-r4-snow-019 6 days, 23:29:03 bm11-tests1-macosx talos-r4-snow-020 23 days, 7:28:29 bm11-tests1-macosx talos-r4-snow-021 18 days, 7:58:49 bm06-tests1-macosx talos-r4-snow-025 25 days, 22:37:16 bm11-tests1-macosx talos-r4-snow-030 17 days, 6:43:14 bm04-tests1-macosx talos-r4-snow-031 18 days, 18:15:25 bm06-tests1-macosx talos-r4-snow-032 16 days, 19:31:21 bm04-tests1-macosx talos-r4-snow-039 21 days, 5:10:39 bm11-tests1-macosx talos-r4-snow-040 13 days, 23:43:10 bm11-tests1-macosx talos-r4-snow-043 2 days, 1:46:18 bm11-tests1-macosx talos-r4-snow-045 33 days, 12:37:33 bm06-tests1-macosx talos-r4-snow-046 20 days, 6:23:05 bm04-tests1-macosx talos-r4-snow-050 1 day, 2:30:08 bm06-tests1-macosx talos-r4-snow-053 6 days, 6:28:38 bm04-tests1-macosx talos-r4-snow-054 16 days, 18:29:33 bm04-tests1-macosx talos-r4-snow-058 18 days, 2:35:58 bm04-tests1-macosx talos-r4-snow-063 5 days, 17:45:43 bm04-tests1-macosx talos-r4-snow-065 18 days, 6:51:28 bm06-tests1-macosx talos-r4-snow-068 6 days, 2:49:01 bm06-tests1-macosx talos-r4-snow-074 25 days, 20:40:31 bm06-tests1-macosx talos-r4-snow-079 5 days, 16:02:31 bm11-tests1-macosx tegra-033 23 days, 20:27:49 Test Master tegra-033 23 days, 20:27:49 Test Master tegra-033 23 days, 20:27:49 Test Master tegra-036 5 days, 18:57:11 Test Master tegra-036 5 days, 18:57:11 Test Master tegra-036 5 days, 18:57:11 Test Master tegra-038 5 days, 0:38:35 Test Master tegra-038 5 days, 0:38:35 Test Master tegra-038 5 days, 0:38:35 Test Master tegra-039 18 days, 20:55:01 Test Master tegra-039 18 days, 20:55:01 Test Master tegra-039 18 days, 20:55:01 Test Master tegra-043 21 days, 2:00:27 Test Master tegra-043 21 days, 2:00:27 Test Master tegra-043 21 days, 2:00:27 Test Master tegra-044 19 days, 15:36:41 Test Master tegra-044 19 days, 15:36:41 Test Master tegra-044 19 days, 15:36:41 Test Master tegra-047 19 days, 23:54:46 Test Master tegra-047 19 days, 23:54:46 Test Master tegra-047 19 days, 23:54:46 Test Master tegra-048 18 days, 21:01:47 Test Master tegra-048 18 days, 21:01:47 Test Master tegra-048 18 days, 21:01:47 Test Master tegra-065 13 days, 18:57:46 Test Master tegra-065 13 days, 18:57:46 Test Master tegra-065 13 days, 18:57:46 Test Master tegra-066 18 days, 6:51:00 Test Master tegra-066 18 days, 6:51:00 Test Master tegra-066 18 days, 6:51:00 Test Master tegra-067 6 days, 0:14:29 Test Master tegra-067 6 days, 0:14:29 Test Master tegra-067 6 days, 0:14:29 Test Master tegra-068 18 days, 7:00:44 Test Master tegra-068 18 days, 7:00:44 Test Master tegra-068 18 days, 7:00:44 Test Master tegra-070 18 days, 7:20:04 Test Master tegra-070 18 days, 7:20:04 Test Master tegra-070 18 days, 7:20:04 Test Master tegra-072 18 days, 7:15:41 Test Master tegra-072 18 days, 7:15:41 Test Master tegra-072 18 days, 7:15:41 Test Master tegra-077 20 days, 2:59:15 Test Master tegra-077 20 days, 2:59:15 Test Master tegra-077 20 days, 2:59:15 Test Master tegra-085 12 days, 17:30:06 Test Master tegra-085 12 days, 17:30:06 Test Master tegra-085 12 days, 17:30:06 Test Master tegra-086 11 days, 21:32:27 Test Master tegra-086 11 days, 21:32:27 Test Master tegra-086 11 days, 21:32:27 Test Master tegra-087 4 days, 23:39:27 Test Master tegra-087 4 days, 23:39:27 Test Master tegra-087 4 days, 23:39:27 Test Master tegra-106 5 days, 19:16:20 Test Master tegra-106 5 days, 19:16:20 Test Master tegra-106 5 days, 19:16:20 Test Master tegra-113 3 days, 17:43:39 Test Master tegra-113 3 days, 17:43:39 Test Master tegra-113 3 days, 17:43:39 Test Master tegra-129 3 days, 14:55:16 Test Master tegra-129 3 days, 14:55:16 Test Master tegra-129 3 days, 14:55:16 Test Master tegra-130 3 days, 14:27:10 Test Master tegra-130 3 days, 14:27:10 Test Master tegra-130 3 days, 14:27:10 Test Master tegra-132 1 day, 18:51:48 Test Master tegra-132 1 day, 18:51:48 Test Master tegra-132 1 day, 18:51:48 Test Master tegra-133 3 days, 14:20:11 Test Master tegra-133 3 days, 14:20:11 Test Master tegra-133 3 days, 14:20:11 Test Master tegra-134 1 day, 18:29:30 Test Master tegra-134 1 day, 18:29:30 Test Master tegra-134 1 day, 18:29:30 Test Master tegra-135 3 days, 15:03:18 Test Master tegra-135 3 days, 15:03:18 Test Master tegra-135 3 days, 15:03:18 Test Master tegra-136 3 days, 14:40:55 Test Master tegra-136 3 days, 14:40:55 Test Master tegra-136 3 days, 14:40:55 Test Master tegra-138 12 days, 19:19:49 Test Master tegra-138 12 days, 19:19:49 Test Master tegra-138 12 days, 19:19:49 Test Master tegra-139 1 day, 18:29:18 Test Master tegra-139 1 day, 18:29:18 Test Master tegra-139 1 day, 18:29:18 Test Master tegra-140 3 days, 15:01:56 Test Master tegra-140 3 days, 15:01:56 Test Master tegra-140 3 days, 15:01:56 Test Master tegra-141 3 days, 16:19:05 Test Master tegra-141 3 days, 16:19:05 Test Master tegra-141 3 days, 16:19:05 Test Master tegra-142 3 days, 13:38:57 Test Master tegra-142 3 days, 13:38:57 Test Master tegra-142 3 days, 13:38:57 Test Master tegra-144 1 day, 18:52:54 Test Master tegra-144 1 day, 18:52:54 Test Master tegra-144 1 day, 18:52:54 Test Master tegra-145 3 days, 13:44:53 Test Master tegra-145 3 days, 13:44:53 Test Master tegra-145 3 days, 13:44:53 Test Master tegra-146 18 days, 20:23:30 Test Master tegra-146 18 days, 20:23:30 Test Master tegra-146 18 days, 20:23:30 Test Master tegra-148 5 days, 17:55:23 Test Master tegra-148 5 days, 17:55:23 Test Master tegra-148 5 days, 17:55:23 Test Master tegra-153 10 days, 16:15:10 Test Master tegra-153 10 days, 16:15:10 Test Master tegra-153 10 days, 16:15:10 Test Master tegra-156 5 days, 21:24:33 Test Master tegra-156 5 days, 21:24:33 Test Master tegra-156 5 days, 21:24:33 Test Master tegra-175 5 days, 18:01:03 Test Master tegra-175 5 days, 18:01:03 Test Master tegra-175 5 days, 18:01:03 Test Master tegra-176 2 days, 12:48:12 Test Master tegra-176 2 days, 12:48:12 Test Master tegra-176 2 days, 12:48:12 Test Master t-r3-w764-002 5 days, 22:40:21 bm15-tests1-windows t-r3-w764-005 5 days, 22:42:00 bm15-tests1-windows try-linux64-slave01 2 days, 19:39:59 bm09-try1 try-linux64-slave02 2 days, 18:02:41 bm09-try1 try-linux64-slave03 2 days, 17:25:20 bm09-try1 try-linux64-slave04 2 days, 17:22:19 bm09-try1 try-linux64-slave05 2 days, 18:06:25 bm09-try1 try-linux64-slave06 2 days, 1:40:42 bm09-try1 try-linux64-slave08 2 days, 18:02:11 bm09-try1 try-linux64-slave09 2 days, 17:21:36 bm09-try1 try-linux-slave02 3 days, 8:32:22 bm09-try1 try-linux-slave06 3 days, 8:34:17 bm09-try1 try-linux-slave09 3 days, 8:40:18 bm09-try1 try-linux-slave16 3 days, 8:44:14 bm09-try1 try-linux-slave18 1 day, 0:18:41 bm09-try1 try-linux-slave23 1 day, 0:09:58 bm09-try1 try-linux-slave26 3 days, 7:54:30 bm09-try1 try-linux-slave27 3 days, 8:04:48 bm09-try1 try-linux-slave28 1 day, 0:44:08 bm09-try1 try-linux-slave29 3 days, 8:37:00 bm09-try1 try-linux-slave30 3 days, 8:28:50 bm09-try1 try-mac64-slave01 3 days, 0:58:34 bm09-try1 try-mac64-slave03 5 days, 1:22:33 bm09-try1 try-mac64-slave07 5 days, 22:23:10 bm09-try1 try-mac64-slave09 3 days, 15:31:57 bm09-try1 try-mac64-slave11 3 days, 1:04:11 bm09-try1 try-mac64-slave12 3 days, 15:01:17 bm09-try1 try-mac64-slave14 4 days, 13:02:49 bm09-try1 try-mac64-slave15 3 days, 14:59:35 bm09-try1 try-mac64-slave21 324 days, 15:23:26 Try Master try-mac64-slave25 2 days, 18:06:12 bm09-try1 try-mac64-slave26 2 days, 16:42:47 bm09-try1 try-mac-slave01 5 days, 22:04:09 bm09-try1 try-mac-slave02 3 days, 15:33:54 bm09-try1 try-mac-slave03 25 days, 1:54:21 bm09-try1 try-mac-slave04 18 days, 14:50:49 bm09-try1 try-mac-slave06 20 days, 16:05:36 bm09-try1 try-mac-slave07 3 days, 19:02:16 bm09-try1 try-mac-slave08 2 days, 23:39:55 bm09-try1 try-mac-slave09 3 days, 15:00:03 bm09-try1 try-mac-slave10 6 days, 12:16:37 bm09-try1 try-mac-slave12 18 days, 7:51:37 bm09-try1 try-mac-slave13 24 days, 19:24:40 bm09-try1 try-mac-slave14 26 days, 19:15:15 bm09-try1 try-mac-slave15 9 days, 20:09:32 bm09-try1 try-mac-slave17 6 days, 9:22:45 bm09-try1 try-mac-slave18 4 days, 13:25:13 bm09-try1 try-mac-slave30 25 days, 1:39:01 bm09-try1 try-mac-slave31 3 days, 16:32:31 bm09-try1 try-mac-slave32 27 days, 16:10:30 bm09-try1 try-mac-slave33 17 days, 17:07:54 bm09-try1 try-mac-slave34 5 days, 22:01:12 bm09-try1 try-mac-slave36 17 days, 18:19:18 bm09-try1 try-mac-slave37 26 days, 19:52:31 bm09-try1 try-mac-slave38 27 days, 17:00:32 bm09-try1 try-mac-slave40 6 days, 15:47:13 bm09-try1 try-mac-slave41 3 days, 0:19:49 bm09-try1 try-mac-slave43 24 days, 18:08:56 bm09-try1 try-mac-slave44 25 days, 1:40:07 bm09-try1 try-mac-slave45 5 days, 22:23:01 bm09-try1 try-mac-slave47 4 days, 17:54:35 bm09-try1 w32-ix-slave02 10 days, 23:53:11 bm14-try1 w32-ix-slave03 103 days, 9:49:10 bm05-trybuilder w32-ix-slave06 179 days, 1:05:56 bm03-trybuilder w32-ix-slave07 66 days, 16:31:19 bm14-try1 w32-ix-slave08 69 days, 1:36:10 bm14-try1 w32-ix-slave09 5 days, 20:02:14 bm03-trybuilder w32-ix-slave12 34 days, 14:58:55 bm03-trybuilder w32-ix-slave14 3 days, 15:58:46 bm03-trybuilder w32-ix-slave23 17 days, 23:34:59 bm14-try1 w32-ix-slave26 11 days, 5:31:31 bm13-build1 w32-ix-slave26 11 days, 5:31:31 bm13-build1 w32-ix-slave33 4 days, 3:58:03 bm13-build1 w32-ix-slave33 4 days, 3:58:03 bm13-build1 w32-ix-slave34 11 days, 5:30:00 bm12-build1 w32-ix-slave34 11 days, 5:30:00 bm12-build1 w32-ix-slave35 97 days, 22:38:41 bm05-builder w32-ix-slave35 97 days, 22:38:41 bm05-builder w32-ix-slave36 48 days, 16:44:02 bm12-build1 w32-ix-slave36 48 days, 16:44:02 bm12-build1 w32-ix-slave37 6 days, 18:06:55 bm12-build1 w32-ix-slave37 6 days, 18:06:55 bm12-build1 w32-ix-slave39 6 days, 14:11:09 bm12-build1 w32-ix-slave39 6 days, 14:11:09 bm12-build1 w64-ix-slave06 3 days, 20:58:38 bm12-build1 w64-ix-slave11 1 day, 23:59:45 bm12-build1 w64-ix-slave19 2 days, 9:30:23 bm12-build1 w64-ix-slave20 88 days, 23:39:00 bm12-build1 w64-ix-slave21 89 days, 22:25:56 bm13-build1 w64-ix-slave22 102 days, 5:10:22 bm13-build1 w64-ix-slave23 89 days, 18:51:36 bm12-build1 w64-ix-slave24 104 days, 4:45:04 bm12-build1 w64-ix-slave25 90 days, 1:01:00 bm14-try1 w64-ix-slave26 90 days, 1:02:11 bm14-try1 w64-ix-slave27 90 days, 0:57:51 bm05-trybuilder w64-ix-slave28 90 days, 0:59:14 bm14-try1 w64-ix-slave30 90 days, 0:56:16 bm05-trybuilder w64-ix-slave37 1 day, 0:17:12 bm14-try1 w64-ix-slave40 2 days, 17:34:43 bm14-try1
Assignee: nobody → jhford
Priority: P3 → --
Passing to next buildduty. This is the updated list of slaves that have not taken a job for more than a day. Refer to comment 8 for instructions or feel free to ask me. bm-xserve07 1 day, 3:26:50 bm07-build1 bm-xserve07 1 day, 3:26:50 bm07-build1 bm-xserve09 2 days, 12:56:55 bm07-build1 bm-xserve09 2 days, 12:56:55 bm07-build1 bm-xserve12 2 days, 18:36:24 bm07-build1 bm-xserve12 2 days, 18:36:24 bm07-build1 bm-xserve16 1 day, 4:05:19 bm08-build1 bm-xserve16 1 day, 4:05:19 bm08-build1 bm-xserve20 1 day, 23:22:47 bm09-try1 linux64-ix-slave14 123 days, 20:17:28 bm05-builder linux64-ix-slave16 95 days, 22:37:05 bm12-build1 linux64-ix-slave22 6 days, 14:07:01 bm14-try1 linux64-ix-slave23 5 days, 20:11:31 bm14-try1 linux64-ix-slave25 4 days, 15:55:14 bm14-try1 linux64-ix-slave26 6 days, 14:23:41 bm14-try1 linux64-ix-slave27 6 days, 14:21:32 bm14-try1 linux64-ix-slave28 5 days, 19:52:47 bm14-try1 linux64-ix-slave29 5 days, 19:49:55 bm14-try1 linux64-ix-slave30 6 days, 14:14:30 bm14-try1 linux64-ix-slave31 6 days, 14:08:29 bm14-try1 linux64-ix-slave32 3 days, 13:18:50 bm14-try1 linux64-ix-slave33 2 days, 0:18:44 bm14-try1 linux64-ix-slave34 6 days, 14:08:48 bm14-try1 linux64-ix-slave36 6 days, 14:01:59 bm14-try1 linux64-ix-slave39 2 days, 0:07:33 bm14-try1 linux64-ix-slave40 5 days, 19:42:42 bm14-try1 linux-ix-slave23 1 day, 4:34:01 bm12-build1 linux-ix-slave23 1 day, 4:34:01 bm12-build1 linux-ix-slave23 1 day, 4:34:01 bm12-build1 linux-ix-slave23 1 day, 4:34:01 bm12-build1 linux-ix-slave23 1 day, 4:34:01 bm12-build1 linux-ix-slave25 2 days, 19:20:10 bm12-build1 linux-ix-slave25 2 days, 19:20:10 bm12-build1 linux-ix-slave25 2 days, 19:20:10 bm12-build1 linux-ix-slave25 2 days, 19:20:10 bm12-build1 linux-ix-slave25 2 days, 19:20:10 bm12-build1 linux-ix-slave29 13 days, 19:48:05 bm12-build1 linux-ix-slave29 13 days, 19:48:05 bm12-build1 linux-ix-slave29 13 days, 19:48:05 bm12-build1 linux-ix-slave29 13 days, 19:48:05 bm12-build1 linux-ix-slave29 13 days, 19:48:05 bm12-build1 linux-ix-slave33 13 days, 16:03:51 bm13-build1 linux-ix-slave33 13 days, 16:03:51 bm13-build1 linux-ix-slave33 13 days, 16:03:51 bm13-build1 linux-ix-slave33 13 days, 16:03:51 bm13-build1 linux-ix-slave33 13 days, 16:03:51 bm13-build1 linux-ix-slave37 13 days, 18:54:16 bm12-build1 linux-ix-slave37 13 days, 18:54:16 bm12-build1 linux-ix-slave37 13 days, 18:54:16 bm12-build1 linux-ix-slave37 13 days, 18:54:16 bm12-build1 linux-ix-slave37 13 days, 18:54:16 bm12-build1 linux-ix-slave38 1 day, 5:16:28 bm12-build1 linux-ix-slave38 1 day, 5:16:28 bm12-build1 linux-ix-slave38 1 day, 5:16:28 bm12-build1 linux-ix-slave38 1 day, 5:16:28 bm12-build1 linux-ix-slave38 1 day, 5:16:28 bm12-build1 linux-ix-slave40 1 day, 4:39:09 bm13-build1 linux-ix-slave40 1 day, 4:39:09 bm13-build1 linux-ix-slave40 1 day, 4:39:09 bm13-build1 linux-ix-slave40 1 day, 4:39:09 bm13-build1 linux-ix-slave40 1 day, 4:39:09 bm13-build1 linux-ix-slave41 13 days, 19:03:29 bm12-build1 linux-ix-slave41 13 days, 19:03:29 bm12-build1 linux-ix-slave41 13 days, 19:03:29 bm12-build1 linux-ix-slave41 13 days, 19:03:29 bm12-build1 linux-ix-slave41 13 days, 19:03:29 bm12-build1 linux-ix-slave42 1 day, 6:10:05 bm12-build1 linux-ix-slave42 1 day, 6:10:05 bm12-build1 linux-ix-slave42 1 day, 6:10:05 bm12-build1 linux-ix-slave42 1 day, 6:10:05 bm12-build1 linux-ix-slave42 1 day, 6:10:05 bm12-build1 moz2-darwin10-slave11 3 days, 8:17:34 bm09-try1 moz2-darwin10-slave12 3 days, 15:48:29 bm09-try1 moz2-darwin10-slave13 3 days, 20:41:27 bm09-try1 moz2-darwin10-slave14 4 days, 5:40:38 bm09-try1 moz2-darwin10-slave50 1 day, 0:04:31 bm07-build1 moz2-darwin9-slave02 3 days, 4:14:45 bm08-build1 moz2-darwin9-slave02 3 days, 4:14:45 bm08-build1 moz2-darwin9-slave11 3 days, 4:15:06 bm08-build1 moz2-darwin9-slave11 3 days, 4:15:06 bm08-build1 moz2-darwin9-slave15 3 days, 4:11:55 bm08-build1 moz2-darwin9-slave15 3 days, 4:11:55 bm08-build1 moz2-darwin9-slave17 3 days, 4:48:40 bm08-build1 moz2-darwin9-slave17 3 days, 4:48:40 bm08-build1 moz2-darwin9-slave18 3 days, 13:39:47 bm08-build1 moz2-darwin9-slave18 3 days, 13:39:47 bm08-build1 moz2-darwin9-slave19 3 days, 14:06:50 bm08-build1 moz2-darwin9-slave19 3 days, 14:06:50 bm08-build1 moz2-darwin9-slave21 1 day, 3:19:38 bm07-build1 moz2-darwin9-slave21 1 day, 3:19:38 bm07-build1 moz2-darwin9-slave22 3 days, 13:09:23 bm08-build1 moz2-darwin9-slave22 3 days, 13:09:23 bm08-build1 moz2-darwin9-slave23 3 days, 13:35:43 bm08-build1 moz2-darwin9-slave23 3 days, 13:35:43 bm08-build1 moz2-darwin9-slave25 3 days, 4:09:35 bm07-build1 moz2-darwin9-slave25 3 days, 4:09:35 bm07-build1 moz2-darwin9-slave38 2 days, 13:50:45 bm07-build1 moz2-darwin9-slave38 2 days, 13:50:45 bm07-build1 moz2-darwin9-slave39 3 days, 7:54:46 bm07-build1 moz2-darwin9-slave39 3 days, 7:54:46 bm07-build1 moz2-darwin9-slave41 3 days, 13:45:57 bm08-build1 moz2-darwin9-slave41 3 days, 13:45:57 bm08-build1 moz2-darwin9-slave42 2 days, 2:38:07 bm07-build1 moz2-darwin9-slave42 2 days, 2:38:07 bm07-build1 moz2-darwin9-slave43 3 days, 11:14:21 bm08-build1 moz2-darwin9-slave43 3 days, 11:14:21 bm08-build1 moz2-darwin9-slave44 2 days, 14:06:55 bm07-build1 moz2-darwin9-slave44 2 days, 14:06:55 bm07-build1 moz2-darwin9-slave45 3 days, 14:00:20 bm08-build1 moz2-darwin9-slave45 3 days, 14:00:20 bm08-build1 moz2-darwin9-slave46 2 days, 2:36:08 bm07-build1 moz2-darwin9-slave46 2 days, 2:36:08 bm07-build1 moz2-darwin9-slave48 3 days, 13:54:57 bm08-build1 moz2-darwin9-slave48 3 days, 13:54:57 bm08-build1 moz2-darwin9-slave49 3 days, 5:29:20 bm08-build1 moz2-darwin9-slave49 3 days, 5:29:20 bm08-build1 moz2-darwin9-slave50 2 days, 14:38:15 bm07-build1 moz2-darwin9-slave50 2 days, 14:38:15 bm07-build1 moz2-darwin9-slave51 2 days, 13:55:35 bm07-build1 moz2-darwin9-slave51 2 days, 13:55:35 bm07-build1 moz2-darwin9-slave53 3 days, 13:51:11 bm08-build1 moz2-darwin9-slave53 3 days, 13:51:11 bm08-build1 moz2-darwin9-slave54 2 days, 13:15:39 bm07-build1 moz2-darwin9-slave54 2 days, 13:15:39 bm07-build1 moz2-linux64-slave09 12 days, 6:06:58 bm07-build1 moz2-linux-slave23 2 days, 4:30:30 bm08-build1 moz2-linux-slave23 2 days, 4:30:30 bm08-build1 moz2-linux-slave23 2 days, 4:30:30 bm08-build1 moz2-linux-slave23 2 days, 4:30:30 bm08-build1 moz2-linux-slave23 2 days, 4:30:30 bm08-build1 moz2-linux-slave24 3 days, 5:06:27 bm08-build1 moz2-linux-slave24 3 days, 5:06:27 bm08-build1 moz2-linux-slave24 3 days, 5:06:27 bm08-build1 moz2-linux-slave24 3 days, 5:06:27 bm08-build1 moz2-linux-slave24 3 days, 5:06:27 bm08-build1 moz2-linux-slave28 1 day, 4:36:18 bm07-build1 moz2-linux-slave28 1 day, 4:36:18 bm07-build1 moz2-linux-slave28 1 day, 4:36:18 bm07-build1 moz2-linux-slave28 1 day, 4:36:18 bm07-build1 moz2-linux-slave28 1 day, 4:36:18 bm07-build1 moz2-linux-slave34 2 days, 6:57:48 bm07-build1 moz2-linux-slave34 2 days, 6:57:48 bm07-build1 moz2-linux-slave34 2 days, 6:57:48 bm07-build1 moz2-linux-slave34 2 days, 6:57:48 bm07-build1 moz2-linux-slave34 2 days, 6:57:48 bm07-build1 moz2-linux-slave35 2 days, 4:39:46 bm08-build1 moz2-linux-slave35 2 days, 4:39:46 bm08-build1 moz2-linux-slave35 2 days, 4:39:46 bm08-build1 moz2-linux-slave35 2 days, 4:39:46 bm08-build1 moz2-linux-slave35 2 days, 4:39:46 bm08-build1 moz2-linux-slave36 1 day, 5:15:18 bm08-build1 moz2-linux-slave36 1 day, 5:15:18 bm08-build1 moz2-linux-slave36 1 day, 5:15:18 bm08-build1 moz2-linux-slave36 1 day, 5:15:18 bm08-build1 moz2-linux-slave36 1 day, 5:15:18 bm08-build1 moz2-linux-slave40 1 day, 6:27:55 bm07-build1 moz2-linux-slave40 1 day, 6:27:55 bm07-build1 moz2-linux-slave40 1 day, 6:27:55 bm07-build1 moz2-linux-slave40 1 day, 6:27:55 bm07-build1 moz2-linux-slave40 1 day, 6:27:55 bm07-build1 moz2-linux-slave46 1 day, 10:46:44 bm07-build1 moz2-linux-slave46 1 day, 10:46:44 bm07-build1 moz2-linux-slave46 1 day, 10:46:44 bm07-build1 moz2-linux-slave46 1 day, 10:46:44 bm07-build1 moz2-linux-slave46 1 day, 10:46:44 bm07-build1 moz2-linux-slave49 3 days, 13:16:39 bm09-try1 mv-moz2-linux-ix-slave02 2 days, 4:07:39 bm08-build1 mv-moz2-linux-ix-slave02 2 days, 4:07:39 bm08-build1 mv-moz2-linux-ix-slave02 2 days, 4:07:39 bm08-build1 mv-moz2-linux-ix-slave02 2 days, 4:07:39 bm08-build1 mv-moz2-linux-ix-slave02 2 days, 4:07:39 bm08-build1 mv-moz2-linux-ix-slave14 1 day, 5:46:54 bm07-build1 mv-moz2-linux-ix-slave14 1 day, 5:46:54 bm07-build1 mv-moz2-linux-ix-slave14 1 day, 5:46:54 bm07-build1 mv-moz2-linux-ix-slave14 1 day, 5:46:54 bm07-build1 mv-moz2-linux-ix-slave14 1 day, 5:46:54 bm07-build1 mw32-ix-slave02 62 days, 0:06:42 bm07-build1 mw32-ix-slave02 62 days, 0:06:42 bm07-build1 mw32-ix-slave08 20 days, 3:04:29 bm08-build1 mw32-ix-slave08 20 days, 3:04:29 bm08-build1 mw32-ix-slave16 2 days, 0:18:23 bm09-try1 mw32-ix-slave24 1 day, 23:17:26 bm03-trybuilder talos-r3-fed-009 10 days, 22:08:23 bm17-tests1-linux talos-r3-fed-014 10 days, 22:07:12 bm17-tests1-linux talos-r3-fed-017 5 days, 22:55:00 bm18-tests1-linux talos-r3-fed-037 2 days, 19:37:01 bm18-tests1-linux talos-r3-fed-042 4 days, 22:43:49 bm18-tests1-linux talos-r3-fed-057 24 days, 2:53:49 bm18-tests1-linux talos-r3-fed64-003 5 days, 22:13:31 bm18-tests1-linux talos-r3-fed64-004 11 days, 19:03:16 bm17-tests1-linux talos-r3-fed64-005 68 days, 14:01:52 bm04-tests1-macosx talos-r3-fed64-008 3 days, 14:14:59 bm17-tests1-linux talos-r3-fed64-014 4 days, 1:20:36 bm17-tests1-linux talos-r3-fed64-015 2 days, 3:48:00 bm17-tests1-linux talos-r3-fed64-024 18 days, 1:45:16 bm18-tests1-linux talos-r3-fed64-026 3 days, 2:28:05 bm18-tests1-linux talos-r3-fed64-027 26 days, 14:21:46 bm18-tests1-linux talos-r3-fed64-034 40 days, 16:08:48 bm17-tests1-linux talos-r3-fed64-035 66 days, 21:03:18 bm04-tests1-macosx talos-r3-fed64-041 13 days, 4:33:33 bm18-tests1-linux talos-r3-fed64-049 10 days, 22:07:01 bm17-tests1-linux talos-r3-fed64-056 25 days, 13:24:51 bm18-tests1-linux talos-r3-leopard-007 219 days, 2:07:59 Tests Master 03 talos-r3-leopard-007 219 days, 2:07:59 Tests Master 03 talos-r3-leopard-014 3 days, 12:44:06 bm06-tests1-macosx talos-r3-leopard-014 3 days, 12:44:06 bm06-tests1-macosx talos-r3-leopard-015 6 days, 8:57:37 bm06-tests1-macosx talos-r3-leopard-015 6 days, 8:57:37 bm06-tests1-macosx talos-r3-leopard-019 23 days, 6:07:47 bm11-tests1-macosx talos-r3-leopard-019 23 days, 6:07:47 bm11-tests1-macosx talos-r3-leopard-023 20 days, 9:10:31 bm06-tests1-macosx talos-r3-leopard-023 20 days, 9:10:31 bm06-tests1-macosx talos-r3-leopard-033 62 days, 18:09:04 bm04-tests1-macosx talos-r3-leopard-033 62 days, 18:09:04 bm04-tests1-macosx talos-r3-leopard-042 3 days, 2:58:23 bm11-tests1-macosx talos-r3-leopard-042 3 days, 2:58:23 bm11-tests1-macosx talos-r3-leopard-045 17 days, 0:04:30 bm06-tests1-macosx talos-r3-leopard-045 17 days, 0:04:30 bm06-tests1-macosx talos-r3-leopard-058 14 days, 7:33:35 bm06-tests1-macosx talos-r3-leopard-058 14 days, 7:33:35 bm06-tests1-macosx talos-r3-w7-004 6 days, 22:36:32 bm16-tests1-windows talos-r3-w7-024 51 days, 21:02:52 bm15-tests1-windows talos-r3-w7-036 96 days, 7:50:49 bm16-tests1-windows talos-r3-w7-053 23 days, 22:34:37 bm15-tests1-windows talos-r3-xp-007 5 days, 18:08:47 bm16-tests1-windows talos-r3-xp-016 11 days, 22:58:44 bm15-tests1-windows talos-r3-xp-017 6 days, 21:33:50 bm16-tests1-windows talos-r3-xp-018 6 days, 16:08:00 bm16-tests1-windows talos-r3-xp-022 4 days, 0:07:22 bm15-tests1-windows talos-r3-xp-025 4 days, 17:01:28 bm15-tests1-windows talos-r3-xp-028 8 days, 19:46:03 bm16-tests1-windows talos-r3-xp-033 5 days, 7:17:52 bm15-tests1-windows talos-r3-xp-035 6 days, 16:20:29 bm16-tests1-windows talos-r3-xp-043 4 days, 0:38:11 bm15-tests1-windows talos-r3-xp-045 195 days, 21:20:42 Tests Master 03 talos-r3-xp-049 6 days, 16:19:07 bm16-tests1-windows talos-r3-xp-058 6 days, 15:38:07 bm16-tests1-windows talos-r4-lion-003 2 days, 17:20:53 bm06-tests1-macosx talos-r4-lion-004 1 day, 3:26:18 bm11-tests1-macosx talos-r4-lion-009 6 days, 8:05:23 bm06-tests1-macosx talos-r4-lion-011 11 days, 15:47:01 bm06-tests1-macosx talos-r4-lion-013 4 days, 17:37:56 bm04-tests1-macosx talos-r4-lion-016 20 days, 3:42:39 bm04-tests1-macosx talos-r4-lion-017 10 days, 14:05:12 bm06-tests1-macosx talos-r4-lion-024 3 days, 3:59:22 bm04-tests1-macosx talos-r4-lion-029 4 days, 6:01:12 bm04-tests1-macosx talos-r4-lion-031 34 days, 8:14:44 bm04-tests1-macosx talos-r4-lion-033 5 days, 17:10:09 bm04-tests1-macosx talos-r4-lion-039 6 days, 11:18:43 bm06-tests1-macosx talos-r4-lion-040 5 days, 12:39:08 bm04-tests1-macosx talos-r4-lion-043 5 days, 1:37:15 bm11-tests1-macosx talos-r4-lion-047 8 days, 20:34:26 bm04-tests1-macosx talos-r4-lion-050 10 days, 15:08:17 bm04-tests1-macosx talos-r4-lion-057 1 day, 5:20:06 bm06-tests1-macosx talos-r4-lion-058 7 days, 19:21:00 bm11-tests1-macosx talos-r4-lion-069 12 days, 1:54:11 bm04-tests1-macosx talos-r4-lion-074 9 days, 16:41:23 bm11-tests1-macosx talos-r4-lion-075 5 days, 18:45:10 bm04-tests1-macosx talos-r4-snow-003 40 days, 18:10:40 bm11-tests1-macosx talos-r4-snow-005 15 days, 13:08:00 bm11-tests1-macosx talos-r4-snow-009 10 days, 15:41:41 bm06-tests1-macosx talos-r4-snow-012 32 days, 19:59:57 bm11-tests1-macosx talos-r4-snow-013 14 days, 0:44:27 bm06-tests1-macosx talos-r4-snow-015 23 days, 5:26:32 bm11-tests1-macosx talos-r4-snow-016 9 days, 6:16:19 bm04-tests1-macosx talos-r4-snow-017 22 days, 4:09:57 bm04-tests1-macosx talos-r4-snow-018 4 days, 11:02:49 bm04-tests1-macosx talos-r4-snow-019 13 days, 20:29:04 bm11-tests1-macosx talos-r4-snow-020 30 days, 4:28:30 bm11-tests1-macosx talos-r4-snow-021 25 days, 4:58:50 bm06-tests1-macosx talos-r4-snow-024 4 days, 17:36:16 bm04-tests1-macosx talos-r4-snow-025 32 days, 19:37:17 bm11-tests1-macosx talos-r4-snow-028 5 days, 9:58:51 bm06-tests1-macosx talos-r4-snow-030 24 days, 3:43:15 bm04-tests1-macosx talos-r4-snow-031 25 days, 15:15:26 bm06-tests1-macosx talos-r4-snow-032 23 days, 16:31:22 bm04-tests1-macosx talos-r4-snow-033 4 days, 10:45:59 bm04-tests1-macosx talos-r4-snow-034 3 days, 21:14:54 bm04-tests1-macosx talos-r4-snow-038 4 days, 2:43:14 bm06-tests1-macosx talos-r4-snow-039 28 days, 2:10:40 bm11-tests1-macosx talos-r4-snow-040 20 days, 20:43:11 bm11-tests1-macosx talos-r4-snow-043 8 days, 22:46:19 bm11-tests1-macosx talos-r4-snow-044 4 days, 17:46:33 bm06-tests1-macosx talos-r4-snow-045 40 days, 9:37:34 bm06-tests1-macosx talos-r4-snow-046 27 days, 3:23:06 bm04-tests1-macosx talos-r4-snow-050 7 days, 23:30:09 bm06-tests1-macosx talos-r4-snow-052 7 days, 17:56:04 bm06-tests1-macosx talos-r4-snow-053 5 days, 16:04:08 bm04-tests1-macosx talos-r4-snow-054 23 days, 15:29:34 bm04-tests1-macosx talos-r4-snow-055 7 days, 0:51:23 bm06-tests1-macosx talos-r4-snow-057 4 days, 0:33:05 bm06-tests1-macosx talos-r4-snow-058 24 days, 23:35:59 bm04-tests1-macosx talos-r4-snow-061 1 day, 21:52:40 bm06-tests1-macosx talos-r4-snow-063 12 days, 14:45:44 bm04-tests1-macosx talos-r4-snow-064 1 day, 14:43:04 bm11-tests1-macosx talos-r4-snow-065 25 days, 3:51:29 bm06-tests1-macosx talos-r4-snow-066 3 days, 18:49:36 bm04-tests1-macosx talos-r4-snow-067 3 days, 18:21:21 bm11-tests1-macosx talos-r4-snow-068 12 days, 23:49:02 bm06-tests1-macosx talos-r4-snow-071 4 days, 15:05:15 bm04-tests1-macosx talos-r4-snow-074 32 days, 17:40:32 bm06-tests1-macosx talos-r4-snow-078 4 days, 4:17:56 bm04-tests1-macosx talos-r4-snow-079 12 days, 13:02:32 bm11-tests1-macosx tegra-033 30 days, 17:27:50 Test Master tegra-033 30 days, 17:27:50 Test Master tegra-033 30 days, 17:27:50 Test Master tegra-034 1 day, 13:13:08 Test Master tegra-034 1 day, 13:13:08 Test Master tegra-034 1 day, 13:13:08 Test Master tegra-036 12 days, 15:57:12 Test Master tegra-036 12 days, 15:57:12 Test Master tegra-036 12 days, 15:57:12 Test Master tegra-043 27 days, 23:00:28 Test Master tegra-043 27 days, 23:00:28 Test Master tegra-043 27 days, 23:00:28 Test Master tegra-044 26 days, 12:36:42 Test Master tegra-044 26 days, 12:36:42 Test Master tegra-044 26 days, 12:36:42 Test Master tegra-066 25 days, 3:51:01 Test Master tegra-066 25 days, 3:51:01 Test Master tegra-066 25 days, 3:51:01 Test Master tegra-068 25 days, 4:00:45 Test Master tegra-068 25 days, 4:00:45 Test Master tegra-068 25 days, 4:00:45 Test Master tegra-069 1 day, 13:15:16 Test Master tegra-069 1 day, 13:15:16 Test Master tegra-069 1 day, 13:15:16 Test Master tegra-070 25 days, 4:20:05 Test Master tegra-070 25 days, 4:20:05 Test Master tegra-070 25 days, 4:20:05 Test Master tegra-072 25 days, 4:15:42 Test Master tegra-072 25 days, 4:15:42 Test Master tegra-072 25 days, 4:15:42 Test Master tegra-077 26 days, 23:59:16 Test Master tegra-077 26 days, 23:59:16 Test Master tegra-077 26 days, 23:59:16 Test Master tegra-106 12 days, 16:16:21 Test Master tegra-106 12 days, 16:16:21 Test Master tegra-106 12 days, 16:16:21 Test Master tegra-113 10 days, 14:43:40 Test Master tegra-113 10 days, 14:43:40 Test Master tegra-113 10 days, 14:43:40 Test Master tegra-129 10 days, 11:55:17 Test Master tegra-129 10 days, 11:55:17 Test Master tegra-129 10 days, 11:55:17 Test Master tegra-130 10 days, 11:27:11 Test Master tegra-130 10 days, 11:27:11 Test Master tegra-130 10 days, 11:27:11 Test Master tegra-132 8 days, 15:51:49 Test Master tegra-132 8 days, 15:51:49 Test Master tegra-132 8 days, 15:51:49 Test Master tegra-133 10 days, 11:20:12 Test Master tegra-133 10 days, 11:20:12 Test Master tegra-133 10 days, 11:20:12 Test Master tegra-134 8 days, 15:29:31 Test Master tegra-134 8 days, 15:29:31 Test Master tegra-134 8 days, 15:29:31 Test Master tegra-135 10 days, 12:03:19 Test Master tegra-135 10 days, 12:03:19 Test Master tegra-135 10 days, 12:03:19 Test Master tegra-136 10 days, 11:40:56 Test Master tegra-136 10 days, 11:40:56 Test Master tegra-136 10 days, 11:40:56 Test Master tegra-138 19 days, 16:19:50 Test Master tegra-138 19 days, 16:19:50 Test Master tegra-138 19 days, 16:19:50 Test Master tegra-139 8 days, 15:29:19 Test Master tegra-139 8 days, 15:29:19 Test Master tegra-139 8 days, 15:29:19 Test Master tegra-140 10 days, 12:01:57 Test Master tegra-140 10 days, 12:01:57 Test Master tegra-140 10 days, 12:01:57 Test Master tegra-141 10 days, 13:19:06 Test Master tegra-141 10 days, 13:19:06 Test Master tegra-141 10 days, 13:19:06 Test Master tegra-142 10 days, 10:38:58 Test Master tegra-142 10 days, 10:38:58 Test Master tegra-142 10 days, 10:38:58 Test Master tegra-144 8 days, 15:52:55 Test Master tegra-144 8 days, 15:52:55 Test Master tegra-144 8 days, 15:52:55 Test Master tegra-145 10 days, 10:44:54 Test Master tegra-145 10 days, 10:44:54 Test Master tegra-145 10 days, 10:44:54 Test Master tegra-146 25 days, 17:23:31 Test Master tegra-146 25 days, 17:23:31 Test Master tegra-146 25 days, 17:23:31 Test Master tegra-149 2 days, 3:57:17 Test Master tegra-149 2 days, 3:57:17 Test Master tegra-149 2 days, 3:57:17 Test Master tegra-175 12 days, 15:01:04 Test Master tegra-175 12 days, 15:01:04 Test Master tegra-175 12 days, 15:01:04 Test Master try-linux64-slave01 3 days, 22:27:09 bm09-try1 try-linux64-slave02 4 days, 3:36:59 bm09-try1 try-linux64-slave03 2 days, 0:57:09 bm09-try1 try-linux64-slave05 2 days, 2:39:13 bm09-try1 try-linux64-slave06 3 days, 22:02:25 bm09-try1 try-linux64-slave08 4 days, 2:47:16 bm09-try1 try-linux64-slave09 4 days, 3:29:34 bm09-try1 try-linux64-slave10 4 days, 9:16:11 bm09-try1 try-linux-slave01 3 days, 20:45:23 bm09-try1 try-linux-slave04 3 days, 15:12:49 bm09-try1 try-linux-slave07 4 days, 12:05:49 bm09-try1 try-linux-slave08 2 days, 22:59:39 bm09-try1 try-linux-slave09 3 days, 12:56:42 bm09-try1 try-linux-slave10 3 days, 0:03:43 bm09-try1 try-linux-slave11 3 days, 12:23:32 bm09-try1 try-linux-slave12 2 days, 23:04:49 bm09-try1 try-linux-slave13 3 days, 12:45:11 bm09-try1 try-linux-slave16 1 day, 23:42:32 bm09-try1 try-linux-slave17 1 day, 23:27:06 bm09-try1 try-linux-slave19 3 days, 0:03:42 bm09-try1 try-linux-slave21 3 days, 20:46:43 bm09-try1 try-linux-slave23 3 days, 21:11:28 bm09-try1 try-linux-slave24 3 days, 20:52:41 bm09-try1 try-linux-slave25 2 days, 23:45:00 bm09-try1 try-linux-slave27 3 days, 21:11:58 bm09-try1 try-linux-slave28 2 days, 23:44:48 bm09-try1 try-linux-slave29 3 days, 20:48:09 bm09-try1 try-mac64-slave01 5 days, 13:19:02 bm09-try1 try-mac64-slave03 4 days, 3:39:24 bm09-try1 try-mac64-slave04 2 days, 16:02:27 bm09-try1 try-mac64-slave05 3 days, 15:02:08 bm09-try1 try-mac64-slave06 4 days, 3:44:55 bm09-try1 try-mac64-slave07 3 days, 15:24:52 bm09-try1 try-mac64-slave08 3 days, 20:42:15 bm09-try1 try-mac64-slave10 3 days, 14:51:41 bm09-try1 try-mac64-slave11 2 days, 15:50:20 bm09-try1 try-mac64-slave13 3 days, 21:13:04 bm09-try1 try-mac64-slave14 3 days, 21:19:03 bm09-try1 try-mac64-slave15 5 days, 5:43:16 bm09-try1 try-mac64-slave16 3 days, 14:31:16 bm09-try1 try-mac64-slave17 4 days, 12:53:12 bm09-try1 try-mac64-slave18 3 days, 21:21:38 bm09-try1 try-mac64-slave20 3 days, 17:15:37 bm09-try1 try-mac64-slave21 331 days, 12:23:27 Try Master try-mac64-slave22 3 days, 21:24:01 bm09-try1 try-mac64-slave23 1 day, 22:16:47 bm09-try1 try-mac64-slave24 2 days, 17:18:37 bm09-try1 try-mac64-slave25 5 days, 6:10:32 bm09-try1 try-mac64-slave26 2 days, 17:05:40 bm09-try1 try-mac-slave01 12 days, 19:04:10 bm09-try1 try-mac-slave02 3 days, 15:15:13 bm09-try1 try-mac-slave03 31 days, 22:54:22 bm09-try1 try-mac-slave04 3 days, 20:38:11 bm09-try1 try-mac-slave06 4 days, 14:21:07 bm09-try1 try-mac-slave07 10 days, 16:02:17 bm09-try1 try-mac-slave08 6 days, 12:08:57 bm09-try1 try-mac-slave09 3 days, 19:40:50 bm09-try1 try-mac-slave10 13 days, 9:16:38 bm09-try1 try-mac-slave12 25 days, 4:51:38 bm09-try1 try-mac-slave13 4 days, 14:20:52 bm09-try1 try-mac-slave14 33 days, 16:15:16 bm09-try1 try-mac-slave15 16 days, 17:09:33 bm09-try1 try-mac-slave17 4 days, 12:36:11 bm09-try1 try-mac-slave18 3 days, 20:12:52 bm09-try1 try-mac-slave19 6 days, 12:02:04 bm09-try1 try-mac-slave30 31 days, 22:39:02 bm09-try1 try-mac-slave31 5 days, 6:17:23 bm09-try1 try-mac-slave32 34 days, 13:10:31 bm09-try1 try-mac-slave33 3 days, 14:59:27 bm09-try1 try-mac-slave34 12 days, 19:01:13 bm09-try1 try-mac-slave36 24 days, 15:19:19 bm09-try1 try-mac-slave37 33 days, 16:52:32 bm09-try1 try-mac-slave38 34 days, 14:00:33 bm09-try1 try-mac-slave39 6 days, 11:14:19 bm09-try1 try-mac-slave40 13 days, 12:47:14 bm09-try1 try-mac-slave41 9 days, 21:19:50 bm09-try1 try-mac-slave42 5 days, 11:53:44 bm09-try1 try-mac-slave43 31 days, 15:08:57 bm09-try1 try-mac-slave44 31 days, 22:40:08 bm09-try1 try-mac-slave45 12 days, 19:23:02 bm09-try1 try-mac-slave46 6 days, 12:19:00 bm09-try1 try-mac-slave47 6 days, 11:47:05 bm09-try1 w32-ix-slave02 17 days, 20:53:12 bm14-try1 w32-ix-slave03 110 days, 6:49:11 bm05-trybuilder w32-ix-slave05 1 day, 21:59:41 bm03-trybuilder w32-ix-slave06 185 days, 22:05:57 bm03-trybuilder w32-ix-slave07 73 days, 13:31:20 bm14-try1 w32-ix-slave08 75 days, 22:36:11 bm14-try1 w32-ix-slave09 2 days, 12:27:27 bm03-trybuilder w32-ix-slave10 2 days, 0:08:04 bm03-trybuilder w32-ix-slave11 1 day, 23:11:16 bm03-trybuilder w32-ix-slave12 41 days, 11:58:56 bm03-trybuilder w32-ix-slave13 1 day, 22:49:42 bm03-trybuilder w32-ix-slave15 1 day, 22:04:08 bm03-trybuilder w32-ix-slave16 2 days, 12:47:41 bm03-trybuilder w32-ix-slave18 2 days, 13:02:16 bm03-trybuilder w32-ix-slave19 2 days, 0:12:47 bm03-trybuilder w32-ix-slave21 1 day, 22:11:26 bm03-trybuilder w32-ix-slave23 24 days, 20:35:00 bm14-try1 w32-ix-slave26 18 days, 2:31:32 bm13-build1 w32-ix-slave26 18 days, 2:31:32 bm13-build1 w32-ix-slave33 11 days, 0:58:04 bm13-build1 w32-ix-slave33 11 days, 0:58:04 bm13-build1 w32-ix-slave34 18 days, 2:30:01 bm12-build1 w32-ix-slave34 18 days, 2:30:01 bm12-build1 w32-ix-slave35 104 days, 19:38:42 bm05-builder w32-ix-slave35 104 days, 19:38:42 bm05-builder w32-ix-slave36 55 days, 13:44:03 bm12-build1 w32-ix-slave36 55 days, 13:44:03 bm12-build1 w32-ix-slave37 13 days, 15:06:56 bm12-build1 w32-ix-slave37 13 days, 15:06:56 bm12-build1 w32-ix-slave39 13 days, 11:11:10 bm12-build1 w32-ix-slave39 13 days, 11:11:10 bm12-build1 w64-ix-slave09 1 day, 15:12:47 bm13-build1 w64-ix-slave14 1 day, 2:13:59 bm12-build1 w64-ix-slave19 2 days, 6:34:08 bm12-build1 w64-ix-slave20 95 days, 20:39:01 bm12-build1 w64-ix-slave21 96 days, 19:25:57 bm13-build1 w64-ix-slave22 109 days, 2:10:23 bm13-build1 w64-ix-slave23 96 days, 15:51:37 bm12-build1 w64-ix-slave24 111 days, 1:45:05 bm12-build1 w64-ix-slave25 96 days, 22:01:01 bm14-try1 w64-ix-slave26 96 days, 22:02:12 bm14-try1 w64-ix-slave27 96 days, 21:57:52 bm05-trybuilder w64-ix-slave28 96 days, 21:59:15 bm14-try1 w64-ix-slave30 96 days, 21:56:17 bm05-trybuilder w64-ix-slave31 3 days, 21:52:25 bm14-try1 w64-ix-slave33 2 days, 16:35:24 bm14-try1 w64-ix-slave34 3 days, 15:51:22 bm14-try1 w64-ix-slave35 1 day, 22:31:55 bm14-try1 w64-ix-slave36 3 days, 20:27:08 bm14-try1 w64-ix-slave37 2 days, 16:45:20 bm14-try1
Assignee: jhford → coop
(In reply to Armen Zambrano G. [:armenzg] - Release Engineer from comment #8) > Here's the command I run: > wget -O- http://build.mozilla.org/builds/last-job-per-slave.txt | grep day | > sed 's/[bB]ug.*$//' | sed 's/201.*$//' | sort > slaves.log Add a -u to your sort command and you'll trim out the duplicates. I'm scripting something up to try to reboot slaves in this list semi-automatically.
Status: NEW → ASSIGNED
Priority: -- → P2
I don't really follow that command there. The .txt page won't have any slavealloc comments about bugs, so used the wrong url ? If you did have those comments I think you'd want to assume they were machines that needed manual help, and exclude them from the list to reboot.
Good catch! I was using the script with copy/paste from the html version and eventually I moved to use the txt one which is incorrect. The corrected list is: talos-r3-fed-009 12 days, 21:08:23 talos-r3-fed-014 12 days, 21:07:12 talos-r3-fed-057 26 days, 1:53:49 talos-r3-fed64-004 13 days, 18:03:16 talos-r3-fed64-008 5 days, 13:14:59 talos-r3-fed64-014 6 days, 0:20:36 talos-r3-fed64-015 4 days, 2:48:00 talos-r3-fed64-024 20 days, 0:45:16 talos-r3-fed64-026 5 days, 1:28:05 talos-r3-fed64-049 12 days, 21:07:01 talos-r3-leopard-015 8 days, 7:57:37 talos-r3-leopard-019 25 days, 5:07:47 talos-r3-leopard-023 22 days, 8:10:31 talos-r3-leopard-042 5 days, 1:58:23 talos-r3-leopard-045 18 days, 23:04:3 talos-r3-xp-007 7 days, 17:08:47 talos-r3-xp-016 13 days, 21:58:44 talos-r3-xp-017 8 days, 20:33:50 talos-r3-xp-018 8 days, 15:08:00 talos-r3-xp-025 6 days, 16:01:28 talos-r3-xp-033 7 days, 6:17:52 talos-r3-xp-049 8 days, 15:19:07 talos-r3-xp-058 8 days, 14:38:07 talos-r4-lion-009 8 days, 7:05:23 talos-r4-lion-011 13 days, 14:47:01 talos-r4-lion-013 6 days, 16:37:56 talos-r4-lion-017 12 days, 13:05:12 talos-r4-lion-029 6 days, 5:01:12 talos-r4-lion-033 1 day, 2:27:03 talos-r4-lion-043 7 days, 0:37:15 talos-r4-lion-058 9 days, 18:21:00 talos-r4-lion-075 7 days, 17:45:10 talos-r4-snow-012 34 days, 18:59:57 talos-r4-snow-015 25 days, 4:26:32 talos-r4-snow-017 24 days, 3:09:57 talos-r4-snow-020 32 days, 3:28:30 talos-r4-snow-024 6 days, 16:36:16 talos-r4-snow-025 34 days, 18:37:17 talos-r4-snow-028 7 days, 8:58:51 talos-r4-snow-032 25 days, 15:31:22 talos-r4-snow-038 6 days, 1:43:14 talos-r4-snow-039 30 days, 1:10:40 talos-r4-snow-043 10 days, 21:46:19 talos-r4-snow-045 42 days, 8:37:34 talos-r4-snow-046 29 days, 2:23:06 talos-r4-snow-058 26 days, 22:35:59 talos-r4-snow-059 1 day, 10:53:52 talos-r4-snow-061 3 days, 20:52:40 talos-r4-snow-063 14 days, 13:45:44 talos-r4-snow-068 14 days, 22:49:02 talos-r4-snow-074 34 days, 16:40:32 talos-r4-snow-079 14 days, 12:02:32 tegra-033 32 days, 16:27:50 tegra-034 3 days, 12:13:08 tegra-043 29 days, 22:00:28 tegra-044 28 days, 11:36:42 tegra-066 27 days, 2:51:01 tegra-068 27 days, 3:00:45 tegra-069 3 days, 12:15:16 tegra-070 27 days, 3:20:05 tegra-072 27 days, 3:15:42 tegra-077 28 days, 22:59:16 tegra-138 21 days, 15:19:50 tegra-141 12 days, 12:19:06 tegra-146 27 days, 16:23:31 tegra-175 14 days, 14:01:04 linux-ix-slave25 4 days, 18:20:10 linux-ix-slave33 15 days, 15:03:51 linux-ix-slave37 15 days, 17:54:16 linux-ix-slave38 3 days, 4:16:28 linux-ix-slave42 3 days, 5:10:05 linux64-ix-slave14 125 days, 19:17:28 moz2-darwin9-slave11 1 day, 3:34:32 moz2-darwin9-slave13 1 day, 3:30:44 moz2-darwin9-slave17 1 day, 3:38:27 moz2-darwin9-slave19 5 days, 13:06:50 moz2-darwin9-slave22 1 day, 16:19:54 moz2-darwin9-slave25 1 day, 3:34:15 moz2-darwin9-slave49 5 days, 4:29:20 moz2-darwin9-slave50 1 day, 3:51:00 w64-ix-slave20 97 days, 19:39:01 w64-ix-slave21 98 days, 18:25:57 w64-ix-slave22 111 days, 1:10:23 w64-ix-slave23 98 days, 14:51:37 w64-ix-slave24 113 days, 0:45:05
I've gone through the tegras. In many cases, these were in staging or waiting on swaps, so I marked them as such in slavealloc (bug 707584). I've also gone through the linux*-ix-slaves and rebooted them. They were all running buildbot, but probably had lost there way home to there masters due to network outages. I'll work my way through the rest of the buildslaves and then start in on the test slaves this afternoon.
These huge, fluid lists of slaves don't carry-over well from one week to the next. I'll file a new bug with an updated list for next week's buildduty.
Status: ASSIGNED → RESOLVED
Closed: 13 years ago
Resolution: --- → INCOMPLETE
Product: mozilla.org → Release Engineering
You need to log in before you can comment on or make changes to this bug.