Closed Bug 657015 Opened 14 years ago Closed 13 years ago

Replace iX slave HDs - 2011-05-16 batch (40 systems)

Categories

(Infrastructure & Operations :: RelOps: General, task)

Product:
Infrastructure & Operations
Component:
RelOps: General
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: dustin, Assigned: zandr)

References

Details

Batch II: linux-ix-slave06 4625 A1-16077 linux-ix-slave13 4632 A1-16084 linux-ix-slave16 4635 A1-16087 linux-ix-slave23 4854 A1-16153 linux-ix-slave29 4760 A1-16159 linux-ix-slave35 4766 A1-16165 linux-ix-slave42 4773 A1-16172 linux64-ix-slave03 4776 A1-16175 linux64-ix-slave04 4777 A1-16176 linux64-ix-slave11 4784 A1-16183 linux64-ix-slave12 4785 A1-16184 linux64-ix-slave13 4786 A1-16185 linux64-ix-slave14 4787 A1-16186 linux64-ix-slave17 4790 A1-16189 linux64-ix-slave35 4808 A1-16207 linux64-ix-slave40 4813 A1-16212 mv-moz2-linux-ix-slave12 3121 A1-14132 w64-ix-slave02 4708 A1-16107 w64-ix-slave06 4712 A1-16111 w64-ix-slave07 4713 A1-16112 w64-ix-slave08 4714 A1-16113 w64-ix-slave09 4715 A1-16114 w64-ix-slave10 4716 A1-16115 w64-ix-slave11 4717 A1-16116 w64-ix-slave12 4718 A1-16117 w64-ix-slave13 4719 A1-16118 w64-ix-slave14 4720 A1-16119 w64-ix-slave15 4721 A1-16120 w64-ix-slave16 4722 A1-16121 w64-ix-slave17 4723 A1-16122 w64-ix-slave18 4724 A1-16123 w64-ix-slave19 4725 A1-16124 w64-ix-slave20 4726 A1-16125 w64-ix-slave21 4727 A1-16126 w64-ix-slave22 4728 A1-16127 w64-ix-slave23 4729 A1-16128 w64-ix-slave24 4730 A1-16129 w64-ix-slave25 4731 A1-16130 w64-ix-slave26 4732 A1-16131 All secrets have been cleaned, and all hosts that I could get to via IPMI have been turned off.
w64-ix-slave07 is in the previous batch, which explains why I couldn't get to it via IMPI. Sorry. So that's 38 systems.
Summary: Replace iX slave HDs - 2011-05-16 batch → Replace iX slave HDs - 2011-05-16 batch (38 systems)
Assignee: server-ops-releng → zandr
Adding to bring up to an even 40: linux-ix-slave34 4765 A1-16164 linux64-ix-slave36 4809 A1-16208 (They were powered off, and confirmed this with dustin)
Summary: Replace iX slave HDs - 2011-05-16 batch (38 systems) → Replace iX slave HDs - 2011-05-16 batch (40 systems)
These are unracked and ready for pickup.
I had the wrong asset tag for this host; the serial was right: linux-ix-slave23 4754 A1-16153 Now I'm using the inventory API so I won't screw those up again.
35 of the 49 machines were returned Friday, 5/27. I don't yet know which 35. Their QA wasn't happy with the cable routing on the remaining 14, they'll be in early next week.
Actually, 37 were returned: 4785 4625 4719 4717 4808 4712 4814 4632 4722 4713 4620 4705 4729 4732 4764 4720 4728 4789 4727 4723 4784 4790 4714 4708 4766 4777 4787 4730 3121 4765 4635 4813 4725 4754 4783 4617 4773
Once these start getting re-racked, and we're happy with them, I'll put together batch III.
colo-trip: --- → scl1
From comment 14, that means the following are back: mv-moz2-linux-ix-slave12 3121 A1-14132 linux-ix-slave06 4625 A1-16077 linux-ix-slave13 4632 A1-16084 linux-ix-slave16 4635 A1-16087 w64-ix-slave02 4708 A1-16107 w64-ix-slave06 4712 A1-16111 w64-ix-slave08 4714 A1-16113 w64-ix-slave11 4717 A1-16116 w64-ix-slave13 4719 A1-16118 w64-ix-slave14 4720 A1-16119 w64-ix-slave16 4722 A1-16121 w64-ix-slave17 4723 A1-16122 w64-ix-slave19 4725 A1-16124 w64-ix-slave21 4727 A1-16126 w64-ix-slave22 4728 A1-16127 w64-ix-slave23 4729 A1-16128 w64-ix-slave24 4730 A1-16129 w64-ix-slave26 4732 A1-16131 linux-ix-slave23 4754 A1-16153 linux-ix-slave34 4765 A1-16164 linux-ix-slave35 4766 A1-16165 linux-ix-slave42 4773 A1-16172 linux64-ix-slave04 4777 A1-16176 linux64-ix-slave11 4784 A1-16183 linux64-ix-slave12 4785 A1-16184 linux64-ix-slave14 4787 A1-16186 linux64-ix-slave17 4790 A1-16189 linux64-ix-slave35 4808 A1-16207 linux64-ix-slave40 4813 A1-16212 And the following are still at iX: w64-ix-slave09 4715 A1-16114 w64-ix-slave10 4716 A1-16115 w64-ix-slave12 4718 A1-16117 w64-ix-slave15 4721 A1-16120 w64-ix-slave18 4724 A1-16123 w64-ix-slave20 4726 A1-16125 w64-ix-slave25 4731 A1-16130 linux-ix-slave29 4760 A1-16159 linux64-ix-slave03 4776 A1-16175 linux64-ix-slave13 4786 A1-16185 linux64-ix-slave36 4809 A1-16208
11 more received, apologies if these belong in the other bug: 4716 4760 4724 4715 4721 4636 4776 4786 4731 4726 4718
So the following are back: mv-moz2-linux-ix-slave12 3121 A1-14132 linux-ix-slave06 4625 A1-16077 linux-ix-slave13 4632 A1-16084 linux-ix-slave16 4635 A1-16087 w64-ix-slave02 4708 A1-16107 w64-ix-slave06 4712 A1-16111 w64-ix-slave08 4714 A1-16113 w64-ix-slave11 4717 A1-16116 w64-ix-slave13 4719 A1-16118 w64-ix-slave14 4720 A1-16119 w64-ix-slave16 4722 A1-16121 w64-ix-slave17 4723 A1-16122 w64-ix-slave19 4725 A1-16124 w64-ix-slave21 4727 A1-16126 w64-ix-slave22 4728 A1-16127 w64-ix-slave23 4729 A1-16128 w64-ix-slave24 4730 A1-16129 w64-ix-slave26 4732 A1-16131 linux-ix-slave23 4754 A1-16153 linux-ix-slave34 4765 A1-16164 linux-ix-slave35 4766 A1-16165 linux-ix-slave42 4773 A1-16172 linux64-ix-slave04 4777 A1-16176 linux64-ix-slave11 4784 A1-16183 linux64-ix-slave12 4785 A1-16184 linux64-ix-slave14 4787 A1-16186 linux64-ix-slave17 4790 A1-16189 linux64-ix-slave35 4808 A1-16207 linux64-ix-slave40 4813 A1-16212 w64-ix-slave09 4715 A1-16114 w64-ix-slave12 4718 A1-16117 w64-ix-slave15 4721 A1-16120 w64-ix-slave18 4724 A1-16123 w64-ix-slave20 4726 A1-16125 w64-ix-slave25 4731 A1-16130 linux-ix-slave29 4760 A1-16159 the following are still at iX: w64-ix-slave10 4716 A1-16115 linux64-ix-slave03 4776 A1-16175 linux64-ix-slave13 4786 A1-16185 linux64-ix-slave36 4809 A1-16208
linux-ix-slave06 4625 A1-16077 linux-ix-slave13 4632 A1-16084 linux-ix-slave16 4635 A1-16087 w64-ix-slave02 4708 A1-16107 w64-ix-slave06 4712 A1-16111 w64-ix-slave08 4714 A1-16113 w64-ix-slave11 4717 A1-16116 w64-ix-slave13 4719 A1-16118 w64-ix-slave14 4720 A1-16119 w64-ix-slave16 4722 A1-16121 w64-ix-slave17 4723 A1-16122 w64-ix-slave19 4725 A1-16124 w64-ix-slave21 4727 A1-16126 w64-ix-slave22 4728 A1-16127 w64-ix-slave23 4729 A1-16128 w64-ix-slave24 4730 A1-16129 w64-ix-slave26 4732 A1-16131 linux-ix-slave23 4754 A1-16153 linux-ix-slave34 4765 A1-16164 linux-ix-slave35 4766 A1-16165 linux-ix-slave42 4773 A1-16172 linux64-ix-slave04 4777 A1-16176 linux64-ix-slave11 4784 A1-16183 linux64-ix-slave12 4785 A1-16184 linux64-ix-slave14 4787 A1-16186 linux64-ix-slave17 4790 A1-16189 linux64-ix-slave35 4808 A1-16207 linux64-ix-slave40 4813 A1-16212 w64-ix-slave09 4715 A1-16114 w64-ix-slave12 4718 A1-16117 w64-ix-slave15 4721 A1-16120 w64-ix-slave18 4724 A1-16123 w64-ix-slave20 4726 A1-16125 w64-ix-slave25 4731 A1-16130 linux-ix-slave29 4760 A1-16159 Racked and powered up in scl1.
mv-moz2-linux-ix-slave12 will be coming back to its ancestral home in mtv1 for now.
And I don't see record of this one being re-racked or returned, so it's presumed still at iX. Correct me if that's wrong. linux64-ix-slave36 4809 A1-16208
linux64-ix-slave36 4809 A1-16208 is now back at scl1, as is w64-ix-slave02 4708 A1-16107 which had been re-sent to iX for further messing-around. So all of our ix machines are in our hands now.
which means this bug is fixed and bug 655304 remains to track the saga.
Status: NEW → RESOLVED
Closed: 13 years ago
Resolution: --- → FIXED
Component: Server Operations: RelEng → RelOps
Product: mozilla.org → Infrastructure & Operations
You need to log in before you can comment on or make changes to this bug.