host and service groups not properly updated for scl1 -> scl3 move trains

RESOLVED FIXED

Status

mozilla.org Graveyard
Server Operations
RESOLVED FIXED
4 years ago
3 years ago

People

(Reporter: arr, Assigned: arr)

Tracking

Details

(URL)

(Assignee)

Description

4 years ago
It looks like the hostgroups and servicegroups are not being properly updated when hosts move from scl1 -> scl3. Those hosts are no longer in scl1, but they're still listed as being in scl1 groups.
I believe this only occurred on the last move (Train C). It was noted that this needed to be done... however, looks like it was missed.

Trains A,B should be ok/correct.

Are you indeed referring to train C?
(Assignee)

Comment 2

4 years ago
Hm, it looks like the others I saw were part of the panda move.  Looks like parents didn't get updated for those:

foopy53.p3.releng.scl3.mozilla.com
foopy54.p3.releng.scl3.mozilla.com
foopy55.p3.releng.scl3.mozilla.com
foopy56.p3.releng.scl3.mozilla.com
foopy57.p3.releng.scl3.mozilla.com
foopy58.p3.releng.scl3.mozilla.com
foopy59.p3.releng.scl3.mozilla.com
mobile-imaging-003.p3.releng.scl3.mozilla.com
panda-relay-023.p3.releng.scl3.mozilla.com
panda-relay-024.p3.releng.scl3.mozilla.com
panda-relay-025.p3.releng.scl3.mozilla.com
panda-relay-026.p3.releng.scl3.mozilla.com
panda-relay-027.p3.releng.scl3.mozilla.com
panda-relay-028.p3.releng.scl3.mozilla.com
panda-relay-029.p3.releng.scl3.mozilla.com
panda-relay-030.p3.releng.scl3.mozilla.com

Wrong groups from the last move (this may not be exhaustive):

b-linux64-ix-0008.build.releng.scl3.mozilla.com
b-linux64-ix-0009.build.releng.scl3.mozilla.com
b-linux64-ix-0010.build.releng.scl3.mozilla.com
b-linux64-ix-0011.build.releng.scl3.mozilla.com

I'm starting an audit at https://docs.google.com/a/mozilla.com/spreadsheets/d/1s1dVO9rD5I3BvioYkCEqEZmm53ZOSAZp1gRCnN2ZqR4 as part of cleaning up all our nagios stuff, which is why I caught these.
(Assignee)

Comment 3

4 years ago
I've added the missing switches for the panda rack, and updated the parents for all of p3 (r89200)
I also corrected the mozpool health check (r89201)
Assignee: server-ops → arich
Status: NEW → RESOLVED
Last Resolved: 4 years ago
Resolution: --- → FIXED
Product: mozilla.org → mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.