It looks like the hostgroups and servicegroups are not being properly updated when hosts move from scl1 -> scl3. Those hosts are no longer in scl1, but they're still listed as being in scl1 groups.
I believe this only occurred on the last move (Train C). It was noted that this needed to be done... however, looks like it was missed. Trains A,B should be ok/correct. Are you indeed referring to train C?
Hm, it looks like the others I saw were part of the panda move. Looks like parents didn't get updated for those: foopy53.p3.releng.scl3.mozilla.com foopy54.p3.releng.scl3.mozilla.com foopy55.p3.releng.scl3.mozilla.com foopy56.p3.releng.scl3.mozilla.com foopy57.p3.releng.scl3.mozilla.com foopy58.p3.releng.scl3.mozilla.com foopy59.p3.releng.scl3.mozilla.com mobile-imaging-003.p3.releng.scl3.mozilla.com panda-relay-023.p3.releng.scl3.mozilla.com panda-relay-024.p3.releng.scl3.mozilla.com panda-relay-025.p3.releng.scl3.mozilla.com panda-relay-026.p3.releng.scl3.mozilla.com panda-relay-027.p3.releng.scl3.mozilla.com panda-relay-028.p3.releng.scl3.mozilla.com panda-relay-029.p3.releng.scl3.mozilla.com panda-relay-030.p3.releng.scl3.mozilla.com Wrong groups from the last move (this may not be exhaustive): b-linux64-ix-0008.build.releng.scl3.mozilla.com b-linux64-ix-0009.build.releng.scl3.mozilla.com b-linux64-ix-0010.build.releng.scl3.mozilla.com b-linux64-ix-0011.build.releng.scl3.mozilla.com I'm starting an audit at https://docs.google.com/a/mozilla.com/spreadsheets/d/1s1dVO9rD5I3BvioYkCEqEZmm53ZOSAZp1gRCnN2ZqR4 as part of cleaning up all our nagios stuff, which is why I caught these.
I've added the missing switches for the panda rack, and updated the parents for all of p3 (r89200) I also corrected the mozpool health check (r89201)
Assignee: server-ops → arich
Status: NEW → RESOLVED
Last Resolved: 4 years ago
Resolution: --- → FIXED
Product: mozilla.org → mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.