1376279 - decommission six mac buildbot test masters

Status: RESOLVED FIXED

(Infrastructure & Operations :: CIDuty, task)

Description

[Kim Moir [:kmoir] ET]

since we have migrated the majority on tests to run on tc

Comment 1

[Sebastian Pacurar [:spacurar]]

I noticed in the DB (1) that there are only several slaves connected to each masters. Shouldn't we decommission more than just 2 test masters in this case? All 8 masters are located in scl3 datacenter.

Side note: what should we do with the snow machines, since there are no jobs running for more than 20 days because mozilla-aurora has been retired.


(1)  mysql> select masters.nickname, count(*), masters.enabled from slaves, masters where masters.nickname like '%macosx%' and slaves.name not like '%snow%' and slaves.current_masterid = masters.masterid group by masters.nickname;

+---------------------+----------+---------+
| nickname            | count(*) | enabled |
+---------------------+----------+---------+
| bm106-tests1-macosx |        9 |       1 |
| bm107-tests1-macosx |        7 |       1 |
| bm108-tests1-macosx |        3 |       1 |
| bm132-tests1-macosx |        5 |       1 |
| bm133-tests1-macosx |        6 |       1 |
| bm134-tests1-macosx |        6 |       1 |
| bm135-tests1-macosx |        2 |       1 |
| bm136-tests1-macosx |        5 |       1 |
+---------------------+----------+---------+

Comment 2

[Chris AtLee [:catlee]]

I think we could reduce down to 2 masters. A single master could handle the load, but we need some redundancy.

Comment 3

[Sebastian Pacurar [:spacurar]]

Attachment: decomission_2_macs_puppet.patch

Removed mac buildbot test masters 108, 132, 133, 134, 135 and 136 from puppet.

Comment 4

[Sebastian Pacurar [:spacurar]]

Attachment: decomission_2_macs_tools.patch

Removed mac buildbot test masters 108, 132, 133, 134, 135 and 136 from tools repository.

Comment 5

[Alin Selagea [:aselagea]]

Comment on attachment 8883536 [details] [diff] [review]
decomission_2_macs_puppet.patch

https://hg.mozilla.org/build/puppet/rev/26e2ce139869
https://hg.mozilla.org/build/puppet/rev/2e99bef2314c

Comment 6

[Alin Selagea [:aselagea]]

Comment on attachment 8883537 [details] [diff] [review]
decomission_2_macs_tools.patch

https://hg.mozilla.org/build/tools/rev/5efede04659d

Comment 7

[Mihai Tabara [:mtabara - PTO2ndSept]⌚️GMT]

Yay, dependency bugs done, is there anything left here to do or can we declare victory?

Comment 8

[Sebastian Pacurar [:spacurar]]

I think what is left is to remove them from the db. I am taking care of this right now.

Comment 9

[Sebastian Pacurar [:spacurar]]

It's done now. Thank you mtabara for your help!