613323 - SUMO, grow cluster

Status: RESOLVED DUPLICATE of bug 622752

(mozilla.org Graveyard :: Server Operations, task)

Description

[matthew zeier [:mrz]]

Related to bug 613252.  Need more machines?

Comment 1

[Jeremy Orem [:oremj]]

2 more web servers and 1 celery machine?

Comment 2

[Jeremy Orem [:oremj]]

If someone will set up pm-app-sumo05,06 and pm-celery-sumo01 64 bit boxes on the vlan 81 I can puppetize them.

Comment 3

[James Socol [:jsocol, :james]]

+1 to a dedicated celery machine. I suspect that one of the reasons
pm-app-sumo04 has a hard time recovering is that higher traffic leads
simultaneously to higher load on apache and higher load on celeryd/rabbit,
which can then back up the other servers as they try to connect to rabbit.

Comment 4

[Corey Shields [:cshields]]

I don't believe we have any spares suitable for this but will check.  Going to pass this to Phong, he can order and install when he returns.

Comment 5

[James Socol [:jsocol, :james]]

Any movement here? It would be great to have the cluster beefed up before Firefox 4.

Comment 6

[matthew zeier [:mrz]]

Talking internally and will likely migrate SUMO to Phoenix for full time (with SJC as backup).  All of this will happen prior to Fx4.

Comment 7

[Phong Tran [:phong]]

We are actually moving this to PHX.  There is another bug open for this.