Closed Bug 601622 Opened 14 years ago Closed 14 years ago

Add more Socorro collector boxes

Categories

(mozilla.org Graveyard :: Server Operations, task)

Product:
mozilla.org Graveyard
Component:
Server Operations
Platform:
All
Other
Type:
task
Priority:
Not set
Severity:
blocker

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: laura, Assigned: aravind)

Details

When we have HBase problems (like today, and a couple of days last week) and have to fallback to local storage, disks are having trouble keeping up so sometimes fail to store a crash.

If we spread the load over more boxes this will help to alleviate the problem.

How fast can we spin up a couple more?
So this is really a disk space issue?  Can we start writing files to Zetta?
Zetta won't be fast enough, it needs to be local storage.

Upping this to blocker because until we get it we will see some data loss.
Severity: critical → blocker
The team is building out 2 more servers.
Assignee: server-ops → phong
I built out two boxes - Aravind has point on this.
Assignee: phong → aravind
Need two firewall rules opened.  Netops has the needed info.
Firewall rules opened.

pm-app-collector04 is now in the mix, working on adding pm-app-collector06.
And pm-app-collector06 is now accepting crashes as well.
Status: NEW → RESOLVED
Closed: 14 years ago
Resolution: --- → FIXED
Product: mozilla.org → mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.