Closed
Bug 1357259
Opened 7 years ago
Closed 6 years ago
Autoscale the telemetry edge server
Categories
(Data Platform and Tools :: General, enhancement, P3)
Data Platform and Tools
General
Tracking
(Not tracked)
RESOLVED
WONTFIX
People
(Reporter: whd, Unassigned)
Details
(Whiteboard: [SvcOps])
Previously the ingestion stack was fronted by a tee server, which autoscaled based on load. Now that the edge server is running nginx again, we should have it autoscale as well. This is very low priority work since the edge is very efficient, to the point where it is unlikely that we will actually need to scale beyond the standard number of instances we provide for reliability (3). For instance, we recently DDOS'd ourselves (bug #1353364) and we were able to handle that traffic easily. We may even want to consider switching instance types to something smaller. Regardless, the bottleneck for the edge will be network throughput, so the autoscaling rules should be based on that. The only thing I would want to re-verify is that the s3 upload works correctly on instance termination due to scaling events.
Updated•7 years ago
|
Component: Metrics: Pipeline → Pipeline Ingestion
Product: Cloud Services → Data Platform and Tools
Reporter | ||
Comment 1•6 years ago
|
||
Closing this as unnecessary.
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → WONTFIX
Assignee | ||
Updated•2 years ago
|
Component: Pipeline Ingestion → General
You need to log in
before you can comment on or make changes to this bug.
Description
•