1357259 - Autoscale the telemetry edge server

Status: RESOLVED WONTFIX

(Data Platform and Tools :: General, enhancement, P3)

Description

[Wesley Dawson [:whd]]

Previously the ingestion stack was fronted by a tee server, which autoscaled based on load. Now that the edge server is running nginx again, we should have it autoscale as well.

This is very low priority work since the edge is very efficient, to the point where it is unlikely that we will actually need to scale beyond the standard number of instances we provide for reliability (3). For instance, we recently DDOS'd ourselves (bug #1353364) and we were able to handle that traffic easily. We may even want to consider switching instance types to something smaller. Regardless, the bottleneck for the edge will be network throughput, so the autoscaling rules should be based on that.

The only thing I would want to re-verify is that the s3 upload works correctly on instance termination due to scaling events.

Comment 1

[Wesley Dawson [:whd]]

Closing this as unnecessary.