Closed Bug 1250013 Opened 4 years ago Closed 4 years ago

create production sync metrics redshift instance

Categories

(Firefox :: Sync, defect, P2)

defect

Tracking

()

RESOLVED INVALID

People

(Reporter: dcoates, Unassigned)

References

Details

(Whiteboard: [sync-metrics])

Create or find a Redshift instance to use for beta testing sync metrics in production.
An estimate on cluster size...

Given the flexibility with resizing I'm comfortable starting with a super small cluster.

https://docs.aws.amazon.com/redshift/latest/mgmt/working-with-clusters.html#cluster-resize-intro

Its hard to estimate upfront a lower bound for how much storage we'll need given redshift's compression, but the upper bound will likely be in the mid 10s of GB per day for full production traffic. A dc1.large has 160GB of storage, so at 40GB per day we'd need 8 nodes for 30 days of data.

To beta test against 1 sync node a single dc1.large should be sufficient and will give us a better idea of what to expect from the full cluster.

:bobm :whd f? next steps?
Flags: needinfo?(whd)
Flags: needinfo?(bobm)
I believe this falls under WHD's purview, so I'm clearing my needinfo.  I will monitor and assist as required.
Flags: needinfo?(bobm)
I need to parameterize the provisioning logic we use for redshift clusters for this and bug #1251097, which I will do next week. Is the plan here to instrument a single sync production node for this test? If so this is going to require bobm to do the instrumentation.
Flags: needinfo?(whd)
> I need to parameterize the provisioning logic we use for redshift clusters for this and bug #1251097, which I will do next week.

Great! I won't need an instance until after fxa train-57 is in prod (at least 2 weeks)

> Is the plan here to instrument a single sync production node for this test?

yes. I'll start another bug for wiring it up.
Assignee: nobody → dcoates
Flags: firefox-backlog+
Priority: -- → P2
Summary: sync metrics redshift → create production sync metrics redshift instance
Whiteboard: [sync-metrics]
Assignee: dcoates → nobody
superseded by bug 1291340
Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → INVALID
Component: Firefox Sync: Backend → Sync
Product: Cloud Services → Firefox
You need to log in before you can comment on or make changes to this bug.