Closed Bug 1296245 Opened 9 years ago Closed 9 years ago

Spark clusters not spawning

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P1)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED WORKSFORME

People

(Reporter: Dexter, Assigned: robotblake)

Details

I tried to spawn a new cluster (15 workers) this morning but it failed to initialize, remaining stuck in the bootstrapping phase. After a bit, the cluster web page stopped refreshing a left me this nice error > No such cluster: j-2ZPL0G4BMUETV -- error: EmrResponseError: 400 Bad Request Sender Throttling Rate exceeded 14245b57-651e-11e6-940a-111b567fefc3 I killed the cluster and tried to spawn a new one, no luck again.
Severity: normal → blocker
Looks like something is failing in the bootstrap script, investigating.
Assignee: nobody → bimsland
Points: --- → 1
Priority: -- → P1
It appears that this issue was a mix of timeouts in the bootstrap script and the AWS API being unhappy with how often we were hitting it. Currently not reproducible.
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → WORKSFORME
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.