Closed Bug 1342525 Opened 8 years ago Closed 8 years ago

fix s3 save queuing [antenna]

Categories

(Socorro :: Antenna, task)

task
Not set
normal

Tracking

(Not tracked)

RESOLVED FIXED

People

(Reporter: willkg, Assigned: willkg)

References

Details

Attachments

(1 file)

Miles and I were talking about upload bandwidth caps when we realized there's a problem with the way Antenna spins off coroutines to save crash data to s3. Namely, it's spinning of a coroutine per crash. Given that all the coroutines are running concurrently, that means each individual coroutine gets a smaller share of the upload bandwidth. In high-load situations, this will probably result in everything backing up and then Antenna dying. This bug covers looking into that and fixing the code so that it enforces a maximum number of crashes being saved to s3 at any given time and explicitly queues the rest.
Grabbing this now to look into.
Assignee: nobody → willkg
Status: NEW → ASSIGNED
I just landed this. I'm going to wait until it hits -dev, test it out and then push it to -stage.
I tested it on -dev and then Miles pushed it to -stage and I tested it out on -stage and it seems fine. Going to mark this FIXED.
Status: ASSIGNED → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
Switching Antenna bugs to Antenna component.
Component: General → Antenna
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: