1212096 - Increase percentage of crashes that are sent to stage collectors

Status: RESOLVED FIXED

(Socorro :: General, task)

Description

[Matt Brandt [:mbrandt]]

I'd like to up the percentage of crashes being sent from prod to stage and it's collectors to get a more representative collection of data.

On production's collector boxes, let's raise crashmover's destination.storage3.throttle from 10 to 20 to send more data to the stage collectors.

Comment 1

[Peter Bengtsson [:peterbe]]

I agree. I think we should definitely bump it from 10 to 20.

Comment 2

[K Lars Lohn [:lars] [:klohn]]

:jp the idea is to change the crashmover config to flow more crashes into the RMQ stage submmission queue:

existing:
    destination.storage3.throttle=10

what we need:
    destination.storage3.throttle=20

that ought to double the number of crashes flowing into staging.

Comment 3

[JP Schneider [:jp]]

Great, thanks lars!

I've run it and set us to 20%...:mbrandt is that sufficient?

Comment 4

[Matt Brandt [:mbrandt]]

Thanks JP! Much appreciated. Let's call this good for now. I think time will tell if this was the right tweak. I'll file a bug if we need more.

Comment 5

[Peter Bengtsson [:peterbe]]

Resolve?

Comment 6

[Peter Bengtsson [:peterbe]]

JP, last time I ssh'ed into one of the stage processors I noticed it hovered around a load of 10. Should we upgrade them to xlarge2 (or whatever it was prod uses?)