Monitoring of NewRelic processes for SUMO may shed light on some of the high swap utilization on the production celery server. NewRelic monitoring should be added the dev, stage, and production environment for SUMO.
@rrosario: I've added NewRelic monitoring for celery in the SUMO dev and staging environments. Can you or someone on your team confirm that this has not affected routine operations in those environments before I make the same changes to production?
For reference, celery background tasks should now be appearing in New Relic: dev - https://rpm.newrelic.com/accounts/263620/applications/2779004/optimize/backgrounds_report stage - https://rpm.newrelic.com/accounts/263620/applications/2779107/optimize/backgrounds_report
I did some manual testing (launched celery tasks for reindexing) and everything seems to be working great. Thumbs up.
I've applied the change to production. Hopefully, we can pull some more data out of this as to what jobs are typically causing the server to go into high swap utilization.