[ETL] Ensure push_to_es.py does not hang on records for too long

NEW
Unassigned

Status

Testing
ActiveData
2 years ago
2 years ago

People

(Reporter: ekyle, Unassigned)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

2 years ago
push_to_es.py pushes records to an abstract queue.  The implementation is threaded; designed to bundle records before pushing them to ES in a big bulk push.

Be sure that the time between push-to-queue and push-to-es is not too long under low load.  Ensure that the threaded implementation is hooked to the AWS shutdown notification, and it shuts down cleanly.
(Reporter)

Updated

2 years ago
Assignee: klahnakoski → nobody
You need to log in before you can comment on or make changes to this bug.