Open
Bug 1233499
Opened 5 years ago
Updated 5 years ago
[ETL] Add Abstraction: Permanent Queue
Categories
(Testing :: ActiveData, defect)
Testing
ActiveData
Tracking
(Not tracked)
NEW
People
(Reporter: ekyle, Unassigned)
Details
Putting work items into a queue, and syncing those work items with data in S3 is a minor pain when writing ETL scripts. Specifically, the JSON configuration must be careful to properly name the queue with its related S3 bucket. Make an abstraction, called Permanent Queue, that hides this abstraction and provides all he features of a queue, with durability of S3, plus the ability to reprocess any (previously) queued items.
Reporter | ||
Updated•5 years ago
|
Assignee: klahnakoski → nobody
You need to log in
before you can comment on or make changes to this bug.
Description
•