Open Bug 1233499 Opened 5 years ago Updated 5 years ago

[ETL] Add Abstraction: Permanent Queue

Categories

(Testing :: ActiveData, defect)

Product:
Testing
Component:
ActiveData
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

People

(Reporter: ekyle, Unassigned)

Details

Putting work items into a queue, and syncing those work items with data in S3 is a minor pain when writing ETL scripts.  Specifically, the JSON configuration must be careful to properly name the queue with its related S3 bucket.

Make an abstraction, called Permanent Queue, that hides this abstraction and provides all he features of a queue, with durability of S3, plus the ability to reprocess any (previously) queued items.
Assignee: klahnakoski → nobody
You need to log in before you can comment on or make changes to this bug.