[ETL] Add Abstraction: Permanent Queue

NEW
Unassigned

Status

Testing
ActiveData
a year ago
a year ago

People

(Reporter: ekyle, Unassigned)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

a year ago
Putting work items into a queue, and syncing those work items with data in S3 is a minor pain when writing ETL scripts.  Specifically, the JSON configuration must be careful to properly name the queue with its related S3 bucket.

Make an abstraction, called Permanent Queue, that hides this abstraction and provides all he features of a queue, with durability of S3, plus the ability to reprocess any (previously) queued items.
(Reporter)

Updated

a year ago
Assignee: klahnakoski → nobody
You need to log in before you can comment on or make changes to this bug.