Closed Bug 1344725 Opened 9 years ago Closed 9 years ago

Implement simplified ingestion pipeline

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, enhancement, P1)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
enhancement

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: mreid, Assigned: mreid)

References

Details

The goal is to be able to spin up a functional, but simplified, version of the ingestion infrastructure locally. This will allow testing of schemas, decoders, analysis plugins, and outputs without sending data through the prod pipeline. The simplest form is a single Docker container running nginx and hindsight (with hsadmin), configured to serialize data to local disk.
Blocks: 1344371
Assignee: nobody → mreid
Points: --- → 3
Priority: -- → P1
Working first pass here: https://github.com/mreid-moz/mozingest-simple/pull/1 Next up is to see if we can use the existing Hindsight container[1] rather than setting up a new one from RPMs. [1] https://hub.docker.com/r/mozilla/hindsight/
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.