1451483 - Have a command that opens all necessary terminals to do pulse data ingestion

Status: RESOLVED DUPLICATE of bug 1318020

(Tree Management :: Treeherder, enhancement, P3)

Description

[Cameron Dawson [:camd]]

This could take the PULSE_DATA_INGESTION_CONFIG from the environment, in a file, or as a cmd line arg.

It would be awesome if it was possible to specify whether to JUST ingest jobs and pushes or to do log parsing as well.

This will require Docker.

Comment 1

[Ed Morley [:emorley]]

Another way to reduce the number of steps would be to combine the push and job listeners into one command - perhaps called "pulse_listener"?

I don't think we ever need to stop listening to one and not the other (the store worker can be paused instead), and the load is so low that we don't need to run them on separate dynos.

Comment 2

[Ed Morley [:emorley]]

Bug 1318020 is filed for adding a command that runs multiple processes using something like Honcho (which looks at the Procfile for what to run).

Alternatively docker-compose could be used for similar effect if the switch from Vagrant to Docker is made (bug 1169263).

For the suggestion in comment 1 of merging the two pulse listening commands, I've filed bug 1530965.