838365 - VM for testing Kafka, needs to be able to talk to Socorro Dev environment

Status: RESOLVED WONTFIX

(mozilla.org Graveyard :: Server Operations, task)

Description

[Selena Deckelmann :selenamarie :selena]

I'd like to set up Kafka on a VM for testing with Socorro in dev. 

I don't need much management - just a system that I can install stuff on.  So, please gimme root :) 

This is for proof-of-concept only.

Comment 1

[Michael Burns [:mburns]]

Does this need to have access to other socorro hosts, or any other particular network ports that might require firewall changes or determine which vlan this ends up in? Or is it pretty much standalone? Thanks

Comment 2

[Selena Deckelmann :selenamarie :selena]

(In reply to Michael Burns [:mburns] from comment #1)
> Does this need to have access to other socorro hosts, or any other
> particular network ports that might require firewall changes or determine
> which vlan this ends up in? Or is it pretty much standalone? Thanks

Sorry for the delay! I missed this reply. 

This dev system needs to access it on a few ports - I think 9092:

    Hostname socorro1.dev.dmz.phx1.mozilla.com

My plan for the moment is to run a standalone Kafka cluster on the VM.

Comment 3

[Shyam Mani [:fox2mike]]

Selena,

I'm sorry this has sat for a while, will a default spec VM suffice? (1 core, 2 GB of RAM and 40GB of disk space)

Let me know I'll get this going for you.

Comment 4

[Selena Deckelmann :selenamarie :selena]

Hi!


(In reply to Shyam Mani [:fox2mike] from comment #3)
> Selena,
> 
> I'm sorry this has sat for a while, will a default spec VM suffice? (1 core,
> 2 GB of RAM and 40GB of disk space)
> 
> Let me know I'll get this going for you.

We ended up doing some local testing and decided to go with RabbitMQ instead. I'll just close this up!