1145703 - split collector out of socorro

Status: RESOLVED FIXED

(Socorro :: Backend, task)

Description

[Robert Helmer [:rhelmer]]

Let's split collector out to it's own repo (socorro-collector?)

It will need to depend on the current "socorro" module for shared code (socorro.external, socorro.lib and so on)

Code as well as tests should be moved, these directories at least:

socorro/collector
socorro/unittest/collector

Let's try to stay light on the build infra, we don't need a Makefile and a bunch of scripts. Maybe we can get away with just a setup.py ?

Comment 1

[Robert Helmer [:rhelmer]]

I took a quick stab at this a little while back:
https://github.com/rhelmer/socorro-collector

That fork isn't usable as it doesn't preserve history and doesn't have tests moved over, but it shows a minimum viable working collector.

Comment 2

[Will Kahn-Greene [:willkg] ET needinfo? me]

Lonnen has been working on splitting the collector out as part of his new asset-leveraging paradigm shift for Socorro initiative. In a ceremony so dark, brooding and solemn that a dozen kittens mewed in anguish for an hour, he bequeathed unto me the task of planning the next step in the campaign. Then he fed the kittens because their anguished mewings were causing him a headache and he had some more vidyo meetings to get through.

Grabbing this since it's the Bugzilla token of work ownership.

I'll look at what the code currently does and rhelmer's fork and start planning.

Comment 3

[Will Kahn-Greene [:willkg] ET needinfo? me]

I've been working on this for the last six months developing a wide array of genetically modified collectors, each more ghastly and macabre than the last.

First, I started working on a ground-up rewrite called Antenna. I abandoned this as I became more aware of some complexities and concerned about timetables.

Then, I switched gears and extracted the existing collector code from Socorro and then honed it a bit. The results of that work sit forsaken and destitute here:

    https://github.com/mozilla/socorro-collector

The most recent attempt is also named Antenna. I scrapped a bunch of the code in the first iteration since some requirements have changed and then continued the ground-up rewrite. You can see it here:

    https://github.com/mozilla/antenna

It's not done, yet, but I think I'll have it done soon. It's got some infrastructure built for it already by Miles who hails from Ops-otopia.

That's the current status.

Comment 4

[Will Kahn-Greene [:willkg] ET needinfo? me]

The Antenna first draft is done and I think that covers the scope of this bug. I started a tracker bug to cover all the things that need to be done to switch to Antenna including any additional Antenna development, tests, environments, etc.

Going to make this bug block that tracker and mark it as FIXED.