971809 - Regression notification system for Eideticker

Status: RESOLVED WONTFIX

(Testing Graveyard :: Eideticker, defect)

Comment 1

[William Lachance (:wlach)]

The path I was planning to take with this was make eideticker use datazilla (bug 909796) and then plug into datazilla's coming-soon (I think end of Q1?) regression notification system.

Comment 2

[William Lachance (:wlach)]

Let's make this depend on adding support for datazilla for now.

Comment 3

[William Lachance (:wlach)]

Actually, it looks like migrating to datazilla isn't that hot an idea after all. But we still want this. So let's write a regression-detection-and-notification system on top of the existing eideticker datastore.

Likely a custom python script will need to be written that will analyze eideticker's data and detect recent regressions. We can probably reuse many of the ideas that are going into the datazilla script, although the nature of eideticker's regressions is a bit different. Kyle would probably be the natural person to write this script, if he has time. Otherwise I can probably take a stab at it based on his work for datazilla.

For sending the regression mails, I'd like to use the same system that glob's writing for datazilla, which I hear will involve something called errormill (which apparently is good at making sure that duplicate notices aren't sent, etc.). Will try to learn more about this next week.

Comment 4

[:glob ✱]

(In reply to William Lachance (:wlach) from comment #3)
> For sending the regression mails, I'd like to use the same system that
> glob's writing for datazilla, which I hear will involve something called
> errormill

we're not doing it yet, but that's the plan.
http://errormill.mozilla.org/
https://getsentry.com/
http://sentry.readthedocs.org/en/latest/

from bugzilla we build the json at http://bzr.mozilla.org/bmo/4.2/view/head:/Bugzilla/Sentry.pm#L206
and send it at http://bzr.mozilla.org/bmo/4.2/view/head:/sentry.pl#L67
(but there's probably a python lib that would most of the heavy lifting)

Comment 5

[William Lachance (:wlach)]

I showed Kyle some samples of eideticker data and regressions (both android and b2g) and he thinks the existing system he's written for datazilla should be straightforward to adapt to the type of data eideticker is generating, so long as the data is in elastic search. Filed bug 985985 for this.

Tentatively scheduling for early Q2.

Comment 6

[William Lachance (:wlach)]

:ekyle has this mostly working. I'll assign this to him.

Comment 7

[Kyle Lahnakoski [:ekyle]]

dzAlerts is a dead project