975186 - Access to raw SeaMonkey ADI data for Robert Kaiser

Status: RESOLVED FIXED

(Data & BI Services Team :: DB: MySQL, task)

Description

[Robert Kaiser]

I'd like access to the raw SeaMonkey ADI data in Vertica or wherever the best machine-consumable form is, in a way that I can have a script running somewhere to get it to a server I run that exposes some views of it publicly to the SeaMonkey community.
deinspanjer had provided some daily-updating files on metrics.m.c until March 2013, and the plan was to replace providing it with some kind of community server that was supposedly being worked on but never actually appeared - so I guess getting some direct access for me to feed it out there is the best option at this point.

For now, all data I actually need is total ADI (blocklist pings) per version and day for the SeaMonkey product.


Some context per https://www.yammer.com/mozilla.com/#/threads/show?threadId=360709291&messageId=361388931

Robert Kaiser:
We also had been getting ADI information for SeaMonkey channeled through a "secret" daily-updated CSV URL until 10 months ago, and deinspanjer kept promising that something will come to replace it but that never materialized. The SeaMonkey community would be happy if we could get something running there again (don't need a dashboard, just some way to get data into my own systems, as I have a dashboard set up there already).

Ben Sullins in reply to Robert Kaiser:
for seamonkey you can access that data here: https://dataviz.mozilla.org/views/SeamonkeyMetrics/SeaMonkey…

Robert Kaiser in reply to Ben Sullins:
Thanks, that already somewhat helpful, I really would like the raw data (and with a bit more depth) and in a way I can expose it publicly, as the people actually working on SeaMonkey are not Mozilla staff, they're almost exclusively volunteers (I'm myself a bystander nowadays with mostly sentimental interest and only trying to help them somewhat with things like this). I had set up http://dev.seamonkey.at/metrics but you can easily see when we stopped getting data. I'd like to get data again in a format that I can feed to this system and expose there.

Ben Sullins in reply to Robert Kaiser:
Sure thing, file a bug under server operations: database and you should be able to get access to these tables in our data warehouse. [...] Just note whichever you'd like access to in the bug and that should get the ball rolling.

Comment 1

[Sheeri Cabral [:sheeri]]

Robert - we did spin up a community metrics server - bug 892600 and bug 821004...

cc'ing Annie, she is doing Daniel's role now, she might have more insight into how to get the ADI data you need.

Comment 2

[Annie Elliott]

There is a community metrics server, but no data is being pushed to it, as to date, none has been requested.

Robert - the Seamonkey metrics that Ben gave you a link to can be moved to a publicly available URL.

Can you give me some requirements that describe the "in more depth" part so that we can address that? What dimensions are you looking for?

Comment 3

[Sheeri Cabral [:sheeri]]

:Kairo - let me know if https://dataviz.mozilla.org/t/public/workbooks/SeamonkeyADI?project=21 works for you. It *should* be available to anyone who can login to LDAP.

You can also download the data by mousing over any data point, clicking the icon that looks like columns (at the bottom right of the box that pops up, it's "view data"), and then click on "underlying data".

Comment 4

[Robert Kaiser]

From what I saw, this provides less info than the public thing I had put up back then, so the data is incompatible, and as long as I can't just read it out from my server in an automated machine-readable way, it's not helpful for me in terms of getting the service back up that I had running.
What is helpful to the actual SeaMonkey team, I don't know. I know my service was, but not sure what they exactly need. Having something public that doesn't need special LDAP permission would probably be a requirement.

Note that I had marked this bug as TODO on my side for a while now anyway but I do get more and more and more tasks put on my plate and caring about SeaMonkey is very low priority for me so I didn't dig into what I can or can't do here.

Comment 5

[Sheeri Cabral [:sheeri]]

OK, I'm going to put this as a WONTFIX for now, and if the need arises from the Seamonkey folks or from you, we can revisit/reopen/open a new bug.