342931 - Need to generate reports on time-in-queue for add-ons

Status: RESOLVED FIXED

(addons.mozilla.org Graveyard :: Administration, enhancement, P4)

Description

[Mike Shaver (:shaver -- probably not reading bugmail closely)]

I'd like to be able to see a histogram of the current queue's "age", new-vs-update, by platform, and probably some other things aggregated and medianized and otherwise crunched.

I guess that makes this a meta-bug.

Comment 1

[Mike Shaver (:shaver -- probably not reading bugmail closely)]

Ahem.

Comment 2

[Tim Horton]

I'm gonna hack up a little Perl script to play around with the information. Is there a better way to get the data from the queue than scraping it out of the HTML (which is what I am currently playing with)?

I know my work is probably going to be duplicated by one of the Update developers who is using the right language, and knows what they're doing (much unlike me!) but I'd like to play with this and potentially be a little tiny bit more helpful than usual.

Comment 3

[Tim Horton]

So - after a quick little bit of work, I've got something. It's just a simple histogram, but it's something. I'll get a LOT more done on this tomorrow, and I'd like to put a webby face on it. For now, though, this is good.

Comment 4

[Tim Horton]

Attachment: A simple histogram of the ages of the extensions in AMO.

Comment 5

[Mike Shaver (:shaver -- probably not reading bugmail closely)]

You make me so happy.

Comment 6

[Tim Horton]

Attachment: The histogram generation code.

From now on, I will - at least once a day, if possible - update the image stored at

http://internote.sourceforge.net/amo-overall.png

with the latest data from Update. The code is attached here, if anyone wants to play with it, and I would be more than happy to add more features/data to the graph if anyone wants anything additional.

Comment 7

[Wil Clouser [:clouserw]]

I think morgamic was thinking about this yesterday, but I don't see a comment about it:

We could probably use plotkit ( http://www.liquidx.net/plotkit/ ) to generate these on the fly like we're doing for the survey tool ( https://survey.mozilla.com/ ).

If you don't need instant updates, we could just use cron to generate something daily.  Do you have any other examples of data you'd want to pull out and the times between graph generation?

Comment 8

[Mike Shaver (:shaver -- probably not reading bugmail closely)]

I'd like to see:

- this awesome histogram, preferably where I can click on a bar or hover and have it show me the extensions that have been waiting that long

(- split bars for new/update)

- a graph over time of our mean/worst in queue

- a bunch of download metrics that I need to think more about

- a per-extension graph of downloads (per-period and cumulative), overlaid with some timeline points of when extensions were submitted, released, etc.

Comment 9

[Tim Horton]

Attachment: A new, HTML-based histogram. Much improved!

How's this? It's just a start, but this is more what I was looking to do when I started - I just wasn't sure how easy it was going to be. Feels much better to me. Hover over a bar to see the extensions that have waited that long; bars are split into new/updated. Click on an updated extension to go to it's current page.

I'll add more stats as you suggest them or as they come to me - the lastest version will be at http://internote.sourceforge.net/amo.html as I update it.

Also - I don't have access to the data needed to do the per-extension graphs. I'd love to do them, but even the graph I'm currently doing is a screen-scraping hack.

I wonder - and I don't know if I'm way out of line here - what it would take to become a Update developer 'intern' or some such. I'd love to help out, have a lot of free time, and enjoy doing this sort of thing!

Comment 10

[Michael Morgan [:morgamic]]

Hey Tim, if you're still interested in helping out I'd love to speak with you about interning or help you get set up with an add-on install so you can hack on it.  Ping me on IRC.

Comment 11

[Wil Clouser [:clouserw]]

Jorge has been generating these and posting them on the forums: https://forums.addons.mozilla.org/viewtopic.php?f=21&t=109

I don't know how automated that is, but it's a place to get the numbers if you want them.

Comment 12

[Jorge Villalobos [:jorgev] (he/him)]

They're not automated yet, but I do have all the queries necessary to generate them. I'm in the process of automating them, but they're not a priority.

Comment 13

[Justin Scott [:fligtar]]

Jorge, if you plan on implementing automated graphs, we can keep this bug open. Otherwise the original intent has pretty much been satisfied by your weekly reports.

Comment 14

[Jorge Villalobos [:jorgev] (he/him)]

I think the reports cover the need for stats and are clear enough to get a picture of the queues and how they change through time. Making charts out of those numbers wouldn't be hard, but I haven't heard any strong need for them.

FIXED (enough)