470029 - Add Urchin download tracking on addons.mozilla.org profile

Status: RESOLVED FIXED

(addons.mozilla.org Graveyard :: Statistics, defect, P2)

Description

[David Rolnitzky]

Now that we have AMO up and running on Urchin 6, it would be incredibly valuable to add in goal tracking reporting. By "goal" I mean download. This will allow us to measure the effectiveness that running external promotions has on driving AMO downloads.

A goal should be counted anytime someone hits the following xpi url:
https://addons.mozilla.org/en-US/firefox/downloads/file/[foo wildcard]

This should be similar to the goal reporting for the mozilla.com profile in urchin 5, where anytime a user hit the download.html page, we used that as a proxy for a download.  We should use the same "Campaign Tracking" report set that we used for the mozilla.com profile in Urchin 5.

Comment 1

[Jeremy Orem [:oremj]]

I've set up the goal.  Data should start coming in tomorrow.

Comment 2

[David Rolnitzky]

Hey Jeremy -- doesn't look like there's any data here.  Can you tell me specifically what report it should be showing up in?  In the marketing and content optimization sections, all goal related data is "0".

Comment 3

[David Rolnitzky]

Hi Jeremy -- can you point me in the right direction here?  Is there a reason this data isn't showing up in any of the campaign reporting?  Is there another report I should be looking at?

Comment 4

[Nick Nguyen [:osunick]]

Pinging again- I'm interested in seeing this data as well as a way to validate our stats data

Comment 5

[Jeremy Orem [:oremj]]

I'm not sure why it isn't showing up and since it is proprietary there aren't really any debug options.

Justin, do we still have a support contract with anyone?

Comment 6

[Justin Fitzhugh]

we don't - but we can get one if needed - xooni was less than helpful but may be the path of least resistance...can you reach out to them?  if they don't work, let me know and we can find someone else.

Comment 7

[Jeremy Orem [:oremj]]

Did a bit more digging.  The /en-US/firefox/downloads/file/.* links can't be tracked, because they are 302s, so urchin doesn't consider them to be content.  Just for comparison Omniture wouldn't be able to track these URLs either.

Webdev might be able to add an onclick even to the download addon button and do something like https://www.google.com/support/googleanalytics/bin/answer.py?answer=72712&ctx=sibling, but that is google analytics so not sure it's directly compatible.

curl -i   'https://addons.mozilla.org/en-US/firefox/downloads/file/41471/foxmarks_bookmark_synchronizer-2.6.0-fx.xpi'
HTTP/1.0 302 Found
Date: Wed, 28 Jan 2009 21:07:27 GMT
Expires: Wed, 28 Jan 2009 22:09:13 GMT
Cache-Control: max-age=3600      ,public
Connection: Keep-Alive
Via: NS-CACHE-6.0:   4
Server: Apache/2.2.3 (Red Hat)
X-Powered-By: PHP/5.1.6
X-AMO-ServedBy: mrapp09
Last-modified: Wed, 28 Jan 2009 21:09:13 GMT
Location: http://releases.mozilla.org/pub/mozilla.org/addons/2410/foxmarks_bookmark_synchronizer-2.6.0-fx.xpi
Content-Length: 0
Content-Type: text/html; charset=UTF-8

Comment 8

[David Rolnitzky]

Is this fundamentally different than what we did with the download.html page as a goal for Mozilla.com?  We used that with Urchin 5.x, where a goal (= download) registered if the following url was hit:
http://www.mozilla.com/en-US/products/download.html?product=firefox-[foo]

Did they change this in Urchin 6 or is doing this for add-ons somehow different?

Comment 9

[David Rolnitzky]

Or, how about we count a "goal" everytime a xpi is served?

Comment 10

[David Rolnitzky]

Wil or Nick -- would it be possible to add an onclick event to each add-on download button (see Jeremy's comment in #7)?  That way we could get aggregate counts of downloads resulting from any external campaigns or promo slots on Mozilla.com or the start page, as examples.

Comment 11

[Wil Clouser [:clouserw]]

We have the power!

oremj: what should we be adding to onclick?

Comment 12

[Nick Nguyen [:osunick]]

BTW, an onclick would only count dl's from people on the listing page.  Not counted would be developers hotlinking to downloads or people downloading from the add-on chrome, right?  This would still be useful as we could figure out the delta and see what the mix of various download sources could be.

Comment 13

[David Rolnitzky]

That's true, but we have the same issue with Firefox downloads via Mozilla.com.  Regardless, this would give us a *much* better picture of how effective promotional power from mozilla.com or external links (e.g. search) is affecting add-on downloads, and it would help in any optimization efforts we might have (like a site redesign).

Comment 14

[Nick Nguyen [:osunick]]

Wil, I believe this is the onClick handler:

onClick="javascript:urchinTracker ('%PATH_TO_DOWNLOAD%');

Comment 15

[David Rolnitzky]

If there's a question about the right syntax let me know and we can contact some Urchin consultants that we've used (Actual Metrics).  Copying oremj for his expertise here.

Comment 16

[Jeremy Orem [:oremj]]

Comment 14 looks correct:
https://secure.urchin.com/helpwiki/en/How_do_I_track_JavaScript_events%3F

Comment 17

[Alex Buchanan [:abuchanan]]

Attachment: patch v1

attaches urchin tracking to active buttons on mousedown

JS add-on install methods, install() and addEngine(), used to live in <a onclick="{install method}">.  per clouserw's suggestion, i've moved this out, into a jquery call $(button).click()

I think I tested every state a button could be in, but there sure are a lot of them :)

Comment 18

[Wil Clouser [:clouserw]]

Comment on attachment 374155 [details] [diff] [review]
patch v1

I like this but you're right.  It is a lot to test.  QA:  This potentially affects every state of every download button. :-/

Comment 19

[Alex Buchanan [:abuchanan]]

r24803 checks in patch v1

Comment 20

[Stephen Donner [:stephend] Not actively reading bugmail]

Can someone from metrics verify that this is working (i.e. reporting) as intended?  Thanks!

Comment 21

[Alex Buchanan [:abuchanan]]

Rolo, is this working as you expected?

Comment 22

[David Rolnitzky]

This is really awesome!  So it looks like the data is appearing in the reporting.  However, the sum number of goals isn't appearing in any of the reports (that I could find anyway).  Instead, it's taking it one step further and providing a conversion rate (great to have), but it would be even better if it also had number of goals so we don't have to manually back-out the calculation.  

I've attached a screen-shot that illustrates.  Basically there should be a column that just says "G1" with the totals.  

Can someone confirm that the goals (G1) register for each button click (and not xpi download)?  Just want to make sure I'm totally understanding the technical implementation.

Excited to see this finally happen!

Comment 23

[David Rolnitzky]

Attachment: Urchin goal tracking - reporting illustrated

Goals are only showing up as a conversion value -- "G1/visit" and not in sum total.