Closed
Bug 549384
Opened 15 years ago
Closed 15 years ago
Implement site metrics tracking
Categories
(Websites Graveyard :: drumbeat.org, defect)
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: scrivi, Unassigned)
References
()
Details
(Whiteboard: server-statistics)
User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; it; rv:1.9.2) Gecko/20100115 Firefox/3.6
Build Identifier: alpha
after this kinda semiprivate launch I noticed that no stats are included into the website for a client side point of view.
I'm wondering if those data are accessible and if there are none if we can tampon this with google analytics or piwik
Reproducible: Always
Updated•15 years ago
|
Summary: stats missing? → need to implement site metrics tracking
Comment 1•15 years ago
|
||
Good point Carlo. Have also sent to Drumbeat web dev list for ideas as well.
Comment 2•15 years ago
|
||
In terms of metrics, I have some input for the group. Metrics break down into some key areas for the site, iterated below:
1) OVERALL TRAFFIC - Right now, Drumbeat runs on a central server using Apache. I would like to get awstats going so we can get detailed metrics on overall usage. Awstats gives us information about things like error codes that we are not going to get on Google Metrics, and provides interesting comparison data when put up next to other services.
2) USER METRICS - I would luike to implement Google Analytics on the site in order to understand where people are coming from and what the most popular content is. Drupal has a module for Google Analytics we can just install and enable. IMHO, Google Analytics is more like a dashboard for Drumbeat, it is going to give us a general overview of what is happening at a glance and good information about geographic distribution.
3) DRUMBEAT METRICS - Drumbeat is all about participation, and (as with most large communities) trending is the most important way to analyze performance. There are a few key metrics related to participation I would like to track. Capturing these metrics in awstats or Google Analytics would be rather complex and somewhat redundant, since it is all captured in the Drupal database. These include:
Basic:
- new registrations
- logins
- project creation
- contributions to projects
- Project 'joins,' or people creating membership in a project.
Advanced:
- usage by content type, for anything contributed to a project: this would help us understand overall usability for project maintainers and (coupled with feedback) tell us what is useful for sharing information about a project.
- event registration, compared to community size: this would help us understand how efforts are translating into offline action. I am more interested in understanding whether this serves as a real benchmark more than anything else.
- donations by project, for obvious reasons.
- overall donation activity and conversions - how many people make it to a donation page compared to how many actually donate.
- searches, popular search terms, tags and the popularity of other classifiers: anything used to classify a project should be quantified in order to reveal general trends. Given the nature of Internet trends, this would probably be the most compelling metric of anything in the site. I would expect to see a long tail develop over time.
- cross-promotion opportunities (pollination): right now, the IA for Drumbeat is centered on specific projects. Users go to a project page to do all their work, and it is a terminal point from the perspective that no information about related projects is presented. Opportunities are created when users participate in multiple projects, either in terms of contributing content, joining a project, donating to a project, or becoming involved in an event related to a project. I would like to establish metrics aimed at identifying which projects have affiliated users, and testing some features for increasing multi-project involvement within the user base without forcing users to go through traditional searches. So, we would analyze common relationships between projects, present links to affiliated projects, and construct metrics around these 'pollination' features.
4) VIRAL METRICS - Matt and I talked about the use of some more advanced features within Drupal as part of a Phase II for Drumbeat. I would like to enable the embed module within the site and generate some metrics around where and how widgets are being used. Right now, this has not been enabled in Drumbeat, but I think it could be very important for the growth of the community.
5) OTHER METRICS: There are some ad hoc metrics I run personally as part of every project I get involved in. These would traditionally be classified as media metrics, and are centered on understanding where people are talking about a subject on the Internet. I would like to set up something custom that uses feeds from Google Alerts, Technocrati, Flickr, Meetup and other UGC sites and indexes to track WHERE, HOW OFTEN, WHO, and HOW ELABORATELY people are discussing Drumbeat. There are some things that would need to happen to bring this set of metrics to be truly effective (such as standards for tagging within the community, the creation of identifiers / badges people can include, etc) but this sort of analysis would be important for understanding the impact the community is having. It would be worthwhile to put some thought into how to make this a meaningful part of how metrics are conducted.
Comment 3•15 years ago
|
||
(In reply to comment #2)
> In terms of metrics, I have some input for the group. Metrics break down into
> some key areas for the site, iterated below:
>
> 1) OVERALL TRAFFIC - Right now, Drumbeat runs on a central server using Apache.
> I would like to get awstats going so we can get detailed metrics on overall
> usage. Awstats gives us information about things like error codes that we are
> not going to get on Google Metrics, and provides interesting comparison data
> when put up next to other services.
+1
http://awstats.sourceforge.net/
>
> 2) USER METRICS - I would luike to implement Google Analytics on the site in
> order to understand where people are coming from and what the most popular
> content is. Drupal has a module for Google Analytics we can just install and
> enable. IMHO, Google Analytics is more like a dashboard for Drumbeat, it is
> going to give us a general overview of what is happening at a glance and good
> information about geographic distribution.
+1
http://drupal.org/project/google_analytics
http://www.google.com/analytics/
>
> 3) DRUMBEAT METRICS - Drumbeat is all about participation, and (as with most
> large communities) trending is the most important way to analyze performance.
> There are a few key metrics related to participation I would like to track.
> Capturing these metrics in awstats or Google Analytics would be rather complex
> and somewhat redundant, since it is all captured in the Drupal database. These
> include:
>
> Basic:
> - new registrations
> - logins
> - project creation
> - contributions to projects
> - Project 'joins,' or people creating membership in a project.
>
> Advanced:
> - usage by content type, for anything contributed to a project: this would help
> us understand overall usability for project maintainers and (coupled with
> feedback) tell us what is useful for sharing information about a project.
> - event registration, compared to community size: this would help us understand
> how efforts are translating into offline action. I am more interested in
> understanding whether this serves as a real benchmark more than anything else.
> - donations by project, for obvious reasons.
> - overall donation activity and conversions - how many people make it to a
> donation page compared to how many actually donate.
> - searches, popular search terms, tags and the popularity of other classifiers:
> anything used to classify a project should be quantified in order to reveal
> general trends. Given the nature of Internet trends, this would probably be the
> most compelling metric of anything in the site. I would expect to see a long
> tail develop over time.
> - cross-promotion opportunities (pollination): right now, the IA for Drumbeat
> is centered on specific projects. Users go to a project page to do all their
> work, and it is a terminal point from the perspective that no information about
> related projects is presented. Opportunities are created when users participate
> in multiple projects, either in terms of contributing content, joining a
> project, donating to a project, or becoming involved in an event related to a
> project. I would like to establish metrics aimed at identifying which projects
> have affiliated users, and testing some features for increasing multi-project
> involvement within the user base without forcing users to go through
> traditional searches. So, we would analyze common relationships between
> projects, present links to affiliated projects, and construct metrics around
> these 'pollination' features.
Would be interested in working on a bespoke metrics module for Drumbeat building on anything that has already been done in the drupal community. We should implement new features though only when we need them and not allow the module to be more complex than need be at any given time.
>
> 4) VIRAL METRICS - Matt and I talked about the use of some more advanced
> features within Drupal as part of a Phase II for Drumbeat. I would like to
> enable the embed module within the site and generate some metrics around where
> and how widgets are being used. Right now, this has not been enabled in
> Drumbeat, but I think it could be very important for the growth of the
> community.
>
> 5) OTHER METRICS: There are some ad hoc metrics I run personally as part of
> every project I get involved in. These would traditionally be classified as
> media metrics, and are centered on understanding where people are talking about
> a subject on the Internet. I would like to set up something custom that uses
> feeds from Google Alerts, Technocrati, Flickr, Meetup and other UGC sites and
> indexes to track WHERE, HOW OFTEN, WHO, and HOW ELABORATELY people are
> discussing Drumbeat. There are some things that would need to happen to bring
> this set of metrics to be truly effective (such as standards for tagging within
> the community, the creation of identifiers / badges people can include, etc)
> but this sort of analysis would be important for understanding the impact the
> community is having. It would be worthwhile to put some thought into how to
> make this a meaningful part of how metrics are conducted.
Totally agree.
I have put a lot of work into the affiliates module on D.o which i think is a great way for Drumbeat to reach a wider audience & quickly
Comment 4•15 years ago
|
||
For more information on the affiliates module , please see ..
http://drupal.org/project/affiliates
Updated•15 years ago
|
Assignee: nobody → paulbooker
Comment 5•15 years ago
|
||
This is great analysis guys! :)
Given that we'll be tackling it in an iterative way,
what is the best FIRST step?
Is it to
1) implement awstats
2) and then (once that's working) the Drupal Google Analytics module?
If we agree, Paul are you able to push ahead with that?
Comment 6•15 years ago
|
||
Hi, Matt,
We can do 1 & 2 in either order
I can help out with installing Google Analytics but awstats will need to be installed by our server adminstrator.
Can i get clearance to upload Google Analytics for testing on our stage server?
(Do i request clearance from Micheal? , if protocol on such things is down somewhere on the wiki would you mind pointing me at that and i'll go and read)
Is stage moving to http://www-stage.drumbeat.org/ ?
Best,
Paul Booker
Appcoast
Best, Paul
Comment 7•15 years ago
|
||
@ Paul: yes, can you go ahead and install Google Analytics for testing on our staging site?
* Gerv can provide some context on when / how staging is moving -- he's been working on that.
@ Gerv: Gerv, should we file a bug to get awstats installed? Can you file it?
Comment 8•15 years ago
|
||
I got an error trying to upload to SVN , investigating ..
paul@paul-desktop:~/Development/drumbeat/sites/all/modules/contrib$ svn status
? google_analytics
? google_analytics-6.x-2.2.tar.gz
paul@paul-desktop:~/Development/drumbeat/sites/all/modules/contrib$ svn commit -m "uploading google_analytics bug #549384"
Adding contrib/google_analytics
svn: Commit failed (details follow):
svn: Server sent unexpected return value (403 Forbidden) in response to CHECKOUT request for '/!svn/ver/63642/projects/crm/trunk/sites/all/modules/contrib'
paul@paul-desktop:~/Development/drumbeat/sites/all/modules/contrib$ svn info
Path: .
URL: https://svn.mozilla.org/projects/crm/trunk/sites/all/modules/contrib
Repository Root: https://svn.mozilla.org
Repository UUID: 4eb1ac78-321c-0410-a911-ec516a8615a5
Revision: 64503
Node Kind: directory
Schedule: normal
Last Changed Author: mvalasek@trellon.com
Last Changed Rev: 63642
Last Changed Date: 2010-03-03 15:43:01 +0000 (Wed, 03 Mar 2010)
Comment 9•15 years ago
|
||
@ Gerv: any thoughts on what may have caused Paul's SVN upload issue?
Comment 10•15 years ago
|
||
Paul: you seem to have checked out using https://, whereas you should have used svn+ssh://. See:
https://wiki.mozilla.org/SVN
(which, admittedly, isn't very clear).
That page does say something about using an LDAP account, but I've never done that.
gerv@kitten:/usr/src/crm$ svn info
Path: .
URL: svn+ssh://svn.mozilla.org/projects/crm/trunk
Repository Root: svn+ssh://svn.mozilla.org
Repository UUID: 4eb1ac78-321c-0410-a911-ec516a8615a5
Revision: 64360
Node Kind: directory
Schedule: normal
Last Changed Author: mpriest@trellon.com
Last Changed Rev: 64077
Last Changed Date: 2010-03-11 19:57:57 +0000 (Thu, 11 Mar 2010)
gerv@kitten:/usr/src/crm$
Gerv
Comment 11•15 years ago
|
||
Thanks Gerv.
I'll try again ..
Comment 12•15 years ago
|
||
I can checkout "crm" using my LDAP username (no password was requested?) but i can't later commit. This approach works fine for spreadfirefox / spreadthunderbird . I would like to use https:// approach if possible as i currently have my VPS servers and workstation configured to do SSH on an alternate port to the standard 22
svn co https://paul%40glaxstar.com@svn.mozilla.org/projects/crm/trunk .
paul@paul-desktop:~/Development/drumbeat/sites/all/modules/contrib$ svn commit -m "uploading google_analytics bug #549384"
Adding contrib/google_analytics
svn: Commit failed (details follow):
svn: Server sent unexpected return value (403 Forbidden) in response to CHECKOUT request for '/!svn/ver/63642/projects/crm/trunk/sites/all/modules/contrib'
Comment 13•15 years ago
|
||
Hmm. Perhaps you don't have access to the crm tree. File a bug on IT to get them to check, and enable you if you don't have it. CC me in case some vouching is required, although it shouldn't be.
Gerv
Comment 14•15 years ago
|
||
Thanks Gerv,
Can you advise which product / component i need to use here? or send a link??
Best,
Paul Booker
Comment 15•15 years ago
|
||
Comment 16•15 years ago
|
||
Just tried again ..
paul@paul-desktop:~/Development/drumbeat/sites/all/modules/contrib/google_analytics$ svn commit -m "uploading google_analytics bug #549384"
Adding google_analytics
svn: Commit failed (details follow):
svn: Server sent unexpected return value (403 Forbidden) in response to CHECKOUT request for '/!svn/ver/63642/projects/crm/trunk/sites/all/modules/contrib'
paul@paul-desktop:~/Development/drumbeat/sites/all/modules/contrib/google_analytics$
paul@paul-desktop:~/Development/drumbeat/sites/all/modules/contrib/google_analytics$ svn info
Path: .
URL: https://paul%40glaxstar.com@svn.mozilla.org/projects/crm/trunk/sites/all/modules/contrib/google_analytics
Repository Root: https://paul%40glaxstar.com@svn.mozilla.org
Repository UUID: 4eb1ac78-321c-0410-a911-ec516a8615a5
Revision: 0
Node Kind: directory
Schedule: add
Best,
Paul Booker
Appcoast
Comment 17•15 years ago
|
||
Did you check out a fresh copy, making sure that you used your credentials?
Gerv
Comment 18•15 years ago
|
||
I downloaded a fresh copy using the following link ..
https://paul%40glaxstar.com@svn.mozilla.org/projects/crm/trunk/sites/all/modules/contrib/google_analytics
.. but couldn't commit as before.
I'll investigate the problem in the morning.
Best,
Paul Booker
Appcoast
Comment 19•15 years ago
|
||
@Gerv
Can you help me please to figure out how to pull the code out of SVN using ..
svn co svn+ssh://svn.mozilla.org/projects/crm/trunk .
You could try the following ..
1. Confirm that i have Mozilla SVN write access
2. If i have Mozilla SVN write access have a look at the SVN logs they should indicate what's wrong my end
Best,
Paul Booker
Appcoast
Comment 20•15 years ago
|
||
@Gerv
Can you install Google Analytics on Drumbeat stage server ?
Best,
Paul Booker
Appcoast
Comment 21•15 years ago
|
||
(In reply to comment #19)
> You could try the following ..
>
> 1. Confirm that i have Mozilla SVN write access
Didn't we just do that over in bug 554275? I have no way of doing this myself - it's an IT thing.
> 2. If i have Mozilla SVN write access have a look at the SVN logs they should
> indicate what's wrong my end
If you are still having trouble, the best thing to do is to reopen that bug.
(In reply to comment #20)
> Can you install Google Analytics on Drumbeat stage server ?
Two possible answers to that question:
1) Is it worth finding out what happens about bug 554342 first?
2) How would I do that? Is it a Drupal module? If so, aren't those installed by checking them into SVN and then updating the code on the staging server?
Gerv
Comment 22•15 years ago
|
||
1. No, There's no reason to wait.
2. It's a drupal module. I'll install the Google Analytics module later today Gerv as soon as i have resolved my SVN problem
Thanks for you patience.
Best,
Paul Booker
Appcoast
Updated•15 years ago
|
Summary: need to implement site metrics tracking → Implement site metrics tracking
Comment 23•15 years ago
|
||
Update on installing the Google Analytics module for future reference ..
It was brought to our attention that we can't use the Google Analytics service as the TOS have not been approved by the legal team at Mozilla
Best,
Paul Booker
Appcoast
Assignee: paulbooker → nobody
Comment 24•15 years ago
|
||
@Matt ,
I have access to the Drumbeat Awstats page .
If Michael's critique on Metrics is captured in the Wiki , i think we can close this bug.
Best,
Paul Booker
Whiteboard: server-statistics
Comment 25•15 years ago
|
||
@Matt
I'll close this bug as we have implemented the tracking of site metrics with the help of awstats. We can discuss other ways of tracking site metrics outside of bugzilla on our Wiki...
Best,
Paul Booker
Appcoast
Status: UNCONFIRMED → RESOLVED
Closed: 15 years ago
Resolution: --- → FIXED
Assignee | ||
Updated•10 years ago
|
Product: Websites → Websites Graveyard
You need to log in
before you can comment on or make changes to this bug.
Description
•