Closed Bug 484106 Opened 16 years ago Closed 16 years ago

Easy way to collect stats for Spread Firefox?

Categories

(Websites Graveyard :: spreadfirefox.com, defect)

Product:
Websites Graveyard
Component:
spreadfirefox.com
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
VERIFIED FIXED

People

(Reporter: mary, Assigned: abuchanan)

References

(
URL
)

Details

(Whiteboard: metrics)

Hi folks: Is there a script we can create or module that would help give me an average daily view of: * # of New nodes created (comments & groups) * # of New accounts * # of Sign-ins * # of new replies * # of new affiliates I'd like to be able to assess this pre-launch and then on an-ongoing basis with SFx. Let me know what you think! *
Once you figure how to extract this data, we can consider integrating it into the Mozilla dashboard (metrics.mozilla.com).
Mary Access log settings is most of what your asking for is part of drupal Top visitors in the past 3 days = /admin/logs/visitors "Mary this can be changed up to 16 weeks Top search phrases = admin/logs/search Recent hits = admin/logs/hits Spam module logs = admin/logs/spam Users Watchdog = admin/user/user = Username / Status / Roles /Member for / Last access Operations Settings for the statistical information that Drupal will keep about the site was Disabled it is now Enabled to show the past 3 days * # of new replies new content = admin/content/comment new content = admin/content/node * # of new affiliates maybe something that needs to be added to the Spreadfirefox affiliates module I looking on drupal now for a fancier type of module
It should be possible to a create a "view" of all this information in D6. http://drupal.org/project/views http://store.lullabot.com/products/learning-views
Cool. In the meantime - Alex: who should I ping about doing a manual scrape of this in IT? Thanks!
Per our meeting today, Alex is going to deliver the queries we'll need to run to gather this info today.
> * # of New nodes created (comments & groups) > * # of New accounts > * # of Sign-ins > * # of new replies > * # of new affiliates I can add a function that can count any stats daily in 3.1 Here are some counts I ran on today's DB (3.26.09) * number of users: 254,617 - select count(*) from users; * number of users that have never logged in: 21,7401 - select count(*) from users where login = 0; * number of nodes: 2,388 - select count(*) from node; * number of comments: 3,846 - select count(*) from comments; * number of affiliates: 88,051 - select count(*) from affiliates_referrals - (this query will change with affiliates v2) * number of nodes per type: mysql> select type, count(*) from node group by type; +-----------+----------+ | type | count(*) | +-----------+----------+ | blog | 57 | | document | 210 | | event | 164 | | feeditems | 665 | | forum | 923 | | group | 246 | | image | 109 | | page | 3 | | poll | 1 | | story | 5 | | tasks | 1 | | webform | 4 | +-----------+----------+ Hope that helps! There is lots and lots of room for growth here, and I think we should make use of simple stat tracking for every part of the site (private messages, contact us form submits, tell a friend submits, affiliates traffic stats, etc) We can use daily totals to build trends over time too. cool stuff.
Hey there: Awesome! A few questions: - It is possible to see how many people signed in on a given day? - Does the node count have a timeframe or is this since the beginning? - Does the comment count include replies? Thanks!
(In reply to comment #7) > Hey there: Awesome! > > A few questions: > > - It is possible to see how many people signed in on a given day? User logins for March 26th: 18 - select count(*) from users where login > 1238050800 and login < 1238137140; User logins for March 22nd: 60 - select count(*) from users where login > 1237705200 and login < 1237791540; Since these are more spread out (and a pain to run the queries by hand) I'll have to write a small script to aggregate daily numbers for a whole month. I'll get back to you on that. > - Does the node count have a timeframe or is this since the beginning? Since the beginning > - Does the comment count include replies? Not sure what you mean here, replies to comments? Comment count means all comments on all nodes on the site.
Hey there: On the last question. That is replies to comments - so sounds like your number encompasses that. Thanks and looking forward to the script.
Also, is it possible to get a historical look on users so I can get a sense of growth. In particular it would be good to see what the number of users was as of Jan. 1, 2009 so I can see how it's grown over the quarter. Thanks!
Hey there: Per our meeting today it would be great to see these numbers day by day for the last quarter or at least on Jan 1, Feb 1, March 1 and April 1. Thanks!
Severity: normal → blocker
Target Milestone: 3.5 → 3.0
r24618 commits a simple module for collecting and displaying the following historical stats... - # of new nodes per day, - # of new comments per day, - # of new users per day # of user logins per day isn't possible to find historic data for, because Drupal doesn't keep any record of this. I'll try to add some simple code to track this going forward if it's not much work, but I'd like to work with the metrics team to set up a more permanent solution for tracking and reporting this stat. # of new affiliates is the same story. Nothing exists currently to track this, so no historical data. I can write a temp. solution, but this is another good opportunity to bring in the metrics team. # of new replies is included in # of new comments (per comment #8 & #9)
copying the metrics team...
Hey there: Where is this located? Thanks!
(In reply to comment #14) > Hey there: Where is this located? Thanks! oops, sorry. spreadfirefox.authstage.mozilla.com/admin/stats
I'd like to suggest that we meet at the all hands and talk a bit about this. I had the chance to talk briefly with alex in irc and I think we can help you get some metrics in mmc
(In reply to comment #16) > I'd like to suggest that we meet at the all hands and talk a bit about this. I > had the chance to talk briefly with alex in irc and I think we can help you get > some metrics in mmc agreed. that would be awesome. does someone want to tackle finding a time when we can all meet?
r24742 commits code to count and display user logins daily counting affiliates is also done and will committed along with other affiliates updates
the code for this is causing perf. problems. I've turned off the module for now. I'll have to figure out the problem and refactor some code
r24800 fixes the perf. problem. turning this back on.
This is great btw :)
r24962 checks in the daily new affiliates counting code. i think i just need to make a page to display this info, and that should close this bug out.
moving this to 3.1 to create the affiliates stats display page
Severity: blocker → normal
Target Milestone: 3.0 → 3.1
Whiteboard: metrics
Target Milestone: 3.1 → 3.0.2
OS: Mac OS X → All
Hardware: x86 → All
Target Milestone: 3.0.2 → 3.0.3
Target Milestone: 3.0.3 → 3.0.4
I've worked on a basic stats dashboard on stage, https://spreadfirefox.authstage.mozilla.com/admin/stats It's still a little rough around the edges, but the framework is there. I'll be working on few things to clean it up, and this should make it a lot easier to add new data in the future. Also, note the data on stage is out of date, so the graphs might show some missing data. I'm working on that.
If you're on VPN, you can see a demo with updated production data here, http://abuchanan-sfx.khan.mozilla.org/admin/stats you can log in as 'test.admin' with the password 'test.admin'
Ok, this is on stage at https://spreadfirefox.authstage.mozilla.com/admin/stats It's still a rough around the edges, but it's a great improvement over the tables of data we had. We can file new bugs for improvements to that dashboard. A couple notes... * you can drag on both the full and summary views to zoom in * The points data seems wrong, I'm looking into that * the graphs pull all-time data at first, and you have to zoom in to more recent data. I want to change this to load only a week at first.
Can we see it? It's asking for user/pass...
the user / pass for stage is sfx / sfx
tried that, but I get a page that says Access denied. Do I have to create a SpreadFirefox account to see it? http://screencast.com/t/W0Kesym8TwdU
oh yes, it's an admin panel, so you need an account, and I'll need to add that account to the admin role
I'm going to close this bug and file new bugs for anything remaining.
Status: NEW → RESOLVED
Closed: 16 years ago
Resolution: --- → FIXED
btw, i should mention here, that if you want to log in on stage to see the stats panel, you can use the account username: test.admin password: pass per https://wiki.mozilla.org/Spreadfirefox#Spreadfirefox.stage
Assignee: nobody → buchanae
verified fixed on https://spreadfirefox.authstage.mozilla.com/admin/stats
Status: RESOLVED → VERIFIED
Product: Websites → Websites Graveyard
You need to log in before you can comment on or make changes to this bug.