Closed Bug 887939 Opened 13 years ago Closed 11 years ago

Create widgets: "X Most Popular in Last Y Days" and "Last X Edits"

Categories

(Websites :: wiki.mozilla.org, enhancement)

enhancement
Not set
normal

Tracking

(Not tracked)

RESOLVED WONTFIX

People

(Reporter: gerv, Assigned: mah)

Details

(Whiteboard: [featurerequest])

We would like to bring a bit of dynamism to the front page of wiki.mozilla.org and show people what's popular and what's current. One way to do this would be to list the X most popular pages in last Y days (for configurable X and Y) and the last X edits (for configurable X). Can we have plugins created which provide this info? Gerv
Since you guys are using SMW, this might be easier than I initially thought. In any case, yes, I can provide this.
Charts and stuff is available on WikiApiary: http://wikiapiary.com/wiki/MozillaWiki The owner (thingles in #wikiapiary on freenode) says he'd like to offer an embeddable widget. Or maybe there already is one.
Ftrott in #semantic-mediawiki says this should to the second bit: {{#ask:[[Modification date::+]]|?Modification date|sort=Modification date|order=desc|limit=5}}
(In reply to Mark A. Hershberger (hexmode) from comment #4) > Ftrott in #semantic-mediawiki says this should to the second bit: Just tested this - works fine.
The first may be tricky if the wiki does not already store useful data about which pages are "popular". There is this: https://wiki.mozilla.org/Special:PopularPages but that gives hits since the beginning of time, which means it is not helpful information. We now have the data from Google Analytics, but it's not obvious how to get it from there into the front page - unless we write a script to do that once a day. Does Google Analytics have a data extraction API? We could hack it up by resetting the stored data every week, and generating a static list at the end of that week (just before the next reset) to be used for all of the following week. But that would lose us the historical aggregate info. Gerv
I don't think this can be done out of the box, but it is something other MediaWiki users would be interested in, so I'd like to code it up. The Google Analytics hack you mention would be a good interim solution, though.
(In reply to Gervase Markham [:gerv] from comment #6) > The first may be tricky if the wiki does not already store useful data about which pages are "popular". Can I ask what your definition of 'popular' is? I ask as, for example, if it is 'most hits from anyone on the web' for a given page that could be gamed by spammers fairly easily (I've just zapped almost 4000 spam pages from wiki.m.o over the last couple of days according to the http://wikiapiary.com/wiki/MozillaWiki chart) and even if it is 'most hits by registered users' that won't necessarily be much better as there are (conservatively) many thousands of spammer accounts at the moment. I suppose the preferred option would be 'most hits by active users' of which there around 1074, but I'm not sure how possible that data would be to capture or filter to.
(In reply to Alison Wheeler [:AlisonW] from comment #8) > Can I ask what your definition of 'popular' is? That is the key question. If we can get clear guidance on this, everything should fall into place. > I suppose the preferred option would be 'most hits by active users' of > which there around 1074, but I'm not sure how possible that data would > be to capture or filter to. 1074 isn't a round ("around") number. How did you get it? If you can tell me how you got it, then we can come up with a process to see what pages those people were interested in (edited? viewed?) while they were logged in.
AlisonW: I'm not aware of any reason that spammers would choose to load the same page over and over. But I think we should use either "most hits", or "most hits from registered users" and see what it looks like to begin with. Gerv
(In reply to Mark A. Hershberger (hexmode) from comment #9) > 1074 isn't a round ("around") number. How did you get it? 1074 is the number of 'active users' per the chart on wikapiary - how he got it I've no idea! (yes, I trusted uncalibrated data ... mea culpa ;-P ) If anything the number seems high. > If you can tell me how you got it, then we can come up with a process to see > what pages those people were interested in (edited? viewed?) while they were > logged in. btw, I liked wikiapiary's captcha method - might see if it works for us. I'll hopefully be at the point within the next 7-10 days where we can zap most of the spam-registered users directly from the database table and with a better filter on spam registrations we'll hopefully have more control and a valid metric on 'users'.
(In reply to Gervase Markham [:gerv] from comment #10) > AlisonW: I'm not aware of any reason that spammers would choose to load the > same page over and over. I've been surprised at some of the spam links we had, but the simple reason would be to game the top entry/ies to be their spam-content pages. Reducing their number is, of course, the best option and is something I'm working on (and already actively reducing) > But I think we should use either "most hits", or > "most hits from registered users" and see what it looks like to begin with. Yes, especially as I suspect the numbers are comparatively small - many pages are unlinked to others presently so are only accessed by those who already know the direct url
Alison: your hard anti-spam work is appreciated :-) Gerv
Hi, is there any way we could not have this at the top of the main page? When I saw it I believed that someone had hacked the front page and was using it to display their spam link pages. It was literally a list of spam pages. Until we have a system for defending ourselves against the addition of spam pages, those widgets are going to be less useful than just having the static links to meeting pages and such. I removed the widget because I honestly believed it was a hack, which means it's a problem. Gerv: thoughts?
I concur, until we've got the better registration checking in place anyway.
Fine to keep it off for now, but note that the existing set of static links isn't ideal either -- there are lots of links to very old content and other important pages aren't listed. Long-term it feels like having a dynamic set of links that show current activity is better than trying to keep a directory style list of links manually updated.
I'd love to hear other opinions, but in my experience / view, most active users of the wiki will go direct to the page(s) they use and very rarely - if ever - visit the home / front page. I agree those static links don't look great, not because they might be outdated, but because they give no explanation of what they lead to. Unless you know the name of the particular project you aren't going to discover anything by just a list of names. I believe that, especially with the expanding internet in all things Mozilla due to FxOS, etc, we need to move the front page to be more of a "shop window" of what information is available within the wiki. This will mean moving some of the present content (where outdated and superseded) to a lower 'section' of the page, headed 'archive' or similar. The existing list could be retained on the 'Community Portal' page (linked from all pages via left menu) or on another link to be named. I fully accept the principle put by others that people (devs) who use the wiki don't want to see anything moved around, but I'd suggest that their are multiple audiences for the content, and new arrivals will be the ones landing on the main page, needing help on where to go next.
If we could show two different lists -- one to authenticated users and one to new users -- might that work? The authenticated spam fighters would see a fresh list and have 24 hours to get rid of any spsm. After 24 hours, new users could see newly created pages. Another idea is to see if we can make use of Wikipedia's spam blacklist. Things like https://en.wikipedia.org/wiki/MediaWiki:Titleblacklist and https://en.wikipedia.org/wiki/MediaWiki:Spam-blacklist. If we decide we can trust those, then they could be updated nightly or as needed.
The 'two lists' idea could probably work, especially as in our case almost zero pages are actually linked from elsewhere on the site. We already use the MW spam blacklist but the problem there is that it is domain level blocking and many of the links are to pages like the spam ones being created here: on valid domains we wouldn't want to block. URL-shortening is also an issue here, of course. The Titleblacklist shows a lot of promise though. Start with 'instagram' and work through the keywords the spammers currently use (until, of course, they 1337 it or similar). The WP list is primarily anti-*vandalism* but should be easy enough to create a version for our use. I'll get on this, and post the word list I create here.
So 40 minutes of going through recent deletions and picking out words and short phrases which probably won't be in 'real' articles on wiki.m.o I end up with the list below. It will, clearly, stop some page creations for a while *but* it won't do anything about the 'user' pages which the spammers also usually create a few seconds before the mainspace spam page (indeed this is one of the easiest ways to recognise that they _are_ a spammer when looking down the list of recent page creations across all namespaces, which means doing this might actually make removing spam slower...) actually works advert advertise advice affiliate marketing age defying amazing american people attractive auction backlink backlinks bail bonds benefit body art boobs boyfriend breastfeeding bride bridegroom buy car rental card game cellulite certainly charm chien cholesterol christian cigarette cleanse clipping consolidating consolidation contractor coupon coupons crack credit report dancing dating deadpool decide deciding dentist dictionary diet plan diet plans discover disease diving dresses easily effective ejaculation electrical erectile exotic expensive explain explaining eye cream fantastic farming federal felon felons find out flooring followers food foodstuff for adults for beginners for men for women from home fungus furnishings furniture gentlemen genuine get my ex back get your ex back girlfriend gluten grocery hassle-free healthy height helpful home business horoscope horse how to hack how to succeed how to tell husband income increase increasing incredible inexpensive insightful insights instagram insurance insure job search keygen ladies linkbuilding loans lover massage massive money monogram mortgage movies muscle need a loan ointment online dating opportunity outlet store painless payday poisson profit property manaement psychic quotes ranking rankings really remedies remedy rental reputation revealed search engines secrets sell selling seo sewer skin social media speedy success successful suggestions superfoods the truthfuerectile thoughts on thuth tips to buy top tips torrent traffic truthful try ultrasound understanding vacation very best way vuitton water weight wide win back your ex wrinkle your company your life
I agree with dria that deployment of this widget only makes sense when the info it provides it useful, rather than spam. If we can achieve that (either by changing the way the widget works, or getting better at spam fighting, or both), then we can deploy. Gerv
(In reply to Alison Wheeler [:AlisonW] from comment #17) > and new arrivals will be the ones > landing on the main page, needing help on where to go next. I definitely agree with this. The main page does get a substantial amount of traffic ('This page has been accessed 6,318,653 times' from the footer) so it's worth making it better for the audience that is likely new and trying to figure out where to go.
I've started work on reworking the front page, mainly (so far) by adding some colour in the form of logos, and reducing the wide open spaces of one word per line by changing to a two-column structure. I've noted that some of the links on the present front page are duplicated (even triplicated), and I can track these down, but I could do with assistance on knowing which projects are still current and which others can move to the "archive" heading (which can be split to a separate page when it gets too long). Could I get some thoughts from you all please, and feel free to get more input! https://wiki.mozilla.org/Main_Page/development
Whiteboard: [featurerequest]
Spam has long been taken care of and the main page has long been redesigned. The sidebar has links to recent changes and recent uploads. Creating these "widgets" would be too complex and time-consuming for their benefit, and their functionality would be mostly redundant.
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → WONTFIX
You need to log in before you can comment on or make changes to this bug.