Closed
Bug 887939
Opened 13 years ago
Closed 11 years ago
Create widgets: "X Most Popular in Last Y Days" and "Last X Edits"
Categories
(Websites :: wiki.mozilla.org, enhancement)
Websites
wiki.mozilla.org
Tracking
(Not tracked)
RESOLVED
WONTFIX
People
(Reporter: gerv, Assigned: mah)
Details
(Whiteboard: [featurerequest])
We would like to bring a bit of dynamism to the front page of wiki.mozilla.org and show people what's popular and what's current. One way to do this would be to list the X most popular pages in last Y days (for configurable X and Y) and the last X edits (for configurable X). Can we have plugins created which provide this info?
Gerv
| Assignee | ||
Comment 1•13 years ago
|
||
Since you guys are using SMW, this might be easier than I initially thought.
In any case, yes, I can provide this.
| Assignee | ||
Comment 2•13 years ago
|
||
posted query for info to the smw-devel list: https://sourceforge.net/mailarchive/forum.php?thread_name=51CC9381.1090200%40everybody.org&forum_name=semediawiki-devel
| Assignee | ||
Comment 3•13 years ago
|
||
Charts and stuff is available on WikiApiary: http://wikiapiary.com/wiki/MozillaWiki
The owner (thingles in #wikiapiary on freenode) says he'd like to offer an embeddable widget. Or maybe there already is one.
| Assignee | ||
Comment 4•13 years ago
|
||
Ftrott in #semantic-mediawiki says this should to the second bit: {{#ask:[[Modification date::+]]|?Modification date|sort=Modification date|order=desc|limit=5}}
Comment 5•13 years ago
|
||
(In reply to Mark A. Hershberger (hexmode) from comment #4)
> Ftrott in #semantic-mediawiki says this should to the second bit:
Just tested this - works fine.
| Reporter | ||
Comment 6•13 years ago
|
||
The first may be tricky if the wiki does not already store useful data about which pages are "popular". There is this:
https://wiki.mozilla.org/Special:PopularPages
but that gives hits since the beginning of time, which means it is not helpful information.
We now have the data from Google Analytics, but it's not obvious how to get it from there into the front page - unless we write a script to do that once a day. Does Google Analytics have a data extraction API?
We could hack it up by resetting the stored data every week, and generating a static list at the end of that week (just before the next reset) to be used for all of the following week. But that would lose us the historical aggregate info.
Gerv
| Assignee | ||
Comment 7•13 years ago
|
||
I don't think this can be done out of the box, but it is something other MediaWiki users would be interested in, so I'd like to code it up.
The Google Analytics hack you mention would be a good interim solution, though.
Comment 8•13 years ago
|
||
(In reply to Gervase Markham [:gerv] from comment #6)
> The first may be tricky if the wiki does not already store useful data about which pages are "popular".
Can I ask what your definition of 'popular' is? I ask as, for example, if it is 'most hits from anyone on the web' for a given page that could be gamed by spammers fairly easily (I've just zapped almost 4000 spam pages from wiki.m.o over the last couple of days according to the http://wikiapiary.com/wiki/MozillaWiki chart) and even if it is 'most hits by registered users' that won't necessarily be much better as there are (conservatively) many thousands of spammer accounts at the moment. I suppose the preferred option would be 'most hits by active users' of which there around 1074, but I'm not sure how possible that data would be to capture or filter to.
| Assignee | ||
Comment 9•13 years ago
|
||
(In reply to Alison Wheeler [:AlisonW] from comment #8)
> Can I ask what your definition of 'popular' is?
That is the key question. If we can get clear guidance on this, everything should fall into place.
> I suppose the preferred option would be 'most hits by active users' of
> which there around 1074, but I'm not sure how possible that data would
> be to capture or filter to.
1074 isn't a round ("around") number. How did you get it?
If you can tell me how you got it, then we can come up with a process to see what pages those people were interested in (edited? viewed?) while they were logged in.
| Reporter | ||
Comment 10•13 years ago
|
||
AlisonW: I'm not aware of any reason that spammers would choose to load the same page over and over. But I think we should use either "most hits", or "most hits from registered users" and see what it looks like to begin with.
Gerv
Comment 11•13 years ago
|
||
(In reply to Mark A. Hershberger (hexmode) from comment #9)
> 1074 isn't a round ("around") number. How did you get it?
1074 is the number of 'active users' per the chart on wikapiary - how he got it I've no idea! (yes, I trusted uncalibrated data ... mea culpa ;-P ) If anything the number seems high.
> If you can tell me how you got it, then we can come up with a process to see
> what pages those people were interested in (edited? viewed?) while they were
> logged in.
btw, I liked wikiapiary's captcha method - might see if it works for us. I'll hopefully be at the point within the next 7-10 days where we can zap most of the spam-registered users directly from the database table and with a better filter on spam registrations we'll hopefully have more control and a valid metric on 'users'.
Comment 12•13 years ago
|
||
(In reply to Gervase Markham [:gerv] from comment #10)
> AlisonW: I'm not aware of any reason that spammers would choose to load the
> same page over and over.
I've been surprised at some of the spam links we had, but the simple reason would be to game the top entry/ies to be their spam-content pages. Reducing their number is, of course, the best option and is something I'm working on (and already actively reducing)
> But I think we should use either "most hits", or
> "most hits from registered users" and see what it looks like to begin with.
Yes, especially as I suspect the numbers are comparatively small - many pages are unlinked to others presently so are only accessed by those who already know the direct url
| Reporter | ||
Comment 13•13 years ago
|
||
Alison: your hard anti-spam work is appreciated :-)
Gerv
Comment 14•13 years ago
|
||
Hi, is there any way we could not have this at the top of the main page? When I saw it I believed that someone had hacked the front page and was using it to display their spam link pages. It was literally a list of spam pages.
Until we have a system for defending ourselves against the addition of spam pages, those widgets are going to be less useful than just having the static links to meeting pages and such.
I removed the widget because I honestly believed it was a hack, which means it's a problem.
Gerv: thoughts?
Comment 15•13 years ago
|
||
I concur, until we've got the better registration checking in place anyway.
Comment 16•13 years ago
|
||
Fine to keep it off for now, but note that the existing set of static links isn't ideal either -- there are lots of links to very old content and other important pages aren't listed.
Long-term it feels like having a dynamic set of links that show current activity is better than trying to keep a directory style list of links manually updated.
Comment 17•13 years ago
|
||
I'd love to hear other opinions, but in my experience / view, most active users of the wiki will go direct to the page(s) they use and very rarely - if ever - visit the home / front page. I agree those static links don't look great, not because they might be outdated, but because they give no explanation of what they lead to. Unless you know the name of the particular project you aren't going to discover anything by just a list of names.
I believe that, especially with the expanding internet in all things Mozilla due to FxOS, etc, we need to move the front page to be more of a "shop window" of what information is available within the wiki. This will mean moving some of the present content (where outdated and superseded) to a lower 'section' of the page, headed 'archive' or similar. The existing list could be retained on the 'Community Portal' page (linked from all pages via left menu) or on another link to be named.
I fully accept the principle put by others that people (devs) who use the wiki don't want to see anything moved around, but I'd suggest that their are multiple audiences for the content, and new arrivals will be the ones landing on the main page, needing help on where to go next.
| Assignee | ||
Comment 18•13 years ago
|
||
If we could show two different lists -- one to authenticated users and one to new users -- might that work?
The authenticated spam fighters would see a fresh list and have 24 hours to get rid of any spsm. After 24 hours, new users could see newly created pages.
Another idea is to see if we can make use of Wikipedia's spam blacklist. Things like https://en.wikipedia.org/wiki/MediaWiki:Titleblacklist and https://en.wikipedia.org/wiki/MediaWiki:Spam-blacklist. If we decide we can trust those, then they could be updated nightly or as needed.
Comment 19•13 years ago
|
||
The 'two lists' idea could probably work, especially as in our case almost zero pages are actually linked from elsewhere on the site.
We already use the MW spam blacklist but the problem there is that it is domain level blocking and many of the links are to pages like the spam ones being created here: on valid domains we wouldn't want to block. URL-shortening is also an issue here, of course.
The Titleblacklist shows a lot of promise though. Start with 'instagram' and work through the keywords the spammers currently use (until, of course, they 1337 it or similar). The WP list is primarily anti-*vandalism* but should be easy enough to create a version for our use. I'll get on this, and post the word list I create here.
Comment 20•13 years ago
|
||
So 40 minutes of going through recent deletions and picking out words and short phrases which probably won't be in 'real' articles on wiki.m.o I end up with the list below. It will, clearly, stop some page creations for a while *but* it won't do anything about the 'user' pages which the spammers also usually create a few seconds before the mainspace spam page (indeed this is one of the easiest ways to recognise that they _are_ a spammer when looking down the list of recent page creations across all namespaces, which means doing this might actually make removing spam slower...)
actually works
advert
advertise
advice
affiliate marketing
age defying
amazing
american people
attractive
auction
backlink
backlinks
bail bonds
benefit
body art
boobs
boyfriend
breastfeeding
bride
bridegroom
buy
car rental
card game
cellulite
certainly
charm
chien
cholesterol
christian
cigarette
cleanse
clipping
consolidating
consolidation
contractor
coupon
coupons
crack
credit report
dancing
dating
deadpool
decide
deciding
dentist
dictionary
diet plan
diet plans
discover
disease
diving
dresses
easily
effective
ejaculation
electrical
erectile
exotic
expensive
explain
explaining
eye cream
fantastic
farming
federal
felon
felons
find out
flooring
followers
food
foodstuff
for adults
for beginners
for men
for women
from home
fungus
furnishings
furniture
gentlemen
genuine
get my ex back
get your ex back
girlfriend
gluten
grocery
hassle-free
healthy
height
helpful
home business
horoscope
horse
how to hack
how to succeed
how to tell
husband
income
increase
increasing
incredible
inexpensive
insightful
insights
instagram
insurance
insure
job search
keygen
ladies
linkbuilding
loans
lover
massage
massive
money
monogram
mortgage
movies
muscle
need a loan
ointment
online dating
opportunity
outlet store
painless
payday
poisson
profit
property manaement
psychic
quotes
ranking
rankings
really
remedies
remedy
rental
reputation
revealed
search engines
secrets
sell
selling
seo
sewer
skin
social media
speedy
success
successful
suggestions
superfoods
the truthfuerectile
thoughts on
thuth
tips
to buy
top tips
torrent
traffic
truthful
try
ultrasound
understanding
vacation
very best way
vuitton
water
weight
wide
win back your ex
wrinkle
your company
your life
| Reporter | ||
Comment 21•13 years ago
|
||
I agree with dria that deployment of this widget only makes sense when the info it provides it useful, rather than spam. If we can achieve that (either by changing the way the widget works, or getting better at spam fighting, or both), then we can deploy.
Gerv
Comment 22•13 years ago
|
||
(In reply to Alison Wheeler [:AlisonW] from comment #17)
> and new arrivals will be the ones
> landing on the main page, needing help on where to go next.
I definitely agree with this. The main page does get a substantial amount of traffic ('This page has been accessed 6,318,653 times' from the footer) so it's worth making it better for the audience that is likely new and trying to figure out where to go.
Comment 23•13 years ago
|
||
I've started work on reworking the front page, mainly (so far) by adding some colour in the form of logos, and reducing the wide open spaces of one word per line by changing to a two-column structure.
I've noted that some of the links on the present front page are duplicated (even triplicated), and I can track these down, but I could do with assistance on knowing which projects are still current and which others can move to the "archive" heading (which can be split to a separate page when it gets too long).
Could I get some thoughts from you all please, and feel free to get more input!
https://wiki.mozilla.org/Main_Page/development
Updated•12 years ago
|
Whiteboard: [featurerequest]
Comment 24•11 years ago
|
||
Spam has long been taken care of and the main page has long been redesigned. The sidebar has links to recent changes and recent uploads.
Creating these "widgets" would be too complex and time-consuming for their benefit, and their functionality would be mostly redundant.
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → WONTFIX
You need to log in
before you can comment on or make changes to this bug.
Description
•