Closed Bug 254478 Opened 21 years ago Closed 21 years ago

robots.txt does not disallow /webalizer, mozilla.org is being referrer-spammed

Categories

(mozilla.org Graveyard :: Server Operations, task)

Product:
mozilla.org Graveyard
Component:
Server Operations
Type:
task
Priority:
Not set
Severity:
minor

Tracking

(Not tracked)

Status:
VERIFIED FIXED

People

(Reporter: drbrain-bugzilla, Assigned: myk)

References

(
URL
)

Details

Google is showing mozilla.org's Webalizer statistics, which is promoting pr0n-referrer-spammers to spam mozilla.org with links to pr0n sites. http://google.com/search?q=allintitle%3A%22usage+statistics%22+site%3Amozilla.org Adding the following to http://www.mozilla.org/robots.txt will remove the usage statistics from searchability: Disallow: * /webalizer In the listed referrers I'm seeing an asian thumbs gallery near the top, and several online cassinos further down.
Err, I'm a moron! Add: Disallow: /webalizer below the disallow line for /webtools
Done. Should go live in an hour or so.
Status: NEW → RESOLVED
Closed: 21 years ago
Resolution: --- → FIXED
VERIFIED /webalizer shows in robots.txt
Status: RESOLVED → VERIFIED
Product: mozilla.org → mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.