Status

defect
VERIFIED FIXED
9 years ago
3 years ago

People

(Reporter: clouserw, Assigned: paul)

Tracking

unspecified
5.12.9

Details

(Whiteboard: [good first bug])

Reporter

Description

9 years ago
We have a robots.txt that disallows crawlers, but Google still indexes the pages if anyone else links to them.  If we add a <meta> tag to the pages it will prevent them from going in google's index.  See http://www.google.com/support/webmasters/bin/answer.py?answer=93710 for details.

The meta tag should be in the main template and have an {% if not settings.ENGAGE_ROBOTS %} around it.

Marking this as a good first bug since it's a 3 line change and I've spelled it out pretty well (I hope).
Reporter

Comment 1

8 years ago
I think putting this in templates/base.html covers us.
Assignee: nobody → paulbooker
Assignee

Comment 2

8 years ago
Thanks Wil, just wanted to let you know that i'm going to work on this now ..

Best,
Paul Booker
Appcoast
Reporter

Comment 3

8 years ago
https://github.com/jbalogh/zamboni/commit/f8a983e38a897859c537ddda683ba43a7a59ddfb
Status: NEW → RESOLVED
Last Resolved: 8 years ago
Resolution: --- → FIXED
Target Milestone: 4.x (triaged) → 5.12.9
Verified FIXED (code, not, obviously, the Google/bot-blocking behavior, yet):

<meta charset="utf-8">
              <meta name="robots" content="noindex">
          <title>Manage My Add-ons :: Developer Hub :: Add-ons</title>
Status: RESOLVED → VERIFIED
Product: addons.mozilla.org → addons.mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.