[SEO] Prevent indexing of non-production domains

RESOLVED FIXED

Status

RESOLVED FIXED
6 years ago
6 years ago

People

(Reporter: MattN, Unassigned)

Tracking

(Blocks: 1 bug)

Firefox Tracking Flags

(Not tracked)

Details

(URL)

www.mozilla.org dev/test sites on allizom.org are getting indexed by search engines.  This should be prevented via the robots.txt.

https://www-dev.allizom.org/robots.txt seems to disallow everything but not https://www.allizom.org/robots.txt
Assignee: nobody → server-ops-webops
Component: General → Server Operations: Web Operations
Product: www.mozilla.org → mozilla.org
QA Contact: cshields
Version: unspecified → other
Implementing canonical URLs can do so, see Bug 481550.

Comment 2

6 years ago
Moving to webdev... we (IT/webops) don't manage the actual content on these sites (of which robots.txt is a part).
Assignee: server-ops-webops → nobody
Component: Server Operations: Web Operations → General
Product: mozilla.org → www.mozilla.org
QA Contact: cshields
www.allizom.org seems to be disallowing robots now.
Status: NEW → RESOLVED
Last Resolved: 6 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.