Closed Bug 802974 Opened 12 years ago Closed 11 years ago

[SEO] Prevent indexing of non-production domains

Categories

(www.mozilla.org :: General, defect)

Product:
www.mozilla.org
Component:
General
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: MattN, Unassigned)

References

(Blocks 1 open bug,
URL
)

Details

www.mozilla.org dev/test sites on allizom.org are getting indexed by search engines.  This should be prevented via the robots.txt.

https://www-dev.allizom.org/robots.txt seems to disallow everything but not https://www.allizom.org/robots.txt
Assignee: nobody → server-ops-webops
Component: General → Server Operations: Web Operations
Product: www.mozilla.org → mozilla.org
QA Contact: cshields
Version: unspecified → other
Implementing canonical URLs can do so, see Bug 481550.
Moving to webdev... we (IT/webops) don't manage the actual content on these sites (of which robots.txt is a part).
Assignee: server-ops-webops → nobody
Component: Server Operations: Web Operations → General
Product: mozilla.org → www.mozilla.org
QA Contact: cshields
Blocks: 745355
www.allizom.org seems to be disallowing robots now.
Status: NEW → RESOLVED
Closed: 11 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.