Closed Bug 608003 Opened 15 years ago Closed 15 years ago

stage mdn.staging.mozilla.com and developer-stage.mozilla.org need better robots.txt

Categories

(mozilla.org Graveyard :: Server Operations, task)

Product:
mozilla.org Graveyard
Component:
Server Operations
Platform:
All
Other
Type:
task
Priority:
Not set
Severity:
minor

Tracking

(Not tracked)

Status:
VERIFIED FIXED

People

(Reporter: ozten, Assigned: fox2mike)

Details

We need to fix 2 robots.txt files as our stage is getting indexed by search engines. 1) Django Please add Alias /robots.txt /media/robots.txt curl http://mdn.staging.mozilla.com/robots.txt and make sure it says Disallow: / 2) Deki The robots.txt at https://developer-stage.mozilla.org/robots.txt is the same as the production config. Please overwrite it with User-agent: * Disallow: /
Summary: stage mdn.staging.mozilla.com and → stage mdn.staging.mozilla.com and developer-stage.mozilla.org need better robots.txt
MDN done, Over to oremj for Deki
Assignee: server-ops → jeremy.orem+bugs
I got Deki too.
Assignee: jeremy.orem+bugs → shyam
Status: NEW → RESOLVED
Closed: 15 years ago
Resolution: --- → FIXED
verified fixed
Status: RESOLVED → VERIFIED
Product: mozilla.org → mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.