Closed Bug 775352 Opened 12 years ago Closed 12 years ago

No robots.txt on developer-new

Categories

(developer.mozilla.org Graveyard :: Wiki pages, defect, P2)

Product:
developer.mozilla.org Graveyard
Component:
Wiki pages
Platform:
x86_64
Linux
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: openjck, Unassigned)

References

Details

(Whiteboard: u= c= s= p=) 

There is currently no robots.txt on developer-new.

developer: https://developer.mozilla.org/robots.txt
developer-new: https://developer-new.mozilla.org/robots.txt
Priority: -- → P1
Blocks: 771763
Do we need a robots.txt? And before launch?

e.g. Anything in particular we want to prevent being indexed? Maybe templates, but I'm not all that concerned about them.
I agree this isn't a blocker.
Understood. Thanks.
No longer blocks: 771763
Priority: P1 → P2
When we have a sitemap.xml files, we'll want to have a robots.txt with:

Sitemap: http://davidwalsh.name/sitemap.xml.gz

But until then, I don't know that we need one.
Depends on: 780740
Version: Kuma → unspecified
Component: Website → Landing pages
Happened due to comment 4.
Status: NEW → RESOLVED
Closed: 12 years ago
Resolution: --- → FIXED
Product: developer.mozilla.org → developer.mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.