Closed Bug 897080 Opened 11 years ago Closed 7 years ago

Adjust robots.txt to not block /firefox/download/ in final stages of unified download project

Categories

(www.mozilla.org :: General, defect)

x86
macOS
defect
Not set
normal

Tracking

(Not tracked)

RESOLVED INVALID

People

(Reporter: cmore, Unassigned)

References

Details

(Whiteboard: [kb=1057833] )

The current robots.txt file on mozilla.org is:

User-agent: *
Disallow: /*/download/
Disallow: /*/whatsnew/
Disallow: /*/firstrun/
Disallow: /b/*

Before we could ever rename /firefox/new/ to /firefox/download/, we will need to adjust the robots.txt file to not block that from being spidered. This change will only happen later in the unified project.

Hold this for now.
Component: Pages & Content → General
Whiteboard: [kb=1057833]
No longer blocks: 868199
Depends on: 868199
no longer valid
Status: NEW → RESOLVED
Closed: 7 years ago
Resolution: --- → INVALID
You need to log in before you can comment on or make changes to this bug.