Closed Bug 465403 Opened 16 years ago Closed 16 years ago

need robots.txt file to prevent bots from spidering all crashes.

Categories

(Socorro :: General, task)

Product:
Socorro
Component:
General
Type:
task
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: aravind, Assigned: morgamic)

References

(
URL
)

Details

I see bots spidering the current crash stats and pulling in every uuid there is.  Can we get a robots.txt file added?  I am not sure where I should be putting it in, or I'd do it myself.
http://code.google.com/p/socorro/source/detail?r=699
Assignee: nobody → morgamic
Status: NEW → RESOLVED
Closed: 16 years ago
Keywords: push-needed
Resolution: --- → FIXED
Keywords: push-needed
Component: Socorro → General
Product: Webtools → Socorro
You need to log in before you can comment on or make changes to this bug.