Closed Bug 513483 Opened 16 years ago Closed 16 years ago

Robots allowed to download firefox add-ons

Categories

(addons.mozilla.org Graveyard :: Statistics, defect)

Product:
addons.mozilla.org Graveyard
Component:
Statistics
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 512528

People

(Reporter: u278084, Unassigned)

References

(
URL
)

Details

I noticed that our robots.txt file (see URL) does not disallow /en-US/firefox/downloads/ and similar urls for other languages and products. I wonder if this is causing the download count to be misreported in the statistics dashboard and add-on public page.
Daniel will know the answer to this
I will know... after you guys answer bug 512528. I've seen the spider downloads as well. We currently aren't filtering them in ETL, but there isn't any filter I could do that would be 100% reliable. Unless there is some use in allowing spiders to download, I'd recommend adding an entry to robots.txt
Status: NEW → RESOLVED
Closed: 16 years ago
Resolution: --- → DUPLICATE
Product: addons.mozilla.org → addons.mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.