Status

Websites
Firefox Flicks
VERIFIED FIXED
6 years ago
5 years ago

People

(Reporter: stephend, Assigned: mkelly)

Tracking

Details

(Whiteboard: [fromAutomation], URL)

(Reporter)

Description

6 years ago
There's no robots.txt file: https://firefoxflicks-dev.allizom.org/robots.txt

Comment 1

5 years ago
will do for 2013 site.. actually this change might be a good test for our chief setup.
Blocks: 815529
No longer blocks: 720938
(Reporter)

Comment 2

5 years ago
BTW, https://github.com/mozilla/marketing-project-template found this, I believe.

Comment 3

5 years ago
This looks to be added but if i read the file correctly it is preventing all spiders which is not what we want.

AFAIK we should not restrict the flicks site from being spidered.
Assignee: nobody → mkelly
(Assignee)

Comment 4

5 years ago
It was added correctly: There's a setting "ENGAGE_ROBOTS" that determines if robots are allowed or denied. We set it to False on dev and stage to keep robots from spidering the dev and stage sites as they were causing tracebacks (a seperate bug that should be fixed).

If you're concerned I can have IT reenable it for testing, but I'm not too worried about it myself, the feature is pretty much copied verbatim from playdoh and has unit tests.
Status: NEW → RESOLVED
Last Resolved: 5 years ago
Resolution: --- → FIXED

Comment 5

5 years ago
No need this is fine, and thanks for explaining.
Verified
Status: RESOLVED → VERIFIED
You need to log in before you can comment on or make changes to this bug.