802961 - Prevent indexing of non-production domains

Status: RESOLVED WONTFIX

(Mozilla QA Graveyard :: MozTrap, defect)

Description

[Matthew N. [:MattN]]

MozTrap dev/test sites on allizom.org are getting indexed by search engines.  This should be prevented via a robots.txt.

Examples:
* https://caseconductor.allizom.org
* https://caseconductor-dev.allizom.org
* https://moztrap-dev.allizom.org

Comment 1

[Cameron Dawson [:camd]]

Matthew- I'm not sure how to check this.  [:satdav] added that file and it's on dev and staging, so this should be fixed.  Can you check for me?

Comment 2

[Matt Brandt [:mbrandt]]

Does it need to be added to urls.py?

https://moztrap.allizom.org/robots.txt
https://moztrap-dev.allizom.org/robots.txt

Comment 3

[Stephen Donner [:stephend] Not actively reading bugmail]

Mass-closing remaining MozTrap bugs as WONTFIX, due to 1) the Mozilla-hosted instance being decommissioned (see https://wiki.mozilla.org/TestEngineering/Testrail), and, for now, 2) the still-up code archived at its GitHub page: https://github.com/mozilla/moztrap (we'll decide what's next for that, in the near future).

See also the history and more-detailed discussion which led us here, at https://groups.google.com/forum/#!topic/mozilla.dev.quality/Sa75hV8Ywvk

(If you'd like, you should be able to filter these notification emails using at least the unique string of "Sa75hV8Ywvk" in the message body.

Thanks!