Closed Bug 1720283 Opened 3 months ago Closed 2 months ago

bugzilla-dev.allizom.org pages found by Google search, should get excluded by robots.txt

Categories

(bugzilla.mozilla.org :: Administration, task)

Tracking

()

RESOLVED FIXED

People

(Reporter: aryx, Assigned: dkl)

References

Details

Attachments

(1 file)

46 bytes, text/x-github-pull-request
Details | Review

A Google search for "mach build toolkit" lists a bugzilla-dev page in the results. The robots.txt looks similar to production. From my point of view, crawlers should be excluded from allizom.

See Also: → 992925
See Also: → 1187498
Assignee: nobody → dkl
Status: NEW → ASSIGNED
Attached file GitHub Pull Request

This change is now live.

Status: ASSIGNED → RESOLVED
Closed: 2 months ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.