Closed Bug 1720283 Opened 3 years ago Closed 3 years ago

bugzilla-dev.allizom.org pages found by Google search, should get excluded by robots.txt

Categories

(bugzilla.mozilla.org :: Administration, task)

Product:
bugzilla.mozilla.org
Component:
Administration
Type:
task

Tracking

()

Status:
RESOLVED FIXED

People

(Reporter: aryx, Assigned: dkl)

References

Details

Attachments

(1 file)

GitHub Pull Request
46 bytes, text/x-github-pull-request
Details | Review

A Google search for "mach build toolkit" lists a bugzilla-dev page in the results. The robots.txt looks similar to production. From my point of view, crawlers should be excluded from allizom.

See Also: → 992925
See Also: → 1187498
Assignee: nobody → dkl
Status: NEW → ASSIGNED
Attached file GitHub Pull Request —

This change is now live.

Status: ASSIGNED → RESOLVED
Closed: 3 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: