Closed Bug 1720283 Opened 3 years ago Closed 3 years ago

bugzilla-dev.allizom.org pages found by Google search, should get excluded by robots.txt

Categories

(bugzilla.mozilla.org :: Administration, task)

Tracking

()

RESOLVED FIXED

People

(Reporter: aryx, Assigned: dkl)

References

Details

Attachments

(1 file)

A Google search for "mach build toolkit" lists a bugzilla-dev page in the results. The robots.txt looks similar to production. From my point of view, crawlers should be excluded from allizom.

See Also: → 992925
See Also: → 1187498
Assignee: nobody → dkl
Status: NEW → ASSIGNED
Attached file GitHub Pull Request

This change is now live.

Status: ASSIGNED → RESOLVED
Closed: 3 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Created:
Updated:
Size: