[SEO] SuMoMo articles are not indexed by search engines (Google, Bing, Yahoo!, etc.)

RESOLVED FIXED

Status

support.mozillamessaging.com Graveyard
General
RESOLVED FIXED
6 years ago
6 years ago

People

(Reporter: kohei, Assigned: gozer)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(Reporter)

Description

6 years ago
I just realized that SuMoMo's knowledge base articles cannot be searched with Google...

https://www.google.comsearch?q=site:support.mozillamessaging.com
http://www.bing.com/search?q=site:support.mozillamessaging.com
http://search.yahoo.com/search?p=site:support.mozillamessaging.com

You are preventing crawlers from indexing those pages:

https://support.mozillamessaging.com/robots.txt

It should be fixed ASAP.
Critical, but easy fix. Set ENGAGE_ROBOTS in settings_local to True.
i believe only :gozer can fix this on the server, so assigning to him
Assignee: nobody → gozer
Yeah, gozer needs to fix this.
(Assignee)

Comment 5

6 years ago
Added to settings_local.py:

ENGAGE_ROBOTS = True

And restarted the server. Not sure how to verify it worked, however.
(Assignee)

Updated

6 years ago
Severity: blocker → normal
(Reporter)

Comment 6

6 years ago
Looks good to me.
https://support.mozillamessaging.com/robots.txt
Status: NEW → RESOLVED
Last Resolved: 6 years ago
Resolution: --- → FIXED
https://support.mozillamessaging.com/robots.txt

With ENGAGE_ROBOTS = False, robots.txt is something more like

User-agent: *
Disallow: /

This is to prevent staging servers from being indexed.
You need to log in before you can comment on or make changes to this bug.