837519 - Forums index is on Google

Status: RESOLVED FIXED

(support.mozilla.org :: Forum, task, P4)

Description

[Chris Ilias [:cilias]]

There are often posts in the contributor forums from users looking for support. In a recent one [1], I asked how the user found the forum. He replied via private message, saying "I found the forum by googling something like "firefox support." "

"firefox support" does not bring up contributor forums, but "firefox support forum" does bring up https://support.mozilla.org/en-US/forums . We should probably prevent it from being indexed by Google.


[1]<https://support.mozilla.org/en-US/forums/lost-threads/708952>

Comment 1

[Kadir Topal [:atopal]]

Good point!

Comment 2

[Will Kahn-Greene [:willkg] ET needinfo? me]

Assuming this is as simple as adding an item to the robots.txt, then this is probably a 1 pointer.

Comment 3

[Kadir Topal [:atopal]]

Moving to next sprint due to sprint being full.

Comment 4

[Ricky Rosario [:rrosario, :r1cky]]

Maybe somebody shows up soon? :)

Comment 5

[Michał Frontczak [:fxa90id] ♥]

there is already {{ 1 }}/forums/ there. Maybe meta <meta name="robots" content="noindex"> would help ?

Comment 6

[Ricky Rosario [:rrosario, :r1cky]]

(In reply to Michał Frontczak :fxa90id from comment #5)
> there is already {{ 1 }}/forums/ there. Maybe meta <meta name="robots"
> content="noindex"> would help ?

Yeah, but that doesn't include https://support.mozilla.org/en-US/forums for example.

Comment 7

[Ricky Rosario [:rrosario, :r1cky]]

I wonder if doing:

Disallow: /{{ l }}/forums

is all we need?

Comment 8

[Ricky Rosario [:rrosario, :r1cky]]

(In reply to Ricky Rosario [:rrosario, :r1cky] from comment #7)
> I wonder if doing:
> 
> Disallow: /{{ l }}/forums
> 
> is all we need?

Yeah, from what I am reading here:
http://en.wikipedia.org/wiki/Robots.txt

it seems that we might just need to remove the trailing slash and be done?

Comment 9

[Michał Frontczak [:fxa90id] ♥]

but does {{ 1 }}/forums include {{ 1 }}/forums/ ?

Comment 10

[Michał Frontczak [:fxa90id] ♥]

oh you wrote it same time ;p I was thinking about removing / and should work I think :)

Comment 11

[Michał Frontczak [:fxa90id] ♥]

https://github.com/mozilla/kitsune/pull/1120

Comment 12

[Ricky Rosario [:rrosario, :r1cky]]

Landed on master:
https://github.com/mozilla/kitsune/commit/84db79470db6c72a1433034c4e4b5618063175c8

Comment 13

[Ricky Rosario [:rrosario, :r1cky]]

Deployed to prod now.

Comment 14

[Will Kahn-Greene [:willkg] ET needinfo? me]

Moving this to the sprint it got fixed in.

Comment 15

[[e-mail]]

Oops, I typoed the bug number. Sorry about that.