931081 - [SEO] Add meta robots noindex to in-product or embedded pages

Status: VERIFIED FIXED

(www.mozilla.org :: General, defect)

Description

[Kohei Yoshino]

While working on Bug 906882, I've noticed some in-product or embedded pages are indexed by Google. For example:

https://www.mozilla.org/en-US/contribute/embed/
https://www.mozilla.org/en-US/facebookapps/downloadtab/
https://www.mozilla.org/en-US/firefox/sms/sent/
https://www.mozilla.org/en-US/newsletter/updated/

We may want to add <meta name="robots" content="noindex"> or the X-Robots-Tag: noindex header to those pages. Will send a PR.

Comment 1

[Kohei Yoshino]

Attachment: Pull Request on GitHub

This PR will add noindex to the following pages:

/facebookapps/downloadtab/ (embedded page)
/firefox/installer-help/ (in-product page)
/firefox/nightly/firstrun/ (in-product page)
/firefox/sms/sent/ (thank you page)
/firefox/update/ (in-product page)
/firefox/{VERSION}/firstrun/ (in-product page)
/firefox/{VERSION}/whatsnew/ (in-product page)
/foundation/openwebfund/thanks/ (thank you page)
/contribute/embed/ (embedded page)
/contribute/universityambassadors/thanks/ (thank you page)
/newsletter/confirm/{TOKEN} (transaction page)
/newsletter/existing/{TOKEN} (transaction page)
/newsletter/hacks.mozilla.org/ (embedded page)
/newsletter/recovery/ (transaction page)
/newsletter/updated/ (transaction page)

Comment 2

[[github robot]]

Commits pushed to master at https://github.com/mozilla/bedrock

https://github.com/mozilla/bedrock/commit/1ce46df3b5777f12b3948e87fb42927e7dd60b03
Bug 931081 - [SEO] Add meta robots noindex to in-product or embedded pages

https://github.com/mozilla/bedrock/commit/8c7a5280c1182f0c9cdbef869529b0991b3f3e7e
Merge pull request #1344 from kyoshino/bug-931081-noindex

Bug 931081 - [SEO] Add meta robots noindex to in-product or embedded pages

Comment 3

[Kohei Yoshino]

https://www-dev.allizom.org/en-US/contribute/embed/
https://www-dev.allizom.org/en-US/facebookapps/downloadtab/
https://www-dev.allizom.org/en-US/firefox/sms/sent/
https://www-dev.allizom.org/en-US/newsletter/updated/

Comment 4

[Stephen Donner [:stephend] Not actively reading bugmail]

Verified FIXED on the URLs in comment 3, on dev.

Comment 5

[Stephen Donner [:stephend] Not actively reading bugmail]

(In reply to Stephen Donner [:stephend] from comment #4)
> Verified FIXED on the URLs in comment 3, on dev.

Also verified those on staging, just now.