744671 - X-Robots-Tag not set after redirect

Status: RESOLVED DUPLICATE of bug 744030

(www.mozilla.org :: General, defect)

Description

[raymond [:retornam] (inactive)]

From https://bugzilla.mozilla.org/show_bug.cgi?id=632665#c1
"Or you may want to use the X-Robots-Tag HTTP header for all pages.
http://code.google.com/intl/en/web/controlcrawlindex/docs/robots_meta_tag.html"


We set the X-Robots-Tags for all pages under mozilla.org/firefox/


I noticed today that the option is not set when a page redirects. For example


 curl -I www.mozilla.org/firefox 
HTTP/1.1 301 Moved Permanently
Server: Apache
X-Backend-Server: bedrock4
Vary: User-Agent,Accept-Language
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0, private
Content-Type: text/html; charset=UTF-8
Date: Thu, 12 Apr 2012 00:58:20 GMT
Location: http://www.mozilla.org/en-US/firefox/new/
Pragma: no-cache
Transfer-Encoding: chunked
Connection: Keep-Alive
X-Robots-Tag: noodp
X-Powered-By: PHP/5.3.3

➜  ~  curl -I www.mozilla.org/en-US/firefox/new/ 
HTTP/1.1 200 OK
Server: Apache
X-Backend-Server: bedrock1
Vary: Accept-Encoding
Cache-Control: max-age=600
Content-Type: text/html; charset=utf-8
Date: Thu, 12 Apr 2012 00:59:53 GMT
Expires: Thu, 12 Apr 2012 01:09:53 GMT
Accept-Ranges: bytes
x-frame-options: DENY
X-Cache-Info: caching
Content-Length: 6749

➜  ~  curl -I www.mozilla.org/en-US/firefox/new/ 
HTTP/1.1 200 OK
Server: Apache
X-Backend-Server: bedrock1
Vary: Accept-Encoding
Cache-Control: max-age=600
Content-Type: text/html; charset=utf-8
Date: Thu, 12 Apr 2012 00:59:53 GMT
Expires: Thu, 12 Apr 2012 01:09:53 GMT
Accept-Ranges: bytes
x-frame-options: DENY
Content-Length: 6749
Connection: Keep-Alive
X-Cache-Info: cached


The first link has it set but the subsequent ones do not

Comment 1

[Kohei Yoshino [:kohei]]

This is not related to redirect. Bedrock.