305504 - non-breaking space ( ) is rendered as black diamond with question mark in UTF-8 encoding when pages are dynamically built.

Status: RESOLVED INVALID

(Firefox :: General, defect)

Description

[Ron Biggs]

User-Agent:       Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.10) Gecko/20050716 Firefox/1.0.6
Build Identifier: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.10) Gecko/20050716 Firefox/1.0.6

I have seen this problem on two separate sites: 
http://www.enduringreflections.com/catalog.php?id=1
http://ir.tysonfoodsinc.com/phoenix.zhtml?c=65476&p=irol-irhome

where non-breaking spaces are rendered or converted to a black diamond with a
question-mark inside.

The commonalities that the two URLs have is that most of the content on the page
is dynamically generated and placed on the pages.  In the first URL, the pages
are processed through Smarty Templates (PHP).  In the second URL, I'm not sure
how that is done, but it is a third-party data-collection and serving service
called Thomson Financial.

Reproducible: Always



Expected Results:  
Rendered the non-breaking space correctly.

Comment 1

[Adam Guthrie]

Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9a1) Gecko/20050821 Firefox/1.6a1
ID:2005082118

WFM.

Comment 2

[Phil Ringnalda (:philor)]

The second one works for me (it doesn't say what character encoding it's in, and
we correctly infer ISO-8859-1), but the first one is just broken: it says it's
encoded in UTF-8 (with the HTTP header "Content-Type: text/html;
charset=UTF-8"), where a non-breaking space is the pair of bytes C2 0A, but
apparently at least the part of it that put in the "view basket" section (and
possibly all of it) thought it was ISO-8859-1, since it tried to put in
ISO-8859-1 non-breaking spaces, the single byte 0A.