179181 - [gtk2] international characters not shown properly

Status: RESOLVED INVALID

(Core :: Layout: Text and Fonts, defect)

Description

[Mox Soini]

User-Agent:       Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.3a) Gecko/20021108
Build Identifier: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.3a) Gecko/20021108 (GTK2/RH8-build)

In the aforementioned website, the international (Finnish) characters are not
displayed properly (i.e. they are "unknown" -boxes). non-gtk -build should show
the site just fine.

Note that the ä -ones are just ok, but the "ä" ones (non-standard HTML) are
not.

Will add attachments

Reproducible: Always

Steps to Reproduce:
1. Use gtk2 -build from
http://komodo.mozilla.org/pub/mozilla/nightly/experimental/gtk2/
2. load the website

Comment 1

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

->blizzard.  (I'm guessing the gtk2 build is also an xft build.)

However, I'm not sure whether this bug is valid or not.  Could you attach a
simple testcase demonstrating the problem?  Is this a reliance on characters in
windows-1252, or character points that are in windows-1252 mapping to certain
other characters in a font with a certain name?  (What do you mean by nonstandard?)

Comment 2

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

That said, I'm not sure what I mean by nonstandard, and I don't see the problem
in my Xft build (where on the page are the characters in question?), so it could
just be an issue that your installation of Xft isn't configured to find the
fonts you need to display those characters.

Comment 3

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

er, what you mean by nonstandard

Comment 4

[Christopher Blizzard (:blizzard)]

Attachment: screenshot

This is what that page looks like on this computer.  I do have the MS fonts
installed, though.  Is this the way it is supposed to look, or not?

Comment 5

[Mox Soini]

GRR, for some reason "create attachment" fails on me with "did not supply file
for attachment" or something like that.

Anyways, here's screenshot: http://aiesec.tky.hut.fi/test/Capture.png
The above part is how it looks like on my computer.

I have RedHat 8, with windows fonts, french-speaking gnome ui (LANG=fr_FR@euro),
english mozilla (with xft)...
Galeon2 (with separate, patched mozilla) seems to show the characters ok, but
none of the mozillas.

By non-standard I mean international characters in the HTML file that are not
HTML codes (ä et al.), but characters typed directly to the file.
Here's a simple testcase: http://aiesec.tky.hut.fi/test/test.html

With a locally stored file, mozilla does not work, galeon and gedit does. I'm a
bit confused as to why it does and does not work in different apps, but I'm just
guessing that it's related to the way mozilla handles fonts... 

Comment 6

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

Could your character encoding be set to UTF-8 somehow?  Check the View |
Character Coding menu.

Did you bookmark the page?  Perhaps this is a duplicate of bug 174197?

Comment 7

[Mox Soini]

Nope, didn't bookmark the page. However the other suggestion hit the mark. I
actually did have View->Character encoding set to "unicode". I might have set it
like that long time a go (esp. if that setting is website specific). Oh well.
Setting it to ISO-8859-1 helps. 

Also, I now have auto-detection set to universal and it seems to work ok. The
auto-detected encoding for the url mentioned is Windows-1252...

Thanks!

Is there a good reason why using UTF-8 breaks the chars?

Comment 8

[David Baron :dbaron: (⌚️UTC-4, no longer working on Mozilla)]

UTF-8 encoding is different, so those characters aren't valid UTF-8.  (ASCII
works fine in UTF-8, but UTF-8 can encode any character in Unicode, so the upper
half of the bytes are used for multibyte sequences.)

Also, the default for Autodetection is off.  Autodetection slows things down and
can mess things up.

Comment 9

[Hixie (not reading bugmail)]

since it works if you have it set to the correct encoding, marking INVALID.
Please reopen if I misunderstood.