124734 - Autodetect charset doesn't work for Italian pages

Status: VERIFIED DUPLICATE of bug 115114

(Core :: Internationalization, defect)

Description

[Lorenzo Colitti]

From Bugzilla Helper:
User-Agent: Mozilla/5.0 (Windows; U; Win 9x 4.90; en-US; rv:0.9.8) Gecko/20020204
BuildID:    2002020406

Charset autodetection always chooses the central european (Windows-1250)
encoding for Italian pages, which is wrong and results in Italian accented
characters being displayed incorrectly.

The correct charsets for Italian are are ISO-8859-1 (Western), ISO-88159-15
(Western+euro), or Windows-1252.

Reproducible: Always
Steps to Reproduce:
1. Open Mozilla
2. Select View->Character Coding->Auto-Detect->Universal
3. Go to the URL above


Actual Results:  The page loads twice, as per bug 105709. On the first load, the
name of the film comes up correctly as "La vita e` bella". But then
autodetection kicks in and decides (wrongly) that the proper charset is
Windows-1250, and the page is reloaded with the name of the film is garbled.

Expected Results:  The page should load once (but this is being tracked in bug
105709) and properly set the charset to ISO-8859-1, ISO-8859-15, or Windows-1252.

The workaround is to select one of the correct character codings manually as the
default.

Here is some info on Italian characters for fixing the sniffer.

The special characters that Italian uses are the accented vowels:

à (a`), è (e`), é (e'), ì (i`), ò (o`), and ù (u`),

and their uppercase counterparts, ÀÈÉÌÒÚ. These (both upper and lower case) may
only appear at the end of a word, except è (or È) which may be a word in its own
right.

Apart from the Euro symbol, ¤, and perhaps the paragraph sign, §, these are the
only special characters that Italian uses.

Comment 1

[Hugh Kennedy]

dup of bug 115114

*** This bug has been marked as a duplicate of 115114 ***

Comment 2

[Yuying Long]

I guess it should be fixed after we fix bug 115114 following by the comment #6
there.

I'm marking this one as verified as dup. for now here.