437276 - Update langGroups with data from the IANA registry

Status: RESOLVED FIXED

(Core :: Internationalization, defect)

Description

[320055323028-0001]

User-Agent:       Opera/9.27 (Windows NT 5.1; U; ru)
Build Identifier: Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9) Gecko/2008051206 Firefox/3.0

When the text language is set to Oromo (code: om) on any web page, Firefox defaults to the Ethiopic font if one is selected in the font dialog. However, Oromo is written in Latin script since 1991.

Reproducible: Always

Steps to Reproduce:
1. If not already done, download and install any Ethiopic font on your computer.
2. Start Firefox and select your Ethiopic font in the Font dialog under the Ethiopic tab for Serif, Sans and Mono.
3. Visit any website that has lang="om" set in the source code (or write one yourself)
Actual Results:  
Firefox uses the Ethiopic font to display the text, which depending on the font can result in hard-to-read text.

Expected Results:  
Firefox should default to the Western font and use it to display the text.

Comment 1

[Simon Montagu :smontagu]

I'm broadening the scope of this bug a bit: I think that any language that has a Suppress-Script value in http://www.iana.org/assignments/language-subtag-registry should have a corresponding definition in langGroups.properties, and can safely have .accept=true defined in languages.properties. I don't include languages where we don't already have a langGroup (e.g. Tibetan, see bug 441110)

It also doesn't make sense to me that there are languages in which we ship a localized version that don't appear in the "preferred language" dialog, so I'm adding a couple of those as well.

Languages affected by the patch:

Code Language    Script
ab   Abkhazian   Cyrillic
ay   Aymara      Latin
gn   Guarani     Latin
gv   Manx        Latin
ht   Haitian     Latin
kk   Kazakh      Cyrillic
kl   Greenlandic Latin
kok  Konkani     Devanagari
ku   Kurdish     Latin (Arabic script is also used; our l10n is Latin)
ln   Lingala     Latin
mg   Malagasy    Latin
mh   Marshallese Latin
mn   Mongolian   Cyrillic (Mongolian script is also used; our l10n is Cyrillic)
na   Nauru       Latin
nd   Ndebele,    Latin
      North
nr   Ndebele,    Latin
      South
nso  Sotho,      Latin
      Northern
ny   Chichewa    Latin
om   Oromo       Latin
ps   Pashto      Arabic
rn   Kirundi     Latin
rw   Kinyarwanda Latin
sm   Samoan      Latin
ss   Siswati     Latin
st   Sotho,      Latin
      Southern  
ti   Tigrinya    Ethiopic
tl   Tagalog     Latin
tn   Tswana      Latin
to   Tonga       Latin
ts   Tsonga      Latin
ur   Urdu        Arabic
ve   Venda       Latin
wo   Wolof       Latin
xh   Xhosa       Latin

Comment 2

[Simon Montagu :smontagu]

Attachment: The patch

Comment 3

[Simon Montagu :smontagu]

Attachment: Correct patch

Comment 4

[Masatoshi Kimura [:emk]]

(In reply to comment #3)
> Correct patch
I haven't see the patch yet, but what's the difference between two patches?
Interdiff didn't show any differences.

Comment 5

[Simon Montagu :smontagu]

(In reply to comment #4)

I thought that the first patch didn't have the line

+tl=x-western

but it looks as if hg diff misled me. Sorry about that.

Comment 6

[Simon Montagu :smontagu]

http://hg.mozilla.org/mozilla-central/rev/fa285ecf6815

Comment 7

[[e-mail]]

Comment on attachment 368924 [details] [diff] [review]
Correct patch

> ht=x-western
> hr=x-central-euro
> # XXX Latin Ext. A is also used for hsb. 
> hsb=x-western
>+ht=x-western
Bah, doesn't anyone read their debug spew any more?

I guess the existing one is incorrect, due to alphabetical ordering fail.

Comment 8

[Simon Montagu :smontagu]

Removed the duplicate entry in http://hg.mozilla.org/mozilla-central/rev/1a6d30255368 (rs=Neil on IRC)