Clean up region names based on CLDR values
Categories
(Core :: Internationalization: Localization, task)
Tracking
()
| Tracking | Status | |
|---|---|---|
| firefox106 | --- | fixed |
People
(Reporter: hectorz, Assigned: flod)
References
Details
Attachments
(1 file)
|
Assignee | |
Comment 1•3 years ago
|
||
As mentioned before, GENC is not the reference at this point.
And there are a lot more differences, mostly typographical, but I'm not sure it's worth chasing them all down. Among others.
BQ (2018)
CLDR: Caribbean Netherlands
Mozilla: Bonaire, Sint Eustatius, and Saba
https://unicode-org.atlassian.net/browse/ICU-10521
CV (2020)
CLDR: Cape Verde
Mozilla: Cabo Verde
https://unicode-org.atlassian.net/browse/CLDR-8633
And there's HK and MO too.
We don't ship any locale for these regions, so the only one which would make sense to fix is CZ
|
|
Assignee | |
Comment 2•3 years ago
|
||
This is the full list of differences, ignoring some basic replacements (& -> and, St. -> Saint).
- I'm not sure yet why CLDR doesn't have X* territories, trying to find some explanation.
- Some can probably be fixed without forcing retranslation, for example: missing accents (
São Tomé & Príncipe), use of parenthesis or commas (Korea, NorthvsNorth Korea,Congo (Kinshasa)vsCongo - Kinshasa).
Missing region names in CLDR:
QM: Midway Islands
QS: Bassas da India
QU: Juan de Nova Island
QW: Wake Island
QX: Glorioso Islands
QZ: Akrotiri
XC: Coral Sea Islands
XD: Dhekelia
XE: Europa Island
XG: Gaza Strip
XH: Howland Island
XJ: Jan Mayen
XL: Palmyra Atoll
XM: Kingman Reef
XP: Paracel Islands
XQ: Jarvis Island
XR: Svalbard
XS: Spratly Islands
XT: Tromelin Island
XU: Johnston Atoll
XV: Navassa Island
XW: West Bank
Different values:
BL
CLDR: St. Barthélemy
Mozilla: Saint Barthelemy
BQ
CLDR: Caribbean Netherlands
Mozilla: Bonaire, Sint Eustatius, and Saba
BS
CLDR: Bahamas
Mozilla: Bahamas, The
CD
CLDR: Congo - Kinshasa
Mozilla: Congo (Kinshasa)
CG
CLDR: Congo - Brazzaville
Mozilla: Congo (Brazzaville)
CV
CLDR: Cape Verde
Mozilla: Cabo Verde
CZ
CLDR: Czechia
Mozilla: Czech Republic
FK
CLDR: Falkland Islands
Mozilla: Falkland Islands (Islas Malvinas)
FM
CLDR: Micronesia
Mozilla: Micronesia, Federated States of
GM
CLDR: Gambia
Mozilla: Gambia, The
HK
CLDR: Hong Kong SAR China
Mozilla: Hong Kong
HM
CLDR: Heard & McDonald Islands
Mozilla: Heard Island and McDonald Islands
KN
CLDR: St. Kitts & Nevis
Mozilla: Saint Kitts and Nevis
KP
CLDR: North Korea
Mozilla: Korea, North
KR
CLDR: South Korea
Mozilla: Korea, South
MM
CLDR: Myanmar (Burma)
Mozilla: Burma
MO
CLDR: Macao SAR China
Mozilla: Macau
PM
CLDR: St. Pierre & Miquelon
Mozilla: Saint Pierre and Miquelon
RE
CLDR: Réunion
Mozilla: Reunion
SH
CLDR: St. Helena
Mozilla: Saint Helena, Ascension, and Tristan da Cunha
ST
CLDR: São Tomé & Príncipe
Mozilla: Sao Tome and Principe
SZ
CLDR: Eswatini
Mozilla: Swaziland
TF
CLDR: French Southern Territories
Mozilla: French Southern and Antarctic Lands
VC
CLDR: St. Vincent & Grenadines
Mozilla: Saint Vincent and the Grenadines
VG
CLDR: British Virgin Islands
Mozilla: Virgin Islands, British
VI
CLDR: U.S. Virgin Islands
Mozilla: Virgin Islands, U.S.
XA
CLDR: Pseudo-Accents
Mozilla: Ashmore and Cartier Islands
XB
CLDR: Pseudo-Bidi
Mozilla: Baker Island
|
|
Assignee | |
Comment 3•3 years ago
|
||
Note: I'm not convinced about SH.
According to CLDR, SH is just St. Helena, while Ascension (AC) and Tristan da Cunha (TA) have their own code.
But ISO 3166-2 has them as subcodes of SH, with SH-SL being St. Helena
https://en.wikipedia.org/wiki/ISO_3166-2:SH
HM: Heard Island & McDonald Islands
As far as I understand, there is one Heard Island, and then are McDonald Islands, so this seems more accurate.
TF: French Southern and Antarctic Lands
That seems to be the correct name https://taaf.fr/
I might file a bug for CLDR to investigate these.
|
|
Assignee | |
Comment 4•3 years ago
|
||
Existing names only missing accents are updated without new IDs, to avoid forcing retranslation.
BQ (2018): Caribbean Netherlands -> Bonaire, Sint Eustatius, and Saba
https://unicode-org.atlassian.net/browse/ICU-10521
CV (2020): Cabo Verde -> Cape Verde
https://unicode-org.atlassian.net/browse/CLDR-8633
CZ (2019): Czech Republic -> Czechia
https://unicode-org.atlassian.net/browse/CLDR-9958
SZ (2019): Swaziland -> Eswatini
https://unicode-org.atlassian.net/browse/CLDR-11083
|
||
Updated•3 years ago
|
|
|
Assignee | |
Updated•3 years ago
|
|
||
Comment 6•3 years ago
|
||
Backed out for causing geckoview failures.
Backout link: https://hg.mozilla.org/integration/autoland/rev/1c4288dea3dc8f173897fc8f1a93694f05cedb90
Failure log: https://treeherder.mozilla.org/logviewer?job_id=389759652&repo=autoland&lineNumber=2763
|
|
Assignee | |
Comment 7•3 years ago
|
||
I don't see how this bug can be related.
We have landed the same code change a week ago without issues (completely unrelated to Autofill BTW).
|
||
Comment 8•3 years ago
|
||
R+B rage reveals that the issue is caused by this bug: https://treeherder.mozilla.org/jobs?repo=autoland&group_state=expanded&collapsedPushes=842382&resultStatus=pending%2Crunning%2Csuccess%2Ctestfailed%2Cbusted%2Cexception%2Cretry%2Cusercancel&searchStr=android%2C7.0%2Cx86-64%2Clite%2Cwebrender%2Copt%2Ctest-android-em-7.0-x86_64-lite-qr%2Fopt-geckoview-junit-fis%2Cgv-junit-fis&fromchange=9449d37e02c280fa2df22fbfbdae16b816005f8b&tochange=ce530399c45afa72128af55d3f255260c1ad2259&selectedTaskRun=Z6ED_stOQlChBEUosUD-jw.0
Also, we've noticed some perma mochitests https://treeherder.mozilla.org/jobs?repo=autoland&resultStatus=pending%2Crunning%2Csuccess%2Ctestfailed%2Cbusted%2Cexception%2Crunnable&fromchange=8628f2165a676c7b669a86dc0858ece4b7c85424&searchStr=linux%2C18.04%2Cx64%2Cwebrender%2Casan%2Copt%2Cmochitests%2Ctest-linux1804-64-asan-qr%2Fopt-mochitest-plain%2C1&group_state=expanded
log: https://treeherder.mozilla.org/logviewer?job_id=389765187&repo=autoland&lineNumber=2596
|
|
Assignee | |
Comment 9•3 years ago
•
|
||
I made typos on 2 out of 4 string IDs, and apparently that trips tests (the missing Fluent ID is displayed in the console). Missed when first looking at the log.
|
||
Comment 10•3 years ago
|
||
|
|
||
Comment 11•3 years ago
|
||
| bugherder | ||
|
Reporter | |
Comment 12•3 years ago
|
||
(In reply to Francesco Lodolo [:flod] from comment #2)
...
- I'm not sure yet why CLDR doesn't have X* territories, trying to find some explanation.
...
I find GENC's "Notes on Territory" helpful in understanding them, e.g. in 1 you can see several of X* ones are collectively covered in ISO 3166-1 (& similarly in CLDR) as UM, "U.S. Outlying Islands".
|
|
Assignee | |
Comment 13•3 years ago
|
||
Turns out XA…XZ are private codes for CLDR
https://unicode-org.atlassian.net/browse/CLDR-1118
That's why we have different values for 2 of them between Mozilla and CLDR.
Still not sure it's a good idea to have them, but there are also some in that list that are risky to touch.
|
|
Reporter | |
Comment 14•3 years ago
•
|
||
(In reply to Francesco Lodolo [:flod] from comment #3)
...
According to CLDR, SH is just St. Helena, while Ascension (AC) and Tristan da Cunha (TA) have their own code.
But ISO 3166-2 has them as subcodes of SH, with SH-SL being St. Helena
https://en.wikipedia.org/wiki/ISO_3166-2:SH...
AC & TA might be included based on this rule from BCP47: "In addition, the codes that are "exceptionally reserved" (as opposed to "assigned") in ISO 3166-1 were also defined in the registry, with the exception of 'UK', which is an exact synonym for the assigned code 'GB'." 1
(In reply to Francesco Lodolo [:flod] from comment #13)
Turns out XA…XZ are private codes for CLDR
https://unicode-org.atlassian.net/browse/CLDR-1118...
The validity data from 2 3 might be helpful? I also found this table 4 comparing status of these region codes in CLDR/BCP47/ISO.
Description
•