238844 - upgrade files generated from unicode character database

Status: RESOLVED DUPLICATE of bug 210502

(Core :: Internationalization, defect)

Description

[David Baron :dbaron: (⌚️UTC-5, no longer working on Mozilla)]

The following four files are generated from the unicode character database, but
from old versions.  We should try to upgrade them.

extensions/spellcheck/src/cattable.h
intl/unicharutil/src/casetable.h
intl/unicharutil/src/cattable.h
intl/unicharutil/tables/transliterate.properties

Are there others I don't know about?

The first thing I'm going to try to do is synchronize the generation tools with
changes that have been manually made to the files (but shouldn't have been) and
figure out what versions of the database were used to generate the existing files.

(I thought there was another bug on this, but I can't find it.)

So far I've found that files were generated from the following database versions:

2.1.8  intl/unicharutil/src/cattable.h

Comment 1

[David Baron :dbaron: (⌚️UTC-5, no longer working on Mozilla)]

extensions/spellcheck/src/cattable.h is very close to 2.1.9 and 3.0.0 (based on
diff), but not exactly

Comment 2

[David Baron :dbaron: (⌚️UTC-5, no longer working on Mozilla)]

intl/unicharutil/src/casetable.h is very close to 3.0.0, but not exactly.

Comment 3

[Jungshik Shin]

This is a dupe of bug 210502 and bug 210501. I've already done most of chores
there. I'm leaving this open for extensions/spellcheck/src/cattable.h that is
not covered by two bugs aforementioned.

Comment 4

[David Baron :dbaron: (⌚️UTC-5, no longer working on Mozilla)]

transliterate.properties seems to be generated from 3.0.0

Comment 5

[David Baron :dbaron: (⌚️UTC-5, no longer working on Mozilla)]

Attachment: changes to perl scripts

Well, in any case, here are the changes I needed to make to the perl scripts to
make the generated files look like the ones in the tree.

Comment 6

[David Baron :dbaron: (⌚️UTC-5, no longer working on Mozilla)]

*** This bug has been marked as a duplicate of 210502 ***

Comment 7

[David Baron :dbaron: (⌚️UTC-5, no longer working on Mozilla)]

The changes to gentransliterate.pl here landed in bug 345024.