4237 - Line breaking-line which contains "\" and "??" does not break.

Status: VERIFIED FIXED

(Core :: Internationalization, defect, P3)

Description

[Teruko Kobayashi]

Tested 3-23-99 Win32 build.

In the above URL page, the test case #3 has Hankaku "\" and the test case #16 has Zenkaku "��".
After both "\" and "��" are Zenkaku numbers.  They do not break lines even though you move mouse
to change the window size. They should break lines.

Comment 1

[Frank Tang]

We should break between number followed by a "\", but not "\" followed by
number. Currently, it does not break in neither places.

Comment 2

[Frank Tang]

Fix it and check in today. The case #16 should be fine now. The #3 should be
correct if we really convert the Shift JIS into Yen sign. It currently does not
break because it is converted into U+005C. (It work if we use ¥). The #3
problem now is only the conversion issue reported as 4238

Comment 3

[Teruko Kobayashi]

I tested this in 2000-09-21-08 Win32, 2000-09-21-04 Mac, and 2000-09-21-10 Linux 
build.  This does not work.

Comment 4

[Zach Lipton [:zach]]

unsetting target milestone, M4 has been out for a long time.

Comment 5

[Frank Tang]

I think this is regression. Reassign to shanjian

Comment 6

[Shanjian Li]

This might be related with a change I made in line breaking. We are using 
dominating space if there is no CJK character involved. And because unicode 
is used for internal processing, zenkaku character might not be necessarily 
considered as CJK character. It is well understood that no Word/Line break 
algorithm is perfect, and I believe the above behavior is compromisable.

Comment 7

[Teruko Kobayashi]

This works fine in 4.x.  This follows the Japanese kinsoku rule.  I reopen this.

Comment 8

[Shanjian Li]

Attachment: patch part 1

Comment 9

[Shanjian Li]

Attachment: patch part 2

Comment 10

[Shanjian Li]

explaination about the 2 changes:
1, if a ZenKaku character is met, we go to CJK route. Unicode 
   code point in range of ff00 to ffff is added. (Yes, I know 
   some code points in this range is not yet or will never be 
   allocated.)
2, In CJK route, 0x5c restore back to its category according to 
   4501. 

Comment 11

[Frank Tang]

sr=ftang

Comment 12

[Erik van der Poel]

sr=erik

Comment 13

[Shanjian Li]

fix checked in.

Comment 14

[Teruko Kobayashi]

Verified in 2001021204 Mtrunk build.