10230 - Detectch (japsm) does not detect any charsets

Status: VERIFIED FIXED

(Core :: Internationalization, defect, P2)

Description

[Teruko Kobayashi]

Tested 7-20-12-M9 Win32 build.

Step of reproduce
1. Save above file in the same directory as apprunner is located.
2. type index.html | DetectCh japsm 1024

Expected result EUC
Actual result   No charset is detected

I did the same thing in http://home.netscape.com/ja   page
Detectch did not detect any charsets.

Comment 1

[Teruko Kobayashi]

Attachment: This is the dos output.

Comment 2

[Frank Tang]

Z:\mozilla\dist\WIN32_D.OBJ\bin>perl -MLWP::Simple -e "getprint 'http://home.net
scape.com/ja/index.html'"|DetectCharset japsm 1024
It's NOT windows-1252- byte 0(0)
It's NOT UTF-8- byte 0(0)
It's NOT Shift_JIS- byte 0(0)
It's NOT ISO-2022-JP- byte 31(1f)
It's NOT ISO-10646-UCS-2- byte 233(e9)
Done
Done 2
This mean we have some problem with the new ISO-10646-UCS-2-LE verifier which it
does not go into error state as we expect.

Comment 3

[Teruko Kobayashi]

*** Bug 10340 has been marked as a duplicate of this bug. ***

Comment 4

[Frank Tang]

Find the bug on the 1.3 of mozilla/intl/chardet/src/nsPkgInt.h All the PRUint16
in the #define should be PRUint32. Wait till people give me ok from hook to
check in.

Comment 5

[Frank Tang]

fix.

Comment 6

[Teruko Kobayashi]

I verified this in 7-28-13-M9 Win32 build.