98675 - MIME encoder mishandles certain character sequences

Status: RESOLVED FIXED

(MailNews Core :: MIME, defect)

Description

[Katsuhiko Momoi]

** Observed with 9/6/2001 Win32 trunk build **

The following sequence of Japanese characters are mis-encoded by 
Mozilla's MIME encoder. (View the string under Japanese (Shift_JIS)
encoding.)

貴社のサイトの問題  サイトURL: http://home/jis.html


This is how you reproduce the problem:

1. Open a Mail compose window and set View | Character Coding to 
   Japanese (ISO-2022-JP). Format could be HTML or plain text.
2. Copy paste the above test line into the Subject header and then
   also into the Mail body.
3. Send it to yourself and view the subject header and compare it to the
   same text in the body.  The subject line has been mis-encoded and mangled.

I will attach a problem image next.

Additional comment:

I experimented with different character combinations but the ASCII 
colon ":" seems to be significant for this problem. When I replace this
with the Japanese colon, the problem does not occur.
There are also 2 spaces between the 1st and the 2nd Japanese phrases.
This too makes a difference. If I reduce the 2 spaces to 1, the problem
does not occur. So the byte count also seems to matter.

Comment 1

[Katsuhiko Momoi]

Attachment: An image showing teh MIME encoder problem in the subject header.

Comment 2

[ji]

There are two bugs: bug 72569 and bug 64948 which might be related to this.

Comment 3

[Katsuhiko Momoi]

bug 72569 and bug 64948 are display bugs. 
This bug seems to be a problem in encoding. If you look in the
message source:

Subject: =?ISO-2022-JP?B?GyRCNS48UiROJTUlJCVIJE5MZEJqGyhCICAbJEIlNSUkJUgbKEJVUg==?=:
	L

This is incomplete. When I eliminated one of the 2 spaces between Japanese
phrases, I got Mozilla to encode the complete string:

Subject: =?ISO-2022-JP?B?GyRCNS48UiROJTUlJCVIJE5MZEJqGyhCIBskQiU1JSQlSBsoQlVSTA==?=:
	 http://kaze:8000/jis.html

So, something goes wrong in the encoding process and chops off data 
after the ":".

Comment 4

[marina]

Kat, there are a lot of bugs reporting problems with mozilla mishandling ":",
"_" "" and space, look at # 98406,92355,98199 and there was one about ":" that i
can not find now... i'll keep looking

Comment 5

[Jean-Francois Ducarroz]

Naoki, can you take care of this problem. Thanks

Comment 6

[Denis Antrushin]

98406 and 98199 doesn't related to this bug;
but 92355 is dup of this bug (or vice versa).
I'll post fix to 92355.

Comment 7

[Denis Antrushin]

See bug 92355 for description and proposed fix

Comment 8

[Takayuki Tei]

add dependency. set TM to 0.9.9. reassign to myself.

Comment 9

[Takayuki Tei]

Mark as fixed.  See bug 73403 for detail.

Comment 10

[ji]

QA contact to marina. Thanks.