Open Bug 537869 Opened 15 years ago Updated 2 years ago

message subjects doesn't use the right charset

Categories

(Thunderbird :: Folder and Message Lists, defect)

Product:
Thunderbird
Component:
Folder and Message Lists
Platform:
PowerPC
macOS
Type:
defect

Tracking

(Not tracked)

Status:
UNCONFIRMED

People

(Reporter: wyuenho, Unassigned)

Details

(Keywords: testcase)

Attachments

(2 files)

Sample spam as serialized from _save as file_
4.72 KB, message/rfc822
Details
Control test case
784 bytes, message/rfc822
Details 
User-Agent:       Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10_5_8; en-us) AppleWebKit/531.21.8 (KHTML, like Gecko) Version/4.0.4 Safari/531.21.10
Build Identifier: Mozilla/5.0 (Macintosh; U; PPC Mac OS X 10.5; en-US; rv:1.9.1.5) Gecko/20091204 Thunderbird/3.0

This bug has been here for as least as far back as 1.5 I think. When an HTML email is sent with a content-type multipart/alternative, the subject in the message list and the message info pane above the message preview pane is displayed as ?.

This behavior is inconsistent with the view message source window, which can correctly detect the right charset to display the subject, probably by looking at the HTML part's content type charset and content language.

Reproducible: Always




Here's a message source from a spam message:


Delivered-To: me@gmail.com
Received: by --.---.--.-- with SMTP id ---------------;
        Thu, 24 Dec 2009 03:24:12 -0800 (PST)
Received: by --.---.--.-- with SMTP id --------------.--.-------------;
        Thu, 24 Dec 2009 03:24:11 -0800 (PST)
Return-Path: <ahciugojujnyb@yahoo.com>
Received: from ---.---.---.-- (122-117-160-26.HINET-IP.hinet.net [---.---.---.--])
        by mx.google.com with SMTP id 6si22950724qwd.56.2009.12.24.03.24.05;
        Thu, 24 Dec 2009 03:24:11 -0800 (PST)
Received-SPF: neutral (google.com: ---.---.---.-- is neither permitted nor denied by domain of ahciugojujnyb@yahoo.com) client-ip=---.---.---.--;
Authentication-Results: mx.google.com; spf=neutral (google.com: ---.---.---.-- is neither permitted nor denied by domain of ahciugojujnyb@yahoo.com) smtp.mail=ahciugojujnyb@yahoo.com
Received: from ---.---.--.--by ; Sat, 23 Jan 2010 06:21:00 -0500
Message-ID: <XNVOZHIDAFCRTNRZIZVEP@yahoo.com>
From: "讓業績直線上升" <ahciugojujnyb@yahoo.com>
Reply-To: "快速銷售的法寶" <ahciugojujnyb@yahoo.com>
To: wysyenterprise@gmail.com
Subject: 廣告信件代發2000萬封,只要2000元(市價8000元)
Date: Sat, 23 Jan 2010 15:15:00 +0400
X-Mailer: The Bat! (v1.52f) Business
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="--"
X-Priority: 3
X-MSMail-Priority: Normal

----
Content-Type: text/html;
Content-Transfer-Encoding: quoted-printable

hair


<html>

<head>
<meta http-equiv=3D"Content-Language" content=3D"zh-tw">
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dbig5">
<title>=BCs=A7i=ABH=A5N=B5o2000=A4=B8</title>
</head>

<body>

<div align=3D"center">

<table id=3D"table3" height=3D"83" cellSpacing=3D"0" cellPadding=3D"0" wid=
th=3D"648" border=3D"0" bgcolor=3D"#FF9999">
  <tr>
    <td width=3D"648" height=3D"147">
    <div align=3D"center">
      <table id=3D"table4" borderColor=3D"#ff0033" height=3D"79" cellSpaci=
ng=3D"1" width=3D"648" border=3D"1">
        <tr>
          <td width=3D"640" bgColor=3D"#FF9999" height=3D"75">
          <p align=3D"center" style=3D"margin-top: 0; margin-bottom: 0">=A1=
@</p>
			<p align=3D"center" style=3D"margin-top: 0; margin-bottom: 0"><b>
			<a target=3D"_blank" href=3D"http://www.myhysp.com/mail/">
			<font size=3D"6">=BD=D0=AC=DD </font>
			<span style=3D"background-color: #FF0066">
			<font color=3D"#FFFF00" size=3D"6">
			=B8=D4=B2=D3=BA=F4=AF=B8=A4=B6=B2=D0</font></span></a></b></p>
			<p align=3D"center" style=3D"margin-top: 0; margin-bottom: 0">
			<font color=3D"#800000" size=3D"7"><b>=BA=F4=A7} www.myhysp.com/mail</b=
></font></p>
			<p align=3D"center" style=3D"margin-top: 0; margin-bottom: 0">=A1@</p>
			<p align=3D"center" style=3D"margin-top: 0; margin-bottom: 0">
			<span style=3D"background-color: #FF0066">
			<font size=3D"6" color=3D"#FFFF00"><b>=A9=E9=B8g=C0=D9=B6W=A7C=BB=F9<fo=
nt face=3D"=B7s=B2=D3=A9=FA=C5=E9">=A1A=A5N=B5o</font>2000=B8U=AB=CA=A6=B3=
=AE=C4=BCs=A7i=ABH</b></font></span></p>
			<p align=3D"center" style=3D"margin-top: 0; margin-bottom: 0">=A1@</p>
			<p align=3D"center" style=3D"margin-top: 0; margin-bottom: 0">
			<span style=3D"background-color: #FF0066">
			<font size=3D"6" color=3D"#FFFF00"><b>=B2{=A6b=AFS=BB=F9=A5u=ADn2000=A4=
=B8=B3=E1<font face=3D"=B7s=B2=D3=A9=FA=C5=E9">=A1I(=A5=AB=BB=F98000=A4=B8=
)</font></b></font></span></p>
			<p align=3D"center" style=3D"margin-top: 0; margin-bottom: 0">=A1@</p>
			<p align=3D"center" style=3D"margin-top: 0; margin-bottom: 0">
			<font color=3D"#FFFFFF"><b><font face=3D"=B7s=B2=D3=A9=FA=C5=E9">
			<span style=3D"background-color: #CC0000">=A1=B9=A1=B9=A1=B9</span></fo=
nt><span style=3D"background-color: #CC0000">=C1=D9=A6=B3=A5H=A4U3=BA=D8=A7=
=F3=C0u=B4f=AA=BA=BB=F9=AE=E6<font face=3D"=B7s=B2=D3=A9=FA=C5=E9">=A1A</f=
ont>=B5o=B6V=A6h=B4N=B6V=ABK=A9y=B3=E1</span><font face=3D"=B7s=B2=D3=A9=FA=
=C5=E9"><span style=3D"background-color: #CC0000">=A1=B9=A1=B9=A1=B9</span=
></font></b></font></p>
			<p align=3D"center" style=3D"margin-top: 0; margin-bottom: 0">=A1@</p>
			<p style=3D"MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px" align=3D"center">
			<strong><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D"#ff0000">(=
1)</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D"#0000ff">=A5=
=AB=BB=F91=B8U=A4=B8</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" col=
or=3D"#ff0000">=A1A&nbsp;
			</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D"#006600">8=B8=
U=A6=B8</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D"#ff0000=
">=C2I=BE\=B2v=A1A=A5=BB=B3=E6=A6=EC=AFS=B4f=BB=F9=AE=E6</font><font face=3D=
"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D"#0000ff">3800=A4=B8</font><font fa=
ce=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D"#ff0000">(=A5=AD=A7=A1=A8C=A4=
@=A6=B8=C2I=BE\</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D=
"#0000ff">0.0475=A4=B8</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" c=
olor=3D"#ff0000">)</font></strong></p>
			<p style=3D"MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px" align=3D"center">
			<strong><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D"#ff0000">(=
2)</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D"#0000ff">=A5=
=AB=BB=F92=B8U=A4=B8</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" col=
or=3D"#ff0000">=A1A</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" colo=
r=3D"#006600"> 
			15=B8U=A6=B8</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D=
"#ff0000">=C2I=BE\=B2v=A1A=A5=BB=B3=E6=A6=EC=AFS=B4f=BB=F9=AE=E6</font><fo=
nt face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D"#0000ff">4500=A4=B8</fon=
t><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D"#ff0000">(=A5=AD=A7=
=A1=A8C=A4@=A6=B8=C2I=BE\</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9=
" color=3D"#0000ff">0.0300=A4=B8</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=
=C5=E9" color=3D"#ff0000">)</font></strong></p>
			<p style=3D"MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px" align=3D"center">
			<strong><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D"#ff0000">(=
3)</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D"#0000ff">=A5=
=AB=BB=F96=B8U=A4=B8</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" col=
or=3D"#ff0000">=A1A</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" colo=
r=3D"#006600">45=B8U=A6=B8</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9=
" color=3D"#ff0000">=C2I=BE\=B2v=A1A=A5=BB=B3=E6=A6=EC=AFS=B4f=BB=F9=AE=E6=

</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D"#0000ff">12500=
=A4=B8</font><font face=3D"=B5=D8=B1d=B2=D3=B6=EA=C5=E9" color=3D"#ff0000"=
>(=A5=AD=A7=A1=A8C=A4@=A6=B8=C2I=BE\</font><font face=3D"=B5=D8=B1d=B2=D3=B6=
=EA=C5=E9" color=3D"#0000ff">0.0277=A4=B8</font><font face=3D"=B5=D8=B1d=B2=
=D3=B6=EA=C5=E9" color=3D"#ff0000">)</font></strong><b><br>
			<br>
			<a target=3D"_blank" href=3D"http://www.myhysp.com/mail/">
			<font color=3D"#006600">=A5u=ADn=A7A=ACO=B0=B5YAHOO=A9=E7=BD=E6=AA=BA=A9=
=CE=ACO=BA=F4=B8=F4=C1=CA=AA=AB=A1B=B9q=A4l=B0=D3=B0=C8=A1B=AA=F7=BF=C4=AB=
O=C0I=A1B=BB=C8=A6=E6=B6U=B4=DA=A1B=B6=C7=BEP=A1B=AA=BD=BEP=A1B=A4@=AF=EB=B7=
~=B0=C8...</font></a></b></p>
			<p align=3D"center" style=3D"margin-top: 0; margin-bottom: 0">=A1@</p>
			<p align=3D"center" style=3D"margin-top: 0; margin-bottom: 0"><b>
			<a target=3D"_blank" href=3D"http://www.myhysp.com/mail/">
			<font color=3D"#990033">=A5u=ADn=A6=B3=A4F=A7=DA=AD=CC=C0=B0=A7A=AB=C5=B6=
=C7=A1A=A7A=B4N=A5i=A5H=AB=DC=AA=BD=B1=B5=AA=BA=A7=E2=A7A=AA=BA=B2=A3=AB~=B1=
H=A8=EC=B9=EF=A4=E8=AA=BA=ABH=BDc=A1A=B4=A3=B0=AA=A7A=B2=A3=AB~=AA=BA=C3n=A5=
=FA=B2v<br>
			=A4]=B7|=BA=A5=B1=B5=B4=A3=B0=AA=A7A=AA=BA=B7~=C1Z=B3=E1=A1I</font></a>=

<br>
			<br>
			<font color=3D"#990033">
			<a target=3D"_blank" href=3D"http://www.myhysp.com/mail/">
			<font color=3D"#FF0000">=A8=F3=A7U=A4=A4=A4p=A5=F8=B7~=A9=CE=BCt=B0=D3=A1=
A=A5H=B3=CC=A7C=B7G=AA=BA=BA=F4=B8=F4=A6=E6=BEP=A6=A8=A5=BB=A1A=B8`=AC=D9=A4=
=A3=A5=B2=ADn=AA=BA=B7~=B0=C8=B3=E6=A6=EC=A4H=AD=FB=B6}=BEP=A1A=B5o=B4=A7=B3=
=CC=A4j=AA=BA=B8g=C0=D9=AE=C4=AFq=A1C</font></a><br>
			</font>
			<br>
			<font color=3D"#0000FF">
			<a target=3D"_blank" href=3D"http://www.myhysp.com/mail/">
			<font color=3D"#663300">=A4=EB=A4J=A6=CA=B8U=ABD=C3=F8=A8=C6=A1A=B1z=A6=
=B3=A6b=B0=B5=BA=F4=A9=E7=BD=E6=AAF=A6=E8=B6=DC=A1H<br>
			=ACO=A7_=C4=B1=B1o=B3=A3=A8S=A6=B3=A5=CD=B7N=A9O=A1H<br>
			=A8=BA=ACO=B7=ED=B5M=B1z=A8S=A6=B3=A7=E2=B1z=AA=BA=BA=F4=AF=B8=AB=C5=B6=
=C7=A5X=A5h</font></a><br>
			</font>
			<br>
			<a target=3D"_blank" href=3D"http://www.myhysp.com/mail/">=A6=B3=A4@=AD=
=D3=AB=C8=A4=E1=BD=D0=A7=DA=AD=CC=A5N=B5o=A4=A7=AB=E1=A1A=A5L=AA=BA=C1=CA=AA=
=AB=BA=F4=AF=B8=A4W=A4@=A4=D1<br>
			=ADq=B3=E6250=A6h=B1i=A1A=ACO=AD=EC=A5=BB=AA=BA=A4=AD=AD=BF=A1C<br>
			=A7O=A6A=B5S=BF=DD=A4F=A1A=A7O=BF=F9=B9L=B3o=AD=D3=C1=C8=A4j=BF=FA=AA=BA=
=BE=F7=B7|=A1C</a></b><p align=3D"center" style=3D"margin-top: 0; margin-b=
ottom: 0">
			<font color=3D"#800000" size=3D"7"><b>=BA=F4=A7} www.myhysp.com/mail</b=
></font><br>
=A1@</td>
        </tr>
        </table>
    </div>
    </td>
  </tr>

</table>
</div>
<!-- End ImageReady Slices -->
<cleaned_tag content=3D"Microsoft FrontPage 5.0" name=3D"GENERATOR" />
<cleaned_tag content=3D"FrontPage.Editor.Document" name=3D"ProgId" />
<cleaned_tag content=3D"text/html; charset=3Dbig5" http-equiv=3D"Content-T=
ype" />

</body>

</html>



peppy

------
is this different from bug 153401 ?
I'm not sure. This source was copied from the View Source frame directly. It would only be the same if View Source and Save as HTML use the same serialization routine that omits the charset data from the email header's content type field, and that somehow the message header display routine gets its charset from the serialized source which I doubt very much.

Nevertheless, the behavior of this bug, it's primary concern and the parts that it is affecting are very completely different from bug 153401, so I would lean on no.
BTW, I would happily provide a saved .eml source file privately  at anyone trying to fix this bug's request.
(In reply to comment #3)
> BTW, I would happily provide a saved .eml source file privately  at anyone
> trying to fix this bug's request.

Could find a message that you could share publicly ? That would make things easier .
Keywords: testcase-wanted
Well my IP and email address is going to be on file and I'm not sure I want to edit the file in case anything is changed during serialization. If you are fixing it then I'll send you the file privately and you can write your test case then.
There's a second problem that may or may not be related to this bug.

Before I go any further I need to be clear that the above problem and test case was produced with a utf-8 character encoding under the view menu, and auto detect set to Chinese.

Now this is a related problem. As I was changing the auto-detect encodings to different values while having utf-8 set as the char encoding, the message pane seems to be displaying the source in plane email encoded text with all the =A5=E8 stuff in it and a full header displayed in the body. If I want to see the message decoded, I had to click another email in the message list pane and then go back to the message I was looking at (all the char encoding, and auto-detect settings remained the same).

Lastly, if I change the char encoding to big-5 (not auto-detect), the above message could be successfully decoded with the subject and body both properly rendered.
Attached file Control test case — 
This is an email I sent to myself from TB 3.0.1. It displays fine in the message list and message preview pan in TB by default.
is this still seen when using version 5?
Keywords: testcase-wanted → testcase
When you send a webpage with special characters in the title from Firefox ("Send Link") via Outlook those characters are passed wrong into Outlooks mail-subject-line. For example, if you try to send this very bugzilla-page the subject becomes:

Bug 537869 – message subjects doesn't use the right charset


Another example:

If you send this page (with German a Umlaut in the page-title):
http://www.heise.de/newsticker/meldung/Do-not-Track-Mozilla-veroeffentlicht-Zahlen-und-Einrichtungshilfe-1340365.html 

You get this in the Outlook-subject-line:
heise online - Do not Track: Mozilla veröffentlicht Zahlen und Einrichtungshilfe

instead of (correctly):
heise online - Do not Track: Mozilla veröffentlicht Zahlen und Einrichtungshilfe


Switching the standard-charset from ISO-8859 to UTF-8 within Firefox does not change the behaviour. Even in the latest Firefox 6.0.2 the problem is not solved.
Severity: normal → S3
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: