779087 - The sourcecode view is broken when opening mail written in UTF-16 (If mail of charset=UTF-16, View/Message Source shows entire message source data as UTF-16)

Status: NEW

(Thunderbird :: Message Reader UI, defect)

Description

[Christof Spies]

Attachment: Abwesenheitsnotiz.eml

User Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:14.0) Gecko/20100101 Firefox/14.0.1
Build ID: 20120713134347

Steps to reproduce:

I openend the message with Strg+U to see the sourcecode of the file.


Actual results:

I got only strange characters like this:
剥瑵牮ⵐ慴栺‼獫牡獮祡湳歩祀楣敦⹣潭㸍੄敬楶敲敤ⵔ漺⁣獰楥獀楣敦⹣潭ഊ剥捥楶敤㨠晲潭潣慬桯獴
汯捡汨潳琠嬱㈷⸰⸰⸱崩ഊॢ礠獡杮楸⹩捥昮捯洠⡐潳瑦楸⤠睩瑨⁅卍呐⁩搠〲㐲䔱㠳㤴〰㌻ഊ॔略Ⱐ㌱⁊畬′〱㈠〸㨵㘺㐴〲〰
䍅協⤍੘ⵖ楲畳ⵓ捡湮敤㨠䑥扩慮⁡浡癩獤⵮敷⁡琠獡杮楸⹩捥昮捯洍੒散敩癥携⁦牯洠獡杮楸⹩捥昮捯洠⡛ㄲ㜮〮〮ㅝ⤍ਉ批潣慬桯獴
獡杮楸⹩捥昮捯洠嬱㈷⸰⸰⸱崩
慭慶楳搭湥眬⁰潲琠㄰〲㐩ഊॷ楴栠䱍呐⁩搠祉效灊湙做潑㬠呵攬″ㄠ䩵氠㈰ㄲ‰㠺㔶㨴㌠⬰㈰〠⡃䕓吩ഊ剥捥楶敤㨠晲潭⁛ㄹ㈮ㄶ㠮〮ㄱ㉝
畮歮潷渠嬳㜮㜷⸱㌰⸳㑝⤍ਉ⡁畴桥湴楣慴敤⁳敮摥爺⁳歲慳湹慮獫楹䁩捥昮捯洩ഊॢ礠獡杮楸⹩捥昮捯洠⡐潳瑦楸⤠睩瑨⁅卍呐十⁩搠㈵㉆㜱㠳㤴〰㈻ഊ॔略Ⱐ㌱⁊畬′〱㈠〸㨵㘺㐳〲〰
䍅協⤍੍敳獡来ⵉ䐺‼㔰ㄷ㠱䅁⸳〸〹〷䁩捥昮捯派ഊ䑡瑥㨠呵攬″ㄠ䩵氠㈰ㄲ‱〺㔶㨴㈠⬰㐰」੆牯洺⁳歲慳湹慮獫楹‼獫牡獮祡湳歩祀楣敦⹣潭㸍੕獥爭䅧敮琺⁍潺楬污⼵⸰
坩湤潷猠乔‶⸱㬠坏圶㐻⁲瘺ㄴ⸰⤠䝥捫漯㈰ㄲ〷ㄳ⁔桵湤敲扩牤⼱㐮」੍䥍䔭噥牳楯渺‱⸰ഊ呯㨠偡瑲楣欠創晦楮朠㱰牵晦楮杀楣敦⹣潭㸍੃䌺⁃桲楳瑯映印楥猠㱣獰楥獀楣敦⹣潭㸬‍ਠ≂敲湤⁓敬扭慮測⁉䍅䘠䝭扈∠㱢獥汢浡湮䁩捥昮捯派ഊ卵扪散琺⁒攺⁁扷敳敮桥楴獮潴楺ഊ剥晥牥湣敳㨠㰵〱ㄳ㘴䈮㠰㄰〰㑀楣敦⹣潭㸠㰵〱ㄳ㝁㘮㌰㄰㄰㥀楣敦⹣潭㸍੉渭剥灬礭呯㨠㰵〱ㄳ㝁㘮㌰㄰㄰㥀楣敦⹣潭㸍੃潮瑥湴ⵔ祰攺畬瑩灡牴⽡汴敲湡瑩癥㬍ਠ扯畮摡特㴢ⴭⴭⴭⴭⴭⴭ〴〱〱〸〳〹〶〳〲〶〸〷∍਍੔桩猠楳⁡畬瑩⵰慲琠浥獳慧攠楮⁍䥍䔠景牭慴⸍ਭⴭⴭⴭⴭⴭⴭⴰ㐰㄰㄰㠰㌰㤰㘰㌰㈰㘰㠰㜍੃潮瑥湴ⵔ祰攺⁴數琯灬慩渻⁣桡牳整㵕呆ⴱ㘻⁦潲浡琽晬潷敤ഊ䍯湴敮琭呲慮獦敲ⵅ湣潤楮机‷扩琍਍਍ਭⴭⴭⴭⴭⴭⴭⴰ㐰㄰㄰㠰㌰㤰㘰㌰㈰㘰㠰㜍੃潮瑥湴ⵔ祰攺⁴數琯桴浬㬠捨慲獥琽啔䘭ㄶഊ䍯湴敮琭呲慮獦敲ⵅ湣潤楮机‸扩琍਍૿︼ഊⴭⴭⴭⴭⴭⴭⴭ〴〱〱〸〳〹〶〳〲〶〸〷ⴭഊ


Expected results:

I'd like to see this:
Return-Path: <[e-mail]>
Delivered-To: [e-mail]
Received: from localhost (localhost [127.0.0.1])
	by sagnix.icef.com (Postfix) with ESMTP id 0242E18394003;
	Tue, 31 Jul 2012 08:56:44 +0200 (CEST)
X-Virus-Scanned: Debian amavisd-new at sagnix.icef.com
Received: from sagnix.icef.com ([127.0.0.1])
	by localhost (sagnix.icef.com [127.0.0.1]) (amavisd-new, port 10024)
	with LMTP id yIeHpJnYPZoQ; Tue, 31 Jul 2012 08:56:43 +0200 (CEST)
Received: from [192.168.0.112] (unknown [37.77.130.34])
	(Authenticated sender: [e-mail])
	by sagnix.icef.com (Postfix) with ESMTPSA id 252F718394002;
	Tue, 31 Jul 2012 08:56:43 +0200 (CEST)
Message-ID: <[e-mail]>
Date: Tue, 31 Jul 2012 10:56:42 +0400
From: skrasnyanskiy <[e-mail]>
User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:14.0) Gecko/20120713 Thunderbird/14.0
MIME-Version: 1.0
To: Patrick Ruffing <[e-mail]>
CC: Christof Spies <[e-mail]>, 
 "Bernd Selbmann, ICEF GmbH" <[e-mail]>
Subject: Re: Abwesenheitsnotiz
References: <[e-mail]> <[e-mail]>
In-Reply-To: <[e-mail]>
Content-Type: multipart/alternative;
 boundary="------------040101080309060302060807"

This is a multi-part message in MIME format.
--------------040101080309060302060807
Content-Type: text/plain; charset=UTF-16; format=flowed
Content-Transfer-Encoding: 7bit


--------------040101080309060302060807
Content-Type: text/html; charset=UTF-16
Content-Transfer-Encoding: 8bit

ÿþ<
--------------040101080309060302060807--

Comment 1

[WADA:World Anti-bad-Duping Agency]

At View/Message Source panel of attached mail in Tb 13.0, if View/Character Encoding is changed to UTF-8, message source is shown as expected, except following text/html part data.
> ��<
Binary of text/html part data in message data stream =
    0xFFFE  (BOM,little-endian)
  + 0x3C    (< in ascii. instead of U+003C in UTF-16)
  + 0x0D0A  (CRLF in ascii. instead of U+000D,U+000A in UTF-16)
This corresponds to ÿþ<[CRLF] in data you pasted(0xFFFE of iso-8859-1 = ÿþ).
> http://en.wikipedia.org/wiki/Byte_order_mark#UTF-16

View/Message Source of Tb looks to show UTF-8 data as charset of Content-Type=UTF-16(UTF-16LE in this case).

This bug is also observed with null message body(payload) of text/plain mail or text/html mail.
  Data in Tb's local mail folder file.
  (a)  Other message headers...
       Content-Type: text/plain; charset=UTF-16
       [CRLF]
       [EOF](End of file, no data after Null line as delimiter)
  (b)  Other message headers...
       Content-Type: text/html; charset=UTF-16
       [CRLF]
       [EOF](End of file, no data after Null line as delimiter)
So, data in text/plain part or text/html part is not relevant to problem.

Confirmig.

Comment 2

[Moritz Franckenstein]

Windows 2003 Server with TB 16.0.2: I can confirm this problem. In addition: when manually trying to switch the source code view to UTF-16 encoding, an error message pops up:
[Exception... "Component returned failure code: 0x805e0006 [nsIWebNavigation.reload]"  nsresult: "0x805e0006 (<unknown>)"  location: "JS frame :: chrome://global/content/bindings/browser.xml :: reloadWithFlags :: line 103"  data: no]

The whole email message isn't displayed at all in normal view here, so the source code view is really secondary :) - I have created the UTF-16 Email myself and sent to myself (imap). It appears empty in the sent folder and the received one in the inbox, too.

Comment 3

[David Lechner (:dlech)]

Error message in comment 2 is in Bug 814382

Comment 4

[David]

Moreover you cannot reply to that kind of email. The recipient will receive an empty message.
To reproduce it's quite simple. You just have to export any key from the windows registry. The reg file generated is in UCS-2 Little Endian (UTF-16). Compose a mail and add this attachment. If the receiver reply, you won't see what he wrote.