481716 - Hendrix messes up non-ascii characters

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: WebOps: Other, task)

Description

[Jens Müller (:tessarakt)]

User-Agent:       Mozilla/5.0 (X11; U; Linux x86_64; de; rv:1.9.1b2) Gecko/20090223 Gentoo Firefox/3.1b2
Build Identifier: 

When I enter my name, "Jens Müller", in a Hendrix form, it gets messed up in the newsgroup posting (posted utf-8 interpreted as iso-8859-1, proably).

Such messages regularly occur in the .feedback. newsgroups.

Reproducible: Always

Comment 1

[Gervase Markham [:gerv]]

Hi Jens,

I've just tested this with the live thing and my local installation, and can't reproduce the problem. I copied and pasted your name from this bug. 
news://news.mozilla.org:119/[e-mail]
I even tried it with Chinese text and it worked:
news://news.mozilla.org:119/[e-mail]

Gerv

Comment 2

[Jens Müller (:tessarakt)]

Well,
Message-ID: <[e-mail]>
shows it's still broken for me ...

Comment 3

[Gervase Markham [:gerv]]

Hmm. I've just realised that there's no easy way to get Thunderbird to display a particular message given the message ID. Or, for that matter, to display a news:// URL. Can you specify which messages you mean?

Of my two, the first was posted at 15:22 BST today in mozilla.feedback.firefox (title "Jens Müller"), and the Chinese one was posted in mozilla.feedback at 15:23.

Gerv

Comment 4

[Jens Müller (:tessarakt)]

Mine was posted in mozilla.feedback.firefox.prerelease some hours ago, subject "[Hendrix] Umlaut test".

Only the _body_ looks wrong, btw.

I just realised that no MIME headers are set for the body, and special characters in the header are not MIME-encoded.

Comment 5

[Jens Müller (:tessarakt)]

Ah:

The first two "Jens Müller" postings (:19 and :20) show the correct subject Shredder, but an empty sender.

The third one (:21) also shows the correct sender ...

On the other hand, the body looks fine for the first two, while it looks broken for the third ...

Comment 6

[Gervase Markham [:gerv]]

I've found the Umlaut test message, and it looks fine for me in Firefox 3.0b2.

But you are right, we make no particular effort to get this right. And we probably should do it explicitly rather than relying on software to guess correctly. 

Gerv

Comment 7

[Gervase Markham [:gerv]]

OK, I've set all the Content-Types to use UTF-8 explicitly. I've also updated to Namoroka, made Name optional, and beefed up yet further the wording about not submitting private information.

Please CVS update the hendrix.mozilla.org installation.

Thanks,

Gerv

Comment 8

[matthew zeier [:mrz]]

Content updated, should push our shortly.

Comment 9

[Gervase Markham [:gerv]]

mrz: how shortly is "shortly"? http://hendrix.mozilla.org/ doesn't show the new version as of today (2nd September, 4:40pm BST).

Gerv

Comment 10

[matthew zeier [:mrz]]

Shorter than 3 days... oremj?

Comment 11

[Jeremy Orem [:oremj]]

cvs -q up -dP
? skin/planet2.css
RCS file: /cvsroot/mozilla/webtools/hendrix/index.cgi,v
retrieving revision 1.20
retrieving revision 1.21
Merging differences between 1.20 and 1.21 into index.cgi
M index.cgi
RCS file: /cvsroot/mozilla/webtools/hendrix/skin/planet.css,v
retrieving revision 1.7
retrieving revision 1.8
Merging differences between 1.7 and 1.8 into planet.css
M skin/planet.css
P template/error.html.tmpl
P template/index.html.tmpl