738609 - content of text fields is truncated if a non-BMP unicode character is present

Status: RESOLVED DUPLICATE of bug 405011

(Bugzilla :: Database, defect)

Description

[Jonathan Kew [:jfkthame]]

It doesn't seem to be possible to submit a bug report or comment that includes supplementary-plane Unicode characters; the submitted text (bug summary, comment) is truncated at the place where the first non-BMP character occurs.

For example, I'll include the title (translation of "What is Unicode?" into Deseret) from the page http://www.unicode.org/standard/translations/deseret.html in the following paragraph. I expect it, and any following text, will be lost.

Here it is, followed by a few more English words: "

Comment 1

[Jonathan Kew [:jfkthame]]

Sure enough, comment #0 was truncated. This occurs whether I use Firefox or Safari to submit the comment.

Comment 2

[Simon Montagu :smontagu]

See bug 676880 and bug 405011. I won't dupe this in case there is some way to fix it today that didn't exist back then.

Comment 3

[Jonathan Kew [:jfkthame]]

What database is our bugzilla using? According to http://dev.mysql.com/doc/refman/5.5/en/charset-unicode-sets.html,

"MySQL 5.5 supports these Unicode character sets:
* ucs2, the UCS-2 encoding of the Unicode character set using 16 bits per character.
* utf16, the UTF-16 encoding for the Unicode character set; like ucs2 but with an extension for supplementary characters.
* utf32, the UTF-32 encoding for the Unicode character set using 32 bits per character.
* utf8, a UTF-8 encoding of the Unicode character set using one to three bytes per character.
* utf8mb4, a UTF-8 encoding of the Unicode character set using one to four bytes per character."

All except "ucs2" and "utf8" should support supplementary-plane characters.

Comment 4

[Frédéric Buclin]

(In reply to Simon Montagu from comment #2)
> I won't dupe this in case there is some way to fix it today that didn't exist back then.

This is still a dupe. We don't need additional bugs for the same issue. If a bug must be reopened, then that's bug 405011.