889813 - [SMS] Wrong codification of UTF-8 character

Status: RESOLVED FIXED

(Core :: DOM: Device Interfaces, defect)

Description

[isabelrios]

Attachment: Ã character codification

Unagi device 07/03 build: 
Gecko-38e6b25
Gaia-a890df3
Commercial RIL AU .148

STR
1. Start composing a text message
2. When the character counter appears, type an: Ã

EXPECTED
à character should count as one

ACTUAL
The counter goes from one message to the third one after typing à character.
Please see adb logcat attached in case it is useful. 
Also two screenshots, before and after typing the à are attached.

Comment 1

[isabelrios]

Attachment: Befor à character

Comment 2

[isabelrios]

Attachment: After à characther

Comment 3

[Vicamo Yang [:vicamo][:vyang]]

Commercial RIL.

Comment 4

[bhavana bajaj [:bajaj]]

Blocking justification : same as in https://bugzilla.mozilla.org/show_bug.cgi?id=887745#c5 

Also adding qawanted to see if this is reproducible on Moz Ril.

Comment 5

[Anshul]

Phil, could you please have a look?

Comment 6

[Natalya Kot [:nkot]]

The issue reproduces on Moz Ril too, 
same behavior - the counter goes from one message to the third one after typing à character

Unagi
Build  20130708070214
Gecko  http://hg.mozilla.org/releases/mozilla-b2g18/rev/8c0127cc7be3
Gaia   7c40bdaeaffae708342fc773926dcfac5389348e

Comment 7

[pgravel]

à is not part of the gsm 7-bit alphabet so the whole message gets promoted to a higher alphabet when à is typed, which lowers the number of characters available per segment and thus increases the total number of segments being sent.

Can add à -> A mapping for both upper and lower case for when strict7BitEncoding is enabled, if that is what is being requested.

Comment 8

[Anshul]

Isabel, in addition to what Phil mentioned in comment #7, could you please send a complete list of all the characters TEF expects to be treated as strict 7 bit.

Comment 9

[isabelrios]

(In reply to Anshul from comment #8)
> Isabel, in addition to what Phil mentioned in comment #7, could you please
> send a complete list of all the characters TEF expects to be treated as
> strict 7 bit.

Anshul, attached a txt file with the utf-8 characters expected to be supported. 

(In reply to pgravel from comment #7)
> 
> Can add à -> A mapping for both upper and lower case for when
> strict7BitEncoding is enabled, if that is what is being requested.

Yes, that character should be added to avoid problems. Thanks

Comment 10

[isabelrios]

Attachment: utf-8 characters and symbols

Comment 11

[pgravel]

Isabel,

Thanks for that character list, had a couple of questions:

` (grave accent): is not part of the gsm 7bit standard alphabet. I was planning mapping it to ' (apostrophe), let me know if there is a better mapping.

¼, ½, ¾: I don't see a way to input those with any of the keyboard layouts available.

Comment 12

[isabelrios]

Hi Phil, 

> ` (grave accent): is not part of the gsm 7bit standard alphabet. I was
> planning mapping it to ' (apostrophe), let me know if there is a better
> mapping.

That is ok.

> 
> ¼, ½, ¾: I don't see a way to input those with any of the keyboard layouts
> available.
Forget about them as it is not possible to type them.

Thanks

Comment 13

[pgravel]

Fixed in AU_LINUX_GECKO_ICS_STRAWBERRY.01.01.00.019.160