279461 - Accentuated characters make iCal imported events don't display correctly

Status: RESOLVED INVALID

(Calendar :: Sunbird Only, defect)

Description

[Thomas Despoix]

User-Agent:       Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.5) Gecko/20041107 Firefox/1.0
Build Identifier: 

The GUI renders incorrectly both in task bar and main wiew

Reproducible: Always

Steps to Reproduce:
1. Subscribe to a calendar with accentuated charc

Comment 1

[gekacheka]

Could you please provide more specific information to reproduce this bug:

What is the string that does not display correctly?
(need specific string to reproduce the bug, and to check if this bug is the same
as a previously reported bug, such as the bug that appears only when certain
characters are the last character in the title.)

What is displayed instead of the correct string?

Where does the string appear?  Is it the title of a calendar?  Is it a title of
an event?

Thanks.

Comment 2

[Thomas Despoix]

Attachment: A test case calendar file showing the bug

Load this calendar file to view the display bug.
It becomes obvious when rolling over task titles in the task bar: broken text
always changes.

Comment 3

[Thomas Despoix]

(In reply to comment #2)
> It becomes obvious when rolling over task titles in the task bar: broken text
> always changes.

It looks like accentuated (french, in the test case) contains some kind of
javascript escaping character... We can actually view pieces of js-like code or
broken chars. Very unusual.

Hope this helps anyway

Comment 4

[gekacheka]

Attachment: fixed up test case: add line breaks, continuation spaces, remove events

(I was not able to load the file
https://bugzilla.mozilla.org/attachment.cgi?id=173540 directly, probably
because it is not a validly formatted file --- it looks like it has been
autofilled, perhaps by a browser, so the original line breaks are not
preserved.  I was able to open the file after I edited it to put line breaks
back in before each icalendar keyword, putting a space at the beginning of each
continued description line, and after removing the events, as I was getting UTF
errors on the whole file.)

I was able to reproduce the problem after these changes.  The titles of tasks
in the task list do indeed show random garbage characters and '?'s, including
sometimes code strings, though in my case it appeared to be xul node ids.  The
garbage changes on each redisplay, whenever you move the mouse into or out of
that pane.

The problem might be that the file is encoded as iso-latin-1 and sunbird tries
to decode it as UTF-8.

Even though it is caused by bad input, it looks like something is failing to
detect failure and is using uninitialized pointers in strings.

Comment 5

[Michiel van Leeuwen (email: mvl+moz@)]

If the file is encoded in latin-1, it is an invalid ics file. ics files are
always encoded as utf8.
Did mozilla calendar/sunbird produce the file?

Comment 6

[Thomas Despoix]

(In reply to comment #5)
> If the file is encoded in latin-1, it is an invalid ics file. ics files are
> always encoded as utf8.
> Did mozilla calendar/sunbird produce the file?

It's been produced on-th-fly by a PHP script at that adress:
http://www.openxtrem.com/projects_ws/ics/?username=mytto

Then I saved the file through the browser to make the testt case file. I saved
it with the browser, not chosing unicode as character encoding. Now i saved it
using UTF-8 character encoding, but it doesn't work any better...

Follow the URL previous URL if you want to make tests.

I can also change the PHP if needed, but though I have good programming skills,
I don't really know iCal standard. Is there somewhere an iCal validator or
something, cuz the official documentation is a bit abstruse.

Anyway whatever the cause of the problem, i'd be nice if Sunbirds were a bit
more verbose.

Thanks for your precious help.

Comment 7

[Michiel van Leeuwen (email: mvl+moz@)]

The ical spec just defines that it is always utf8. nothing complicated about that :)
Your script should output utf8, but at the moment it return windows-1252.

Showing random strings is wrong, but i think that might have been fixed already.
Newer builds will use a proper unicode convertor. At least in my cvs build i get
an exception. (that is not really verbose to the user, that might need fixing)

Comment 8

[Thomas Despoix]

(In reply to comment #7)
> The ical spec just defines that it is always utf8. nothing complicated about
that :)

OK for that ;) I meant the grammar structure is quite complexe, not to say
complicated. I've heard of an XML alternative. Does Sunbird support it, because
XML files are a thousand times easier to produce, read, validate and parse, from
my perspective

> Your script should output utf8, but at the moment it return windows-1252.

Actually, I dont ask PHP to use whatever charaacter encoding, it must be
standard behaviour. The point is I don't have a clue how to change it.

> Showing random strings is wrong, but i think that might have been fixed already.
> Newer builds will use a proper unicode convertor. At least in my cvs build i get
> an exception. (that is not really verbose to the user, that might need fixing)

Is it also true for v0.2 final release?

Comment 9

[Joey Minta]

Resolving invalid, given that the problem was with the reporter's php script, not sunbird.