580261 - Some events on a CalDAV Calendar are not displayed if an event in the calendar has an incorrect URL for an attachment

Status: RESOLVED WORKSFORME

(Calendar :: Provider: CalDAV, defect)

Description

[Tchesmeli serge]

User-Agent:       Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.6) Gecko/20100625 Firefox/3.6.6
Build Identifier: Mozilla/5.0 (X11; U; Linux i686; fr; rv:1.9.2.4) Gecko/20100608 Lightning/1.0b2pre Thunderbird/3.1

I have calendar on a davical server. It's work perfectly with evolution, iphone.
But under lightning some meetings are missing (not displayed).
Exemple of a meeting not displayed (some information have been masked by XXXX):

BEGIN:VEVENT

CREATED:20090622T131055Z

LAST-MODIFIED:20100413T072955Z

DTSTAMP:20100413T072955Z

UID:

 040000008200E00074C5B7101A82E0080000000010325AA3E523C901000000000000000010

 0000000C10FAC5AABC9E468F4B4171ED27264C

SUMMARY:CoOPS

STATUS:CONFIRMED

ORGANIZER;RSVP=FALSE;CN=serge tchesmeli:mailto:[e-mail]

RRULE:FREQ=WEEKLY;BYDAY=TH;WKST=SU

EXDATE:20090827T080000Z

X-MOZ-LASTACK:20100413T072955Z

DTSTART;TZID=Europe/Paris:20081002T100000

DTEND;TZID=Europe/Paris:20081002T110000

X-MOZ-LASTACK:20091109T175411Z

X-MOZ-GENERATION:33

SEQUENCE:6

DESCRIPTION:Quand : A lieu chaque jeudi à compter du 02/10/2008 de 10:00 

 à 12:00 (GMT+02:00) Bruxelles\, Copenhague\, Madrid\, 

 Paris.\nEmplacement : Pont tél. XXXXXXXX + 1 + 120120 \; Coopnet coops 

 + XXXXXX (jour + mois)\n\n*~*~*~*~*~*~*~*~*~*

LOCATION:Pont tél. XXXXXXXXX + X + XXXXX \; Coopnet XXXXX + XX XXX 

 (jour + mois)

TRANSP:OPAQUE

X-EVOLUTION-CALDAV-HREF:

 /caldav.php/stchesmeli/home/040000008200E00074C5B7101A82E0080000000010325A

 A3E523C9010000000000000000100000000C10FAC5AABC9E468F4B4171ED27264C.ics

X-EVOLUTION-CALDAV-ETAG:"bd7807a4b7af2db401c68c33598365a5"

BEGIN:VALARM

TRIGGER;VALUE=DURATION:-PT15M

DESCRIPTION:Mozilla Alarm: CoOPS

ACTION:DISPLAY

X-EVOLUTION-ALARM-UID:20100430T123251Z-3125-1000-1-5@stchesmeli

END:VALARM

END:VEVENT


You can contact me for more information, test, ...

Reproducible: Always

Steps to Reproduce:
1. configure the caldav calendar in lighting, some meetings are not displayed

Actual Results:  
 configure the caldav calendar in lighting, some meetings are not displayed

Comment 1

[Tchesmeli serge]

Sorry, in description i have pasted the event has seen in evolutuion.
Here is the event as seen with a wget on the davical uri:

 

BEGIN:VCALENDAR
PRODID:-//Mozilla.org/NONSGML Mozilla Calendar V1.1//EN
VERSION:2.0
BEGIN:VTIMEZONE
TZID:Europe/Paris
X-LIC-LOCATION:Europe/Paris
BEGIN:DAYLIGHT
TZOFFSETFROM:+0100
TZOFFSETTO:+0200
TZNAME:CEST
DTSTART:19700329T020000
RRULE:FREQ=YEARLY;INTERVAL=1;BYDAY=-1SU;BYMONTH=3
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
TZNAME:CET
DTSTART:19701025T030000
RRULE:FREQ=YEARLY;INTERVAL=1;BYDAY=-1SU;BYMONTH=10
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
CREATED:20090622T131055Z
LAST-MODIFIED:20100413T072955Z
DTSTAMP:20100413T072955Z
UID:
 040000008200E00074C5B7101A82E0080000000010325AA3E523C901000000000000000010
 0000000C10FAC5AABC9E468F4B4171ED27264C
SUMMARY:CoOPS
STATUS:CONFIRMED
ORGANIZER;RSVP=FALSE;CN=serge tchesmeli:mailto:[e-mail]
RRULE:FREQ=WEEKLY;INTERVAL=1;BYDAY=TH;WKST=SU
EXDATE:20090827T080000Z
X-MOZ-LASTACK:20100413T072955Z
DTSTART;TZID=Europe/Paris:20081002T100000
DTEND;TZID=Europe/Paris:20081002T110000
X-MOZ-LASTACK:20091109T175411Z
X-MOZ-GENERATION:33
SEQUENCE:6
DESCRIPTION:Quand : A lieu chaque jeudi à compter du 02/10/2008 de 10:00 
 à 12:00 (GMT+02:00) Bruxelles\, Copenhague\, Madrid\, 
 Paris.\nEmplacement : Pont tél. XXXX + X + XXXXX \; Coopnet coops 
 + mdp jjmm (jour + mois)\n\n*~*~*~*~*~*~*~*~*~*
LOCATION:Pont tél. XXXXXX + 1 + XXXXX \; Coopnet coops + mdp jjmm 
 (jour + mois)
TRANSP:OPAQUE
BEGIN:VALARM
TRIGGER;VALUE=DURATION:-PT15M
DESCRIPTION:Mozilla Alarm: CoOPS
ACTION:DISPLAY
END:VALARM
END:VEVENT
END:VCALENDAR

Comment 2

[Nathaniel Madura]

Could you save the following into a file name lightningtest.xml
<?xml version="1.0" encoding="utf-8"?>
<D:propfind xmlns:D="DAV:">
	<D:prop>
		<D:getcontenttype/>
		<D:resourcetype/>
		<D:getetag/>
	</D:prop>
</D:propfind>

And then execute the following command?

curl --user '{username}' --digest -X "PROPFIND" --data "@lightningtest.xml" -H "Accept:" -H "Content-Type: text/xml; charset=utf-8" -H "Depth: 0" {url-of-offending-meeting}

And then post the results?



This is what it looks like in my setting (Apple iCal Server):
$ curl --user 'xxxxxxxxx' --digest -X "PROPFIND" --data "@lightningtest.xml" -H "Accept:" -H "Content-Type: text/xml; charset=utf-8" -H "Depth: 0" https://server.edu:8443/calendars/users/xxxxxxxxx/FCCE8480-F370-44E9-B4AC-BCF4F762C23F/0B655AE0-F86C-413C-986A-5AC4E4ED4E8B.ics
Enter host password for user 'xxxxxxxxx':
<?xml version='1.0' encoding='UTF-8'?><multistatus xmlns='DAV:'>
  <response>
    <href>/calendars/users/xxxxxxxxx/FCCE8480-F370-44E9-B4AC-BCF4F762C23F/0B655AE0-F86C-413C-986A-5AC4E4ED4E8B.ics</href>
    <propstat>
      <prop>
        <getcontenttype>text/plain</getcontenttype>
        <resourcetype/>
        <getetag>"8F1661-1EF-4ACBA2BC"</getetag>
      </prop>
      <status>HTTP/1.1 200 OK</status>
    </propstat>
  </response>
</multistatus>

Comment 3

[Tchesmeli serge]

Thanks for awnser.
FYI, i have deleted all my calendar on the davical server and re-created it with an imported ics evolution export. But it's worse, now i see only 1 event (or meeting) on 10.

Here what you ask:

<?xml version="1.0" encoding="utf-8" ?>
<multistatus xmlns="DAV:">
 <response>
  <href>/caldav.php/stchesmeli/home/040000008200E00074C5B7101A82E00800000000305699ABEF2CCB010000000000000000100000004AD03898DB8B5C429A90903230605C20-20100727T071932Z.ics</href>
  <propstat>
   <prop>
    <getcontenttype>text/calendar</getcontenttype>
    <resourcetype/>
    <getetag>8cd39f00ac8581d57aaac96f5133937c</getetag>
   </prop>
   <status>HTTP/1.1 200 OK</status>
  </propstat>
 </response>
</multistatus>

Comment 4

[Nathaniel Madura]

Using the same lightningtest.xml file as before can you run the following?
(note change in depth, and url)

curl --user '{username}' --digest -X "PROPFIND" --data "@lightningtest.xml" -H
"Accept:" -H "Content-Type: text/xml; charset=utf-8" -H "Depth: 1"
{url-of-offending-calendar}

You should get output similar to the proceeding except there should be one for every event.

1) Do you get all of the events? 
2) Are there any events that show a status other than 200?
3) are there any events that show a content type other than text/calendar?

Additionally, from within thunderbird go to tools > Error Console. Do you see anything under Warning or Error?

Comment 5

[Tchesmeli serge]

1) It seems i get all my events (see http://ns1.st-hebergement.net/log.txt).

2) First show a 404 for "getetag", all the others are 200:
<?xml version="1.0" encoding="utf-8" ?>
<multistatus xmlns="DAV:" xmlns:C="urn:ietf:params:xml:ns:caldav">
 <response>
  <href>/caldav.php/stchesmeli/home/</href>
  <propstat>
   <prop>
    <getcontenttype>httpd/unix-directory</getcontenttype>
    <resourcetype>
     <collection/>
     <C:calendar/>
    </resourcetype>
   </prop>
   <status>HTTP/1.1 200 OK</status>
  </propstat>
  <propstat>
   <prop>
    <getetag/>
   </prop>
   <status>HTTP/1.1 404 Not Found</status>
  </propstat>
 </response>
 <response>

3) Only the first entry has <getcontenttype>httpd/unix-directory</getcontenttype>

 $ cat log.txt | grep getcontenttype | grep -v text/calendar
    <getcontenttype>httpd/unix-directory</getcontenttype>


In fact, i think the first entry is the "directory" entry and not an event of the calendar, it's why content and getetag and like this.
All the others entry are ok:

Comment 6

[Nathaniel Madura]

Yes you are correct, the last request you made starts at the "Calendar" level, and retrieves the requested properties at that level and one level down (Depth=1)

Unfortunately, Everything so far looks good. 

could you launch Thunderbird and enable Lightning debug information?
Edit > Preferences > Advanced > Config Editor
Filter on "calendar.debug"
and set both values to "True"

Then quit thunderbird and relaunch it from the command line like this...
$ thunderbird &> thunderbird-dbg-log.txt

That should spit gobs of debug information out. If you are willing to post that like you did the last log file I would appreciate it.

Comment 7

[Tchesmeli serge]

I have corrected the command line, debug is on stderr, so thunderbird & 2> thunderbird-dbg-log.txt ;)

Debug help me, it seems thunderbird stop on wrong attached document. Because it was an imported ics evolution export, path to attached document are wrong, like:

ATTACH:/home/stchesmeli/.evolution/cache/tmp/evolution-tmp-YHmhlv/Catalogue_CHG_Standard_20100611.xls

See log:  http://ns1.st-hebergement.net/thunderbird-dbg-log.txt

So, i have supressed all events with attached document. I see more meeting, but still missing some.

New log after supress meeting with attached document:  http://ns1.st-hebergement.net/thunderbird-dbg-log.txt

Comment 8

[Tchesmeli serge]

Oops, i correct myself, new log after supress meeting with attached document: 
http://ns1.st-hebergement.net/thunderbird-dbg-log-5.txt

Comment 9

[Tchesmeli serge]

In fact, i have missed some event with attched document. I have supress all and now ALL my events are visible! :)
So the bug is, if a meeting have an attached document with a wrong path, lightning stop on this meeting.

Comment 10

[Nathaniel Madura]

I can't figure out how to change the bug description, could someone please change it to read

Some events on a CalDAV Calendar are not displayed if an event in the calendar has an incorrect URL for an attachment

Comment 11

[Tchesmeli serge]

ok i have update the description

Comment 12

[Stefan Sitter [:ssitter]]

Severity blocker is incorrect, please see <https://bugzilla.mozilla.org/page.cgi?id=fields.html#bug_severity>. Please use flags like blocking‑calendar1.0 to request blocking by setting them to ?.

Comment 13

[Philipp Kewisch [:Fallen][☁️📆]]

I've tested this and it works for me. Admittedly not on a DAViCal server since it was unfortunately unavailable, but I think we should be good. If the issue persists, please reopen this bug, providing additional details.