642284 - Recurring events lost on restart of Lightning

Status: UNCONFIRMED

(Calendar :: General, defect)

Description

[Andre]

User-Agent:       Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.15) Gecko/20110307 Firefox/3.6.15
Build Identifier: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.15) Gecko/20110307 Lightning/1.0b2 Lanikai/3.1.9

Whatever type of recurring event that is created will be displayed fine until restart of Lightning. Even recurring events created out of normal events will get lost, thereby also deleting the initial event they were created from.
Reproduced various times on weekly, monthly and user-defined recurring events.

Non-recurring events are not affected.

Used Lightning inside Thunderbird, not standalone (if that matters?)
Not tested on daily/yearly recurrings.

Reproducible: Always

Steps to Reproduce:
1. Create a new event.
[optional: Save event as is, close and restart Thunderbird, reopen event for modification - this will have no influence on the result]
2. Make it to repeat weekly/monthly/user-defined
3. Save & Close
4. As long as Thunderbird is not closed, the event is displayed as defined
5. Close and restart Thunderbird
Actual Results:  
The created series has been lost on restart.

Expected Results:  
The created series should still as it was defined

Comment 1

[Philipp Kewisch [:Fallen][☁️📆]]

What type of calendar server are you using (e.g. Google Calendar via Provider, CalDAV, ics/webdav, ...)

Could you enable calendar.debug.log and calendar.debug.log.verbose in the
advanced config editor? This will give you loads of information on what happens
on a delete in the error console.

Also it would be great if you could test with a recent nightly build of
Lightning (1.0b4pre) together with a Thunderbird 3.3 Alpha or later.

Comment 2

[Andre]

I am not using any extra calendar server. At least I didn't install any knowingly.

What error console did you mean? Does Thunderbird / Lightning have a built-in console mode or did you mean the system's error console? That one is redirected to various log-files on my system which I am not sure to be able to extract the necessary data from. But I will try.

As I have no test-environment installed, I will not install any Alpha versions. (sorry)

Comment 3

[Andre]

Found Error Console in Thunderbird. This is what I get after starting:

===============================================================
Fehler: Error selecting events with recurrence!
[Exception... "Component returned failure code: 0x8000ffff (NS_ERROR_UNEXPECTED) [mozIStorageStatementWrapper.step]"  nsresult: "0x8000ffff (NS_ERROR_UNEXPECTED)"  location: "JS frame :: file:///home/andre/.thunderbird/ahewzlft.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/modules/calUtils.jsm -> file:///home/andre/.thunderbird/ahewzlft.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/calendar-js/calStorageCalendar.js :: cSC_assureRecurringItemCaches :: line 1286"  data: no]
DB Error: library routine called out of sequence
===============================================================

And a few more of the same type:
non recurring events by range (2x)
non recurring todos by range (2x)
alarms for item <xy>

while the doubling in fact are 2 different errors: "not an error" and "library routine called out of sequence"

Comment 4

[Philipp Kewisch [:Fallen][☁️📆]]

Hmm strage, this error happens when an sqlite statement is not reset, we've fixed a bug in the past that ensured this. Could you maybe copy your current profile into a new one and test the alpha versions on that profile?

Comment 5

[Andre]

As mentioned before, I can not test anything with the "alpha versions". And as I have the latest stable version of thunderbird installed, I don't see how that would change anything, if the mentioned fix is already implemented in this version.

By the way: as copying calender-profiles didn't work out too well last time I tried (thereby losing everything I had saved in my calender before), I am quite reluctant to try again.

If it helps anyhow, here is the list of plugins I have installed in TB:
Lightning 1.0b2
MinimizeToTray Plus 1.0.8
Silvermel and Charamel XT 1.3.6

Comment 6

[Konomi]

I have the same problem but with different version of lightning. Lightning seems to randomly delete/forget my repeated events.

OS: Debian Testing x64
Icedove: Mozilla/5.0 (X11; Linux x86_64; rv:10.0.12) Gecko/20130116 Icedove/10.0.12
Lightning: v1.2.3

Comment 7

[Konomi]

Now reporting the problem occuring on new versions of Icedove (Thunderbird) and Lightning:

OS: Debian GNU/Linux jessie/sid
Icedove: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20131005 Icedove/17.0.9
Lightning: v1.9.1

I was hoping after going to a later version of lightning this bug would be gone but no such luck.

Comment 8

[Konomi]

I was going to test Icedove 24 (Thunderbird) and Lightning 2.6 but due to the following bugs I am unable to test any further:

http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=724688
https://bugzilla.mozilla.org/show_bug.cgi?id=921066

If a fix is found will it be backported to older versions?

Comment 9

[Christoph Kaulich]

I have the same problem, and got the following messages using the 4.5a1 nightly version of lightning:

Zeitstempel: 21.09.2015 11:55:32
Fehler: [calStorageCalendar] Message: Error selecting events with recurrence!
Connection Ready: true
Last DB Error Number: 100
Last DB Error Message: unknown error
Database File: C:\Users\kaulich\AppData\Roaming\Thunderbird\Profiles\1pq80ino.default\calendar-data\cache.sqlite
Last DB Statement: [object StatementJSHelper]
Last Statement param [item_id]: 040000008200E00074C5B7101A82E00800000000007A9EF60DA2D001000000000000000010000000AF8909A23FD1FB438B975D496539959C
Last Statement param [cal_id]: 6a87ceb1-3a12-4421-a9c1-e69689c7826f
Last Statement param [QueryInterface]: function QueryInterface() {
    [native code]
}
Exception: TypeError: item.startDate is null
1: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:2418] cSC_logError
2: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:1559] cSC_assureRecurringItemCaches
3: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:720] cSC_getItems_
4: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:662] cSC_getItems/<
5: [null:0] null

Quelldatei: file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js
Zeile: 2418



Zeitstempel: 21.09.2015 11:55:33
Fehler: [calStorageCalendar] Message: Error getting recurrence for item 'Frisör ' ([e-mail])!
Connection Ready: true
Last DB Error Number: 100
Last DB Error Message: unknown error
Database File: C:\Users\kaulich\AppData\Roaming\Thunderbird\Profiles\1pq80ino.default\calendar-data\cache.sqlite
Last DB Statement: [object StatementJSHelper]
Last Statement param [item_id]: [e-mail]
Last Statement param [cal_id]: 9db309f1-a838-4f64-9e45-35f1262ded5c
Last Statement param [QueryInterface]: function QueryInterface() {
    [native code]
}
Exception: [Exception... "[JavaScript Error: "Could not extract integer from ":5"" {file: "resource://calendar/modules/ical.js" line: 92}]'[JavaScript Error: "Could not extract integer from ":5"" {file: "resource://calendar/modules/ical.js" line: 92}]' when calling method: [calIRecurrenceRule::icalProperty]"  nsresult: "0x80570021 (NS_ERROR_XPC_JAVASCRIPT_ERROR_WITH_DETAILS)"  location: "JS frame :: file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js :: cSC_getRecurrenceItemFromRow :: line 1883"  data: yes]
1: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:2418] cSC_logError
2: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:1748] cSC_getAdditionalDataForItem
3: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:1607] cSC_getEventFromRow
4: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:1554] cSC_assureRecurringItemCaches
5: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:720] cSC_getItems_
6: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:662] cSC_getItems/<
7: [null:0] null

Quelldatei: file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js
Zeile: 2418


Zeitstempel: 21.09.2015 11:55:33
Fehler: Error: Could not extract integer from ":5"
Quelldatei: resource://calendar/modules/ical.js
Zeile: 92



Zeitstempel: 21.09.2015 11:55:33
Fehler: [calStorageCalendar] Message: Error getting recurrence for item 'Frisör ' ([e-mail])!
Connection Ready: true
Last DB Error Number: 100
Last DB Error Message: unknown error
Database File: C:\Users\kaulich\AppData\Roaming\Thunderbird\Profiles\1pq80ino.default\calendar-data\cache.sqlite
Last DB Statement: [object StatementJSHelper]
Last Statement param [item_id]: [e-mail]
Last Statement param [cal_id]: 9db309f1-a838-4f64-9e45-35f1262ded5c
Last Statement param [QueryInterface]: function QueryInterface() {
    [native code]
}
Exception: [Exception... "[JavaScript Error: "Could not extract integer from ":5"" {file: "resource://calendar/modules/ical.js" line: 92}]'[JavaScript Error: "Could not extract integer from ":5"" {file: "resource://calendar/modules/ical.js" line: 92}]' when calling method: [calIRecurrenceRule::icalProperty]"  nsresult: "0x80570021 (NS_ERROR_XPC_JAVASCRIPT_ERROR_WITH_DETAILS)"  location: "JS frame :: file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js :: cSC_getRecurrenceItemFromRow :: line 1883"  data: yes]
1: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:2418] cSC_logError
2: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:1748] cSC_getAdditionalDataForItem
3: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:1607] cSC_getEventFromRow
4: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:1554] cSC_assureRecurringItemCaches
5: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:720] cSC_getItems_
6: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:662] cSC_getItems/<
7: [null:0] null

Quelldatei: file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js
Zeile: 2418


Zeitstempel: 21.09.2015 11:55:33
Fehler: [calStorageCalendar] Message: Error getting recurrence for item 'Grüne Tonne' ([e-mail])!
Connection Ready: true
Last DB Error Number: 100
Last DB Error Message: unknown error
Database File: C:\Users\kaulich\AppData\Roaming\Thunderbird\Profiles\1pq80ino.default\calendar-data\cache.sqlite
Last DB Statement: [object StatementJSHelper]
Last Statement param [item_id]: [e-mail]
Last Statement param [cal_id]: 9db309f1-a838-4f64-9e45-35f1262ded5c
Last Statement param [QueryInterface]: function QueryInterface() {
    [native code]
}
Exception: [Exception... "[JavaScript Error: "Could not extract integer from ":0"" {file: "resource://calendar/modules/ical.js" line: 92}]'[JavaScript Error: "Could not extract integer from ":0"" {file: "resource://calendar/modules/ical.js" line: 92}]' when calling method: [calIRecurrenceRule::icalProperty]"  nsresult: "0x80570021 (NS_ERROR_XPC_JAVASCRIPT_ERROR_WITH_DETAILS)"  location: "JS frame :: file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js :: cSC_getRecurrenceItemFromRow :: line 1883"  data: yes]
1: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:2418] cSC_logError
2: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:1748] cSC_getAdditionalDataForItem
3: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:1607] cSC_getEventFromRow
4: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:1554] cSC_assureRecurringItemCaches
5: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:720] cSC_getItems_
6: [file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js:662] cSC_getItems/<
7: [null:0] null

Quelldatei: file:///C:/Users/kaulich/AppData/Roaming/Thunderbird/Profiles/1pq80ino.default/extensions/%7Be2fda1a4-762b-4020-b5ad-a41df1933103%7D/components/calStorageCalendar.js
Zeile: 2418


Resetting the cache, make the dates appear again.

Comment 10

[Christoph Kaulich]

The ics for the messages above:
BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//EGroupware//NONSGML EGroupware Calendar 14.3.001//DE
BEGIN:VTIMEZONE
TZID:Europe/Berlin
BEGIN:DAYLIGHT
TZOFFSETFROM:+0100
TZOFFSETTO:+0200
TZNAME:CEST
DTSTART:19700329T020000
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=-1SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:+0200
TZOFFSETTO:+0100
TZNAME:CET
DTSTART:19701025T030000
RRULE:FREQ=YEARLY;BYMONTH=10;BYDAY=-1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
EXDATE;TZID=Europe/Berlin:20150917T070000Z,20150918T070000Z
X-MICROSOFT-CDO-BUSYSTATUS:BUSY
X-MICROSOFT-CDO-IMPORTANCE:1
X-MOZ-GENERATION:4
CLASS:PUBLIC
SUMMARY:Standup
DTSTART;TZID=Europe/Berlin:20150527T090000
DTEND;TZID=Europe/Berlin:20150527T091500
RRULE:FREQ=WEEKLY;BYDAY=MO,TU,WE,TH,FR
PRIORITY:5
TRANSP:OPAQUE
UID:6a2d448e-8f5a-4db3-9dfc-f8d8a77dea76
SEQUENCE:29
STATUS:CONFIRMED
CREATED:20150526T094427Z
LAST-MODIFIED:20150917T054917Z
DTSTAMP:20150921T135134Z
END:VEVENT
END:VCALENDAR

Comment 11

[Stefan Sitter [:ssitter]]

The icaljs issue from Comment 9 and Comment 10 is tracked in Bug 1179783.