1869260 - Massive jank in Daily in the main thread, due to nsImapMailFolder::InitiateAutoSync (with server side folders)

Status: NEW

(Thunderbird :: General, defect)

Description

[Emilio Cobos Álvarez (:emilio)]

See https://share.firefox.dev/41eJsZn. This happens regularly enough to be super annoying :'(

Comment 1

[Emilio Cobos Álvarez (:emilio)]

I guess that's because I had a long weekend so a lot of pending email to download. But still, probably shouldn't block the main thread for seconds at a time...

Comment 2

[Magnus Melin [:mkmelin]]

Maybe ChromeUtils.idleDispatch around here could help: https://searchfox.org/comm-central/rev/76be3830816c8a07044e4d19eb1a31685ec5a2ff/mail/components/activity/modules/autosync.jsm#81
Looks like nsAutoSyncManager is trying back off in a few places. Not convinced it's succeeding...

Comment 3

[Emilio Cobos Álvarez (:emilio)]

It's already using idle dispatch, it's just blocking for too long... Maybe the parsing (which is what takes the most time) can move off the main thread?

Comment 4

[Wayne Mery (:wsmwk)]

Is this the Thunderbird instance with large number of messages going through server side filters?

Comment 5

[Emilio Cobos Álvarez (:emilio)]

Yeah.

Comment 6

[Wayne Mery (:wsmwk)]

What are your settings for mail.check_all_imap_folders_for_new and "check for new messages every" ?

• Ref Bug 729504 - mail.check_all_imap_folders_for_new enabled and low value for "check for new messages every" yields high mork activity and frequent short hangs when writing mail.

Any body matching filter rules?

• Ref Bug 971401 - Severe delay with body matching rule exists(Body condition, with Apply filter on/Getting New Mail/Filter before Junk Classification) and autosync enabled, processing only 1 message at a time, ~50% CPU

Comment 7

[Emilio Cobos Álvarez (:emilio)]

(In reply to Wayne Mery (:wsmwk) from comment #6)

What are your settings for mail.check_all_imap_folders_for_new and "check for new messages every" ?

• mail.check_all_imap_folders_for_new is not set.
• check for new messages every 10 minutes on all my accounts (5 of them)

Any body matching filter rules?

No thunderbird-side filter rules, all the filter rules are in the mail server.

Comment 8

[Wayne Mery (:wsmwk)]

(In reply to Magnus Melin [:mkmelin] from comment #2)

...
Looks like nsAutoSyncManager is trying back off in a few places. Not convinced it's succeeding...

What do you mean "not succeeding"?

Comment 9

[Magnus Melin [:mkmelin]]

(In reply to Emilio Cobos Álvarez (:emilio) from comment #3)

It's already using idle dispatch, it's just blocking for too long... Maybe the parsing (which is what takes the most time) can move off the main thread?

The mork parsing can't easily be changed. But we want to get rid of mork...

Comment 10

[Wayne Mery (:wsmwk)]

(In reply to Emilio Cobos Álvarez (:emilio) from comment #0)

See https://share.firefox.dev/41eJsZn. This happens regularly enough to be super annoying :'(

Looking at this more closely there are

• multiple iterations of chunks like this
• and a 5 second section which contains mork activity but afaict mork isn't the main component and where in the screen images I see the status bar changing, which I suspect is message download progress (ref comment 1)

So I'm not sure mork is the main issue here. Unlike https://share.firefox.dev/3U8P0mB, which I've lost track of where it came from.

FWIW mork nastiness with server side filters goes way back to bug 589310

Comment 11

[Wayne Mery (:wsmwk)]

If you using imap, and are able, please try beta https://www.thunderbird.net/en-US/download/beta/

Comment 12

[Wayne Mery (:wsmwk)]

Or of course daily.

Comment 13

[Emilio Cobos Álvarez (:emilio)]

I'm using Daily. Seems a bit better, will update the bug next time something like this happens.