Open Bug 1737578 Opened 4 years ago Updated 10 months ago

Email Archive Delay to large archive folder of 170k messages

Categories

(Thunderbird :: General, defect)

Thunderbird 102
Unspecified
Windows
defect

Tracking

(Not tracked)

UNCONFIRMED

People

(Reporter: bugzilla.mozilla.org, Unassigned)

References

Details

(Keywords: perf, Whiteboard: [needs performance profile])

Attachments

(3 files)

User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:93.0) Gecko/20100101 Firefox/93.0

Steps to reproduce:

CONFIGURATION:
Windows 10, Thunderbird 91, with no add-ons

  • Setup Thunderbird
  • Enable email account (I'm using pop3)
  • Try marking emails as archived

Actual results:

The first archive action usually is delayed by 1-2 seconds, but subsequent archive actions usually are performed immediately. Occasionally a delay will happen on subsequent archives, but I haven't figured out how to make subsequent delays repeatable.

Things I've tried:

  • Compacting Mailbox
  • Archiving from different folders (doesn't seem to matter which one)
  • Disabling antivirus (as was mentioned here: bug 777221)
  • Checked to make sure indexing was not running
  • Running in Troubleshooting mode (with add-ons disabled)

Expected results:

Archiving should be almost instantaneous.

This issue is more of an annoyance than a real issue since the functionality works, albeit delayed.

Severity: -- → S4
Keywords: perf

Do you still experience this issue with newest version?

Flags: needinfo?(mattbju2013)

:wsmwk Yes, I'm currently using 97.0b2 and still notice the issue.
To clarify, it's only on the first email that i try to archive. If i continue archiving emails the subsequent emails archive immediately.
If i leave the application for a few minutes and come back and start archiving again, the delay happens again on the first archived email.

Flags: needinfo?(mattbju2013)

A few other observations:

  • If i drag the email to the Archive folder, the delay also happens (on the first archived email).
  • If i delete the email, the email is deleted immediately (no delay)

(In reply to Meichthys from comment #2)

:wsmwk Yes, I'm currently using 97.0b2 and still notice the issue.
To clarify, it's only on the first email that i try to archive. If i continue archiving emails the subsequent emails archive immediately.
If i leave the application for a few minutes and come back and start archiving again, the delay happens again on the first archived email.

Just curious if Error Console has any info about what might be happening. Can you try this:

  1. Open TB and don't perform any actions.
  2. Press CTRL-SHIFT-J to open Error Console
  3. Once TB settles a bit, click the trash icon at top-left to clear the screen
  4. Try and perform your 1st archive action which usually causes you a delay
  5. Go back to Error Console and see if there are any errors and, if yes, past the error here

The following error shows up twice when following your steps, but I also get it when selecting on any message (without performing an action on it)
This page is in Quirks Mode. Page layout may be impacted. For Standards Mode use “<!DOCTYPE html>”.

I didn't get any other message.

I can confirm this is still an issue in v102.0b4
It happens in both online and offline mode, so I'm fairly confident it doesn't have to do with my server settings.

Version: Thunderbird 91 → Thunderbird 102

I can confirm that this happens with both mbox and maildir formats.

Depends on: 1771304

Once the profiler is fixed, I will report back.

Now that the profiler is fixed, I'm able to get a profile that shows the delay. I'm not too sure how to use the profiler to pinpoint the cause of the delay, but I've added a screenshot that shows a second delay after archiving.

Attached image profiler_archive.png

Can you reproduce this with 102.2.0?

If yes, please create a new profile and share the json file or uploaded URL using the updated instructions at https://support.mozilla.org/en-US/kb/profiling-thunderbird-performance (the instructions new produce a much better profile)

Flags: needinfo?(mattbju2013)

I'm on v104.0b4 and still seem to be noticing it (but maybe not as bad). Here's the profile: https://share.firefox.dev/3cgh7wN

Flags: needinfo?(mattbju2013)

How is the current beta?

Component: Untriaged → General
Flags: needinfo?(bugzilla.mozilla.org)

It's not too bad, but there is still a definite delay when archiving the first email. Subsequent emails are archived immediately.
I think the profile i linked to above should still be relevant.

Flags: needinfo?(bugzilla.mozilla.org)

Just commenting here to indicate that this is still relevant for v116.0b7

Slightly better STR:

  • Close Thunderbird (if it's open)
  • Re-open Thunderbird
  • Select a mail item in inbox
  • Wait a few seconds (as if to read the email)
  • Archive the email
  • Observe the second or two delay
  • Wait a maybe 5 seconds after the email is archived (the next mail in the inbox will be selected)
  • Archive again
  • Observe the delay
  • Try archiving emails without waiting in-between and archiving usually completes immediately.

Who is your mail provider?
How many messages in the target archive folder?
Please post a new profie.

Flags: needinfo?(bugzilla.mozilla.org)
OS: Unspecified → Windows

I see this with two separate email providers (rackspace & purelymail) although the delay seems to be less noticeable now (perhaps 2-3 seconds).
The target archive folder probably has over 50k messages. I will try to provide an updated profile when i get back to my Thunderbird beta machine.

Just following up to indicate that this is till relevant in the latest beta: 127.0b4

My profile size is: 14GB
The issue happens in Offline mode and Troubleshoot mode (I also do not use any extensions)

Attached image ConsoleErrors.jpg

The attached console errors appear after the emails are finally archived (after the delay).

I'm not sure those console warnings are relevant not that i look at it closer since those same console warnings are shown when selecting different emails in the Archive inbox folder - without any delays.

Attaching new profile (looks the same as the older ones)

After much more testing I've found that the issue seems to be related to the size and or location of the Archive folder (My archive folder was a sub-folder of the inbox folder and contained over 170k emails).

If I change the account settings to archive to a different (smaller) folder, then the archiving happens immediately. When reverting to use the large archive folder, the archiving is slow again.

I've migrated to a new Thunderbird profile and am using the Thunderbird defaults for archive folder location (and archive folder per year). So far I have not seen the delay i was experiencing.

If you want to test the old profile using version 128, please obtain a performance profile https://support.mozilla.org/en-US/kb/profiling-thunderbird-performance.

Summary: Email Archiving Delay → Email Archive Delay to large folder of 170k messages
Whiteboard: [needs performance profile]

I'm also facing this issue -- connecting to gmail -- and it's looking like for me the Build Graph process is what takes a long time (upwards of 5 seconds with 100% pinned CPU).

(In reply to Dan Schultz from comment #26)

I'm also facing this issue -- connecting to gmail -- and it's looking like for me the Build Graph process is what takes a long time (upwards of 5 seconds with 100% pinned CPU).

Please attach a performance profile using version 128. And indicate the size of your archive folder.

Flags: needinfo?(slifty)
Flags: needinfo?(bugzilla.mozilla.org)
Summary: Email Archive Delay to large folder of 170k messages → Email Archive Delay to large archive folder of 170k messages

Meichthys, how is version 128 ?

Flags: needinfo?(slifty)

Dan, could you test this? I've moved away from a large single Archive folder in favor of yearly archive folders so I don't experience this anymore.

Flags: needinfo?(bugzilla.mozilla.org)
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: