998755 - Thunderbird on Linux (OpenSUSE) uses too much memory (a few GB) after a few days with many messages and mailboxes (10 imap accounts) (and in safe mode). Dovecot server

Status: RESOLVED WORKSFORME

(Thunderbird :: General, defect)

Description

[Craig Arno]

User Agent: Mozilla/5.0 (X11; Linux x86_64; rv:28.0) Gecko/20100101 Firefox/28.0 (Beta/Release)
Build ID: 2014031500

Steps to reproduce:

Windows and Linux 24.4.0:

Left Thunderbird running, with heavy use, without restarting for several days.  During the day, Thunderbird gets moderate-heavy use.  Several of the mailboxes are large (9000 messages), and searching is performed on these messages.  I am also making heavy use of Address Book, and Lightning Calendar, both of which are talking to DAV servers.

Performance is still fast and responsive on 2, 6, and 8 core machines.


Actual results:

This is what I see in "top" for memory usage in a 16GB machine:

  PID USER      PR  NI  VIRT     RES   SHR S %CPU %MEM     TIME+ COMMAND
 4528 craig     20   0  6271m 5.0g  33m S    4.6      32.2     158:34.81 thunderbird-bin
                   *** Notice 5GB memory usage, 32% of 16GB RAM ***

I see a similar thing happening in Firefox when I'm doing new page loads about one every 2-3 sec for hours.  Since Thunderbird shares a lot of Firefox code, I wonder if the two could be related?  I suspect aggressive caching is the issue.


Expected results:

Thunderbird should be monitoring system resources and reducing it's own consumption of system resources (caching?) when things like memory are getting tight.

On my 4GB laptop I can't run both Firefox and Thunderbird, using both heavily, for much more than 1-2 hours before one or the other crashes due to the system running out of memory.  For my application I can only use a 16GB machine with these two Mozilla products if I wish to avoid these applications crashing.  This crashing severely limits productivity.

Comment 1

[WADA:World Anti-bad-Duping Agency]

Is Tb killed by OOM Killer when system entered "Out of memory" condition?
Or Tb is killed merely by "VM size limit per a process"?

Although VM size=6.3GB mabe evidence of inefficient VM use in Tb(actul memory leak may exists, if addon like Lightnin, Engmail etc. is used), because Linux uses "demand paging", "5.0g real memory, 32 % of 15GB RAM, currently allocated to Tb" is never problem. OS is responsible on "Real mamemory management" and "demand paging".
> http://linuxtutorial.info/modules.php?name=MContent&pageid=89
 
If former, is sufficiently large swap space kept by you?

If latter, because Linux uses "demand paging", and Linux kernel supports "up to 64 GB of physical memory and several TB of swap", larger "VM size limit per a process" is already possible(before enhancement, up to 16 "127.5 MB swap space" == 2GB swap size).
Is sufficiently large swap space kept by you? Do you set sufficiently large "VM size limit per a process"?

Comment 2

[Wayne Mery (:wsmwk)]

At half day intervals, please do 
 Help | Troubleshooting | about:memory | measure and save

After a couple days, please attach the files to this bug report

Comment 3

[Craig Arno]

Attachment: about:memory Measurement

Here is a "Measure and Save" for the Thunderbird process using 5+GB memory.

As for the other comments, my laptop is too limited to manage gigantic swap spaces.  My laptop has a 256GB SSD and 4GB RAM and is used for light CAD work and office communication.  It isn't equipped to devote most of these resources to fetching email.  Thunderbird needs to be able to operate more efficiently.  My workstation can do this.  I need to be able to use Thunderbird in both environments.

Comment 4

[Craig Arno]

More info from the machine with the attached memory dump:

about:buildconfig
Build Machine

cloud135
Build platform
target
x86_64-unknown-linux-gnu
Build tools
Compiler 	Version 	Compiler flags
gcc 	gcc version 4.7.2 20130108 [gcc-4_7-branch revision 195012] (SUSE Linux) 	-Wall -Wpointer-arith -Wdeclaration-after-statement -Werror=return-type -Wtype-limits -Wempty-body -Wsign-compare -Wno-unused -Wcast-align -fmessage-length=0 -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector -funwind-tables -fasynchronous-unwind-tables -g -Os -fno-strict-aliasing -std=gnu99 -fgnu89-inline -fno-strict-aliasing -ffunction-sections -fdata-sections -pthread -pipe -DNDEBUG -DTRIMMED -g -Os -freorder-blocks -fomit-frame-pointer
c++ 	gcc version 4.7.2 20130108 [gcc-4_7-branch revision 195012] (SUSE Linux) 	-Wall -Wpointer-arith -Woverloaded-virtual -Werror=return-type -Wtype-limits -Wempty-body -Wsign-compare -Wno-invalid-offsetof -Wcast-align -fmessage-length=0 -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector -funwind-tables -fasynchronous-unwind-tables -g -Os -fno-strict-aliasing -fno-exceptions -fno-strict-aliasing -fno-rtti -ffunction-sections -fdata-sections -fno-exceptions -std=gnu++0x -pthread -pipe -DNDEBUG -DTRIMMED -g -Os -freorder-blocks -fomit-frame-pointer
Configure arguments

--enable-application=mail --prefix=/usr --libdir=/usr/lib64/thunderbird --includedir=/usr/include --disable-tests --disable-debug --enable-optimize --with-system-nspr --with-system-nss --with-system-jpeg --with-system-zlib --with-l10n-base=/home/abuild/rpmbuild/BUILD/l10n --disable-updater --enable-system-hunspell --disable-installer --disable-mochitest --enable-startup-notification --enable-official-branding --disable-necko-wifi --enable-update-channel=release --disable-gnomevfs --enable-gio --enable-application=mail --prefix=/usr --libdir=/usr/lib64/thunderbird --includedir=/usr/include --disable-tests --disable-debug --enable-optimize --with-system-nspr --with-system-nss --with-system-jpeg --with-system-zlib --with-l10n-base=/home/abuild/rpmbuild/BUILD/l10n --disable-updater --enable-system-hunspell --disable-installer --disable-mochitest --enable-startup-notification --enable-official-branding --disable-necko-wifi --enable-update-channel=release --disable-gnomevfs --enable-gio --enable-application=../mail --with-external-source-dir=/home/abuild/rpmbuild/BUILD/thunderbird --disable-official-branding --with-branding=../other-licenses/branding/thunderbird --with-l10n-base=/home/abuild/rpmbuild/BUILD/l10n --cache-file=.././config.cache --srcdir=/home/abuild/rpmbuild/BUILD/thunderbird/mozilla




  Application Basics

    Name: Thunderbird
    Version: 24.4.0
    User Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.4.0
    Profile Directory: Open Directory

              (Local drive)
    Application Build ID: 2014031500
    Enabled Plugins: about:plugins
    Build Configuration: about:buildconfig
    Crash Reports: about:crashes
    Memory Use: about:memory

  Mail and News Accounts
    account1:
      INCOMING: account1, , (imap) pluto.arno.com:143, alwaysSTARTTLS, passwordCleartext
      OUTGOING: smtp.frontier.com:465, SSL, passwordCleartext, true

    account2:
      INCOMING: account2, , (none) Local Folders, plain, passwordCleartext

    account3:
      INCOMING: account3, , (imap) imap.googlemail.com:993, SSL, passwordCleartext
      OUTGOING: smtp.googlemail.com:465, SSL, passwordCleartext, true

    account4:
      INCOMING: account4, , (imap) imap.googlemail.com:993, SSL, passwordCleartext
      OUTGOING: smtp.googlemail.com:465, SSL, passwordCleartext, true

    account7:
      INCOMING: account7, , (imap) mail.koczarski.com:143, plain, passwordCleartext
      OUTGOING: mail.koczarski.com:587, plain, passwordCleartext, true

    account8:
      INCOMING: account8, , (im) prpl-jabber, plain, 0

    account9:
      INCOMING: account9, , (imap) imap.googlemail.com:993, SSL, passwordCleartext
      OUTGOING: smtp.googlemail.com:465, SSL, passwordCleartext, true

    account10:
      INCOMING: account10, , (imap) imap.googlemail.com:993, SSL, passwordCleartext
      OUTGOING: smtp.googlemail.com:465, SSL, passwordCleartext, true

    account11:
      INCOMING: account11, , (imap) imap.googlemail.com:993, SSL, passwordCleartext
      OUTGOING: smtp.googlemail.com:465, SSL, passwordCleartext, true

    account12:
      INCOMING: account12, , (imap) imap.mail.yahoo.com:993, SSL, passwordCleartext
      OUTGOING: smtp.mail.yahoo.com:465, SSL, passwordCleartext, true

    account13:
      INCOMING: account13, , (imap) imap.frontier.com:993, SSL, passwordCleartext
      OUTGOING: smtp.frontier.com:465, SSL, passwordCleartext, true

  Extensions
    Contact Tabs, 2.0.8, true, [e-mail]
    Encrypt if possible, 1.0, true, [e-mail]
    FoxClocks, 3.4.14, true, {d37dc5d0-431d-44e5-8c91-49419370caa1}
    Google Contacts, 0.7.12, true, {BDD92442-0534-4D6F-A966-BAB7D561D781}
    Grammar Checker, 0.6, true, [e-mail]
    Inverse SOGo Connector, 24.0.4, true, [e-mail]
    Lightning, 2.6.4, true, {e2fda1a4-762b-4020-b5ad-a41df1933103}
    LookOut, 1.2.13, true, [e-mail]
    Provider for Google Calendar, 0.25, true, {a62ef8ec-5fdc-40c2-873c-223b8a6925cc}
    Saved Password Editor, 2.7.2, true, [e-mail]
    Select Addressbook Text, 1.5, true, [e-mail]

  Important Modified Preferences

    Name: Value

      accessibility.typeaheadfind.flashBar: 0
      browser.cache.disk.capacity: 358400
      browser.cache.disk.smart_size_cached_value: 276480
      browser.cache.disk.smart_size.first_run: false
      browser.cache.disk.smart_size.use_old_max: false
      dom.max_chrome_script_run_time: 0
      extensions.lastAppVersion: 24.4.0
      font.name.sans-serif.x-western: Adobe Helvetica
      mailnews.database.global.datastore.id: 4eaf7efd-d431-4cc3-ae0f-995c4403d4a
      mail.openMessageBehavior.version: 1
      network.cookie.prefsMigrated: true
      places.database.lastMaintenance: 1333948172
      places.history.expiration.transient_current_max_pages: 104858
      plugin.importedState: true
      plugin.state.java: 0
      print.print_bgcolor: false
      print.print_bgimages: false
      print.print_colorspace: default
      print.print_downloadfonts: false
      print.print_duplex: 1
      print.print_evenpages: true
      print.print_in_color: true
      print.print_margin_bottom: 0.5
      print.print_margin_left: 0.5
      print.print_margin_right: 0.5
      print.print_margin_top: 0.5
      print.print_oddpages: true
      print.print_orientation: 0
      print.print_page_delay: 50
      print.print_paper_data: 0
      print.print_paper_height: 279.40
      print.print_paper_name: na_letter
      print.print_paper_size_type: 1
      print.print_paper_size_unit: 1
      print.print_paper_width: 215.90
      print.print_plex_name: default
      print.print_resolution_name: default
      print.print_scaling: 1.00
      print.print_shrink_to_fit: true
      print.print_to_file: false
      print.print_unwriteable_margin_bottom: 56
      print.print_unwriteable_margin_left: 25
      print.print_unwriteable_margin_right: 25
      print.print_unwriteable_margin_top: 25
      print.tmp.printerfeatures.AllInOne7650.can_change_colorspace: false
      print.tmp.printerfeatures.AllInOne7650.can_change_downloadfonts: false
      print.tmp.printerfeatures.AllInOne7650.can_change_jobtitle: false
      print.tmp.printerfeatures.AllInOne7650.can_change_num_copies: true
      print.tmp.printerfeatures.AllInOne7650.can_change_orientation: true
      print.tmp.printerfeatures.AllInOne7650.can_change_paper_size: true
      print.tmp.printerfeatures.AllInOne7650.can_change_plex: false
      print.tmp.printerfeatures.AllInOne7650.can_change_printincolor: true
      print.tmp.printerfeatures.AllInOne7650.can_change_resolution: false
      print.tmp.printerfeatures.AllInOne7650.can_change_spoolercommand: false
      print.tmp.printerfeatures.AllInOne7650.colorspace.0.name: default
      print.tmp.printerfeatures.AllInOne7650.colorspace.count: 1
      print.tmp.printerfeatures.AllInOne7650.has_special_printerfeatures: true
      print.tmp.printerfeatures.AllInOne7650.orientation.0.name: portrait
      print.tmp.printerfeatures.AllInOne7650.orientation.1.name: landscape
      print.tmp.printerfeatures.AllInOne7650.orientation.count: 2
      print.tmp.printerfeatures.AllInOne7650.paper.0.height_mm: 210
      print.tmp.printerfeatures.AllInOne7650.paper.0.is_inch: false
      print.tmp.printerfeatures.AllInOne7650.paper.0.name: A5
      print.tmp.printerfeatures.AllInOne7650.paper.0.width_mm: 148
      print.tmp.printerfeatures.AllInOne7650.paper.1.height_mm: 297
      print.tmp.printerfeatures.AllInOne7650.paper.1.is_inch: false
      print.tmp.printerfeatures.AllInOne7650.paper.1.name: A4
      print.tmp.printerfeatures.AllInOne7650.paper.1.width_mm: 210
      print.tmp.printerfeatures.AllInOne7650.paper.2.height_mm: 420
      print.tmp.printerfeatures.AllInOne7650.paper.2.is_inch: false
      print.tmp.printerfeatures.AllInOne7650.paper.2.name: A3
      print.tmp.printerfeatures.AllInOne7650.paper.2.width_mm: 297
      print.tmp.printerfeatures.AllInOne7650.paper.3.height_mm: 279
      print.tmp.printerfeatures.AllInOne7650.paper.3.is_inch: true
      print.tmp.printerfeatures.AllInOne7650.paper.3.name: Letter
      print.tmp.printerfeatures.AllInOne7650.paper.3.width_mm: 215
      print.tmp.printerfeatures.AllInOne7650.paper.4.height_mm: 355
      print.tmp.printerfeatures.AllInOne7650.paper.4.is_inch: true
      print.tmp.printerfeatures.AllInOne7650.paper.4.name: Legal
      print.tmp.printerfeatures.AllInOne7650.paper.4.width_mm: 215
      print.tmp.printerfeatures.AllInOne7650.paper.5.height_mm: 431
      print.tmp.printerfeatures.AllInOne7650.paper.5.is_inch: true
      print.tmp.printerfeatures.AllInOne7650.paper.5.name: Tabloid
      print.tmp.printerfeatures.AllInOne7650.paper.5.width_mm: 279
      print.tmp.printerfeatures.AllInOne7650.paper.6.height_mm: 254
      print.tmp.printerfeatures.AllInOne7650.paper.6.is_inch: true
      print.tmp.printerfeatures.AllInOne7650.paper.6.name: Executive
      print.tmp.printerfeatures.AllInOne7650.paper.6.width_mm: 190
      print.tmp.printerfeatures.AllInOne7650.paper.count: 7
      print.tmp.printerfeatures.AllInOne7650.plex.0.name: default
      print.tmp.printerfeatures.AllInOne7650.plex.count: 1
      print.tmp.printerfeatures.AllInOne7650.resolution.0.name: default
      print.tmp.printerfeatures.AllInOne7650.resolution.count: 1
      print.tmp.printerfeatures.AllInOne7650.supports_colorspace_change: false
      print.tmp.printerfeatures.AllInOne7650.supports_downloadfonts_change: false
      print.tmp.printerfeatures.AllInOne7650.supports_jobtitle_change: false
      print.tmp.printerfeatures.AllInOne7650.supports_orientation_change: true
      print.tmp.printerfeatures.AllInOne7650.supports_paper_size_change: true
      print.tmp.printerfeatures.AllInOne7650.supports_plex_change: false
      print.tmp.printerfeatures.AllInOne7650.supports_printincolor_change: true
      print.tmp.printerfeatures.AllInOne7650.supports_resolution_change: false
      print.tmp.printerfeatures.AllInOne7650.supports_spoolercommand_change: false
      print.tmp.printerfeatures.hp7650.can_change_colorspace: false
      print.tmp.printerfeatures.HP7650.can_change_colorspace: false
      print.tmp.printerfeatures.hp7650.can_change_downloadfonts: false
      print.tmp.printerfeatures.HP7650.can_change_downloadfonts: false
      print.tmp.printerfeatures.hp7650.can_change_jobtitle: false
      print.tmp.printerfeatures.HP7650.can_change_jobtitle: false
      print.tmp.printerfeatures.hp7650.can_change_num_copies: true
      print.tmp.printerfeatures.HP7650.can_change_num_copies: true
      print.tmp.printerfeatures.hp7650.can_change_orientation: true
      print.tmp.printerfeatures.HP7650.can_change_orientation: true
      print.tmp.printerfeatures.hp7650.can_change_paper_size: true
      print.tmp.printerfeatures.HP7650.can_change_paper_size: true
      print.tmp.printerfeatures.hp7650.can_change_plex: false
      print.tmp.printerfeatures.HP7650.can_change_plex: false
      print.tmp.printerfeatures.hp7650.can_change_printincolor: true
      print.tmp.printerfeatures.HP7650.can_change_printincolor: true
      print.tmp.printerfeatures.hp7650.can_change_resolution: false
      print.tmp.printerfeatures.HP7650.can_change_resolution: false
      print.tmp.printerfeatures.hp7650.can_change_spoolercommand: false
      print.tmp.printerfeatures.HP7650.can_change_spoolercommand: false
      print.tmp.printerfeatures.hp7650.colorspace.0.name: default
      print.tmp.printerfeatures.HP7650.colorspace.0.name: default
      print.tmp.printerfeatures.hp7650.colorspace.count: 1
      print.tmp.printerfeatures.HP7650.colorspace.count: 1
      print.tmp.printerfeatures.hp7650.has_special_printerfeatures: true
      print.tmp.printerfeatures.HP7650.has_special_printerfeatures: true
      print.tmp.printerfeatures.hp7650.orientation.0.name: portrait
      print.tmp.printerfeatures.HP7650.orientation.0.name: portrait
      print.tmp.printerfeatures.hp7650.orientation.1.name: landscape
      print.tmp.printerfeatures.HP7650.orientation.1.name: landscape
      print.tmp.printerfeatures.hp7650.orientation.count: 2
      print.tmp.printerfeatures.HP7650.orientation.count: 2
      print.tmp.printerfeatures.hp7650.paper.0.height_mm: 210
      print.tmp.printerfeatures.HP7650.paper.0.height_mm: 210
      print.tmp.printerfeatures.hp7650.paper.0.is_inch: false
      print.tmp.printerfeatures.HP7650.paper.0.is_inch: false
      print.tmp.printerfeatures.hp7650.paper.0.name: A5
      print.tmp.printerfeatures.HP7650.paper.0.name: A5
      print.tmp.printerfeatures.hp7650.paper.0.width_mm: 148
      print.tmp.printerfeatures.HP7650.paper.0.width_mm: 148
      print.tmp.printerfeatures.hp7650.paper.1.height_mm: 297
      print.tmp.printerfeatures.HP7650.paper.1.height_mm: 297
      print.tmp.printerfeatures.hp7650.paper.1.is_inch: false
      print.tmp.printerfeatures.HP7650.paper.1.is_inch: false
      print.tmp.printerfeatures.hp7650.paper.1.name: A4
      print.tmp.printerfeatures.HP7650.paper.1.name: A4
      print.tmp.printerfeatures.hp7650.paper.1.width_mm: 210
      print.tmp.printerfeatures.HP7650.paper.1.width_mm: 210
      print.tmp.printerfeatures.hp7650.paper.2.height_mm: 420
      print.tmp.printerfeatures.HP7650.paper.2.height_mm: 420
      print.tmp.printerfeatures.hp7650.paper.2.is_inch: false
      print.tmp.printerfeatures.HP7650.paper.2.is_inch: false
      print.tmp.printerfeatures.hp7650.paper.2.name: A3
      print.tmp.printerfeatures.HP7650.paper.2.name: A3
      print.tmp.printerfeatures.hp7650.paper.2.width_mm: 297
      print.tmp.printerfeatures.HP7650.paper.2.width_mm: 297
      print.tmp.printerfeatures.hp7650.paper.3.height_mm: 279
      print.tmp.printerfeatures.HP7650.paper.3.height_mm: 279
      print.tmp.printerfeatures.hp7650.paper.3.is_inch: true
      print.tmp.printerfeatures.HP7650.paper.3.is_inch: true
      print.tmp.printerfeatures.hp7650.paper.3.name: Letter
      print.tmp.printerfeatures.HP7650.paper.3.name: Letter
      print.tmp.printerfeatures.hp7650.paper.3.width_mm: 215
      print.tmp.printerfeatures.HP7650.paper.3.width_mm: 215
      print.tmp.printerfeatures.hp7650.paper.4.height_mm: 355
      print.tmp.printerfeatures.HP7650.paper.4.height_mm: 355
      print.tmp.printerfeatures.hp7650.paper.4.is_inch: true
      print.tmp.printerfeatures.HP7650.paper.4.is_inch: true
      print.tmp.printerfeatures.hp7650.paper.4.name: Legal
      print.tmp.printerfeatures.HP7650.paper.4.name: Legal
      print.tmp.printerfeatures.hp7650.paper.4.width_mm: 215
      print.tmp.printerfeatures.HP7650.paper.4.width_mm: 215
      print.tmp.printerfeatures.hp7650.paper.5.height_mm: 431
      print.tmp.printerfeatures.HP7650.paper.5.height_mm: 431
      print.tmp.printerfeatures.hp7650.paper.5.is_inch: true
      print.tmp.printerfeatures.HP7650.paper.5.is_inch: true
      print.tmp.printerfeatures.hp7650.paper.5.name: Tabloid
      print.tmp.printerfeatures.HP7650.paper.5.name: Tabloid
      print.tmp.printerfeatures.hp7650.paper.5.width_mm: 279
      print.tmp.printerfeatures.HP7650.paper.5.width_mm: 279
      print.tmp.printerfeatures.hp7650.paper.6.height_mm: 254
      print.tmp.printerfeatures.HP7650.paper.6.height_mm: 254
      print.tmp.printerfeatures.hp7650.paper.6.is_inch: true
      print.tmp.printerfeatures.HP7650.paper.6.is_inch: true
      print.tmp.printerfeatures.hp7650.paper.6.name: Executive
      print.tmp.printerfeatures.HP7650.paper.6.name: Executive
      print.tmp.printerfeatures.hp7650.paper.6.width_mm: 190
      print.tmp.printerfeatures.HP7650.paper.6.width_mm: 190
      print.tmp.printerfeatures.hp7650.paper.count: 7
      print.tmp.printerfeatures.HP7650.paper.count: 7
      print.tmp.printerfeatures.hp7650.plex.0.name: default
      print.tmp.printerfeatures.HP7650.plex.0.name: default
      print.tmp.printerfeatures.hp7650.plex.count: 1
      print.tmp.printerfeatures.HP7650.plex.count: 1
      print.tmp.printerfeatures.hp7650.resolution.0.name: default
      print.tmp.printerfeatures.HP7650.resolution.0.name: default
      print.tmp.printerfeatures.hp7650.resolution.count: 1
      print.tmp.printerfeatures.HP7650.resolution.count: 1
      print.tmp.printerfeatures.hp7650.supports_colorspace_change: false
      print.tmp.printerfeatures.HP7650.supports_colorspace_change: false
      print.tmp.printerfeatures.hp7650.supports_downloadfonts_change: false
      print.tmp.printerfeatures.HP7650.supports_downloadfonts_change: false
      print.tmp.printerfeatures.hp7650.supports_jobtitle_change: false
      print.tmp.printerfeatures.HP7650.supports_jobtitle_change: false
      print.tmp.printerfeatures.hp7650.supports_orientation_change: true
      print.tmp.printerfeatures.HP7650.supports_orientation_change: true
      print.tmp.printerfeatures.hp7650.supports_paper_size_change: true
      print.tmp.printerfeatures.HP7650.supports_paper_size_change: true
      print.tmp.printerfeatures.hp7650.supports_plex_change: false
      print.tmp.printerfeatures.HP7650.supports_plex_change: false
      print.tmp.printerfeatures.hp7650.supports_printincolor_change: true
      print.tmp.printerfeatures.HP7650.supports_printincolor_change: true
      print.tmp.printerfeatures.hp7650.supports_resolution_change: false
      print.tmp.printerfeatures.HP7650.supports_resolution_change: false
      print.tmp.printerfeatures.hp7650.supports_spoolercommand_change: false
      print.tmp.printerfeatures.HP7650.supports_spoolercommand_change: false
      print.tmp.printerfeatures.PostScript/default.can_change_colorspace: false
      print.tmp.printerfeatures.PostScript/default.can_change_downloadfonts: false
      print.tmp.printerfeatures.PostScript/default.can_change_jobtitle: false
      print.tmp.printerfeatures.PostScript/default.can_change_num_copies: true
      print.tmp.printerfeatures.PostScript/default.can_change_orientation: true
      print.tmp.printerfeatures.PostScript/default.can_change_paper_size: true
      print.tmp.printerfeatures.PostScript/default.can_change_plex: false
      print.tmp.printerfeatures.PostScript/default.can_change_printincolor: true
      print.tmp.printerfeatures.PostScript/default.can_change_resolution: false
      print.tmp.printerfeatures.PostScript/default.can_change_spoolercommand: true
      print.tmp.printerfeatures.PostScript/default.colorspace.0.name: default
      print.tmp.printerfeatures.PostScript/default.colorspace.count: 1
      print.tmp.printerfeatures.PostScript/default.has_special_printerfeatures: true
      print.tmp.printerfeatures.PostScript/default.orientation.0.name: portrait
      print.tmp.printerfeatures.PostScript/default.orientation.1.name: landscape
      print.tmp.printerfeatures.PostScript/default.orientation.count: 2
      print.tmp.printerfeatures.PostScript/default.paper.0.height_mm: 210
      print.tmp.printerfeatures.PostScript/default.paper.0.is_inch: false
      print.tmp.printerfeatures.PostScript/default.paper.0.name: A5
      print.tmp.printerfeatures.PostScript/default.paper.0.width_mm: 148
      print.tmp.printerfeatures.PostScript/default.paper.1.height_mm: 297
      print.tmp.printerfeatures.PostScript/default.paper.1.is_inch: false
      print.tmp.printerfeatures.PostScript/default.paper.1.name: A4
      print.tmp.printerfeatures.PostScript/default.paper.1.width_mm: 210
      print.tmp.printerfeatures.PostScript/default.paper.2.height_mm: 420
      print.tmp.printerfeatures.PostScript/default.paper.2.is_inch: false
      print.tmp.printerfeatures.PostScript/default.paper.2.name: A3
      print.tmp.printerfeatures.PostScript/default.paper.2.width_mm: 297
      print.tmp.printerfeatures.PostScript/default.paper.3.height_mm: 279
      print.tmp.printerfeatures.PostScript/default.paper.3.is_inch: true
      print.tmp.printerfeatures.PostScript/default.paper.3.name: Letter
      print.tmp.printerfeatures.PostScript/default.paper.3.width_mm: 215
      print.tmp.printerfeatures.PostScript/default.paper.4.height_mm: 355
      print.tmp.printerfeatures.PostScript/default.paper.4.is_inch: true
      print.tmp.printerfeatures.PostScript/default.paper.4.name: Legal
      print.tmp.printerfeatures.PostScript/default.paper.4.width_mm: 215
      print.tmp.printerfeatures.PostScript/default.paper.5.height_mm: 431
      print.tmp.printerfeatures.PostScript/default.paper.5.is_inch: true
      print.tmp.printerfeatures.PostScript/default.paper.5.name: Tabloid
      print.tmp.printerfeatures.PostScript/default.paper.5.width_mm: 279
      print.tmp.printerfeatures.PostScript/default.paper.6.height_mm: 254
      print.tmp.printerfeatures.PostScript/default.paper.6.is_inch: true
      print.tmp.printerfeatures.PostScript/default.paper.6.name: Executive
      print.tmp.printerfeatures.PostScript/default.paper.6.width_mm: 190
      print.tmp.printerfeatures.PostScript/default.paper.count: 7
      print.tmp.printerfeatures.PostScript/default.plex.0.name: default
      print.tmp.printerfeatures.PostScript/default.plex.count: 1
      print.tmp.printerfeatures.PostScript/default.resolution.0.name: default
      print.tmp.printerfeatures.PostScript/default.resolution.count: 1
      print.tmp.printerfeatures.PostScript/default.supports_colorspace_change: false
      print.tmp.printerfeatures.PostScript/default.supports_downloadfonts_change: false
      print.tmp.printerfeatures.PostScript/default.supports_jobtitle_change: false
      print.tmp.printerfeatures.PostScript/default.supports_orientation_change: true
      print.tmp.printerfeatures.PostScript/default.supports_paper_size_change: true
      print.tmp.printerfeatures.PostScript/default.supports_plex_change: false
      print.tmp.printerfeatures.PostScript/default.supports_printincolor_change: true
      print.tmp.printerfeatures.PostScript/default.supports_resolution_change: false
      print.tmp.printerfeatures.PostScript/default.supports_spoolercommand_change: true
      security.disable_button.openCertManager: false
      security.disable_button.openDeviceManager: false

  Graphics

      Adapter Description: NVIDIA Corporation -- GeForce GT 520/PCIe/SSE2
      Vendor ID: NVIDIA Corporation
      Device ID: GeForce GT 520/PCIe/SSE2
      Driver Version: 4.4.0 NVIDIA 331.38
      WebGL Renderer: false
      GPU Accelerated Windows: 0

      AzureCanvasBackend: cairo
      AzureFallbackCanvasBackend: none
      AzureContentBackend: none

  JavaScript

  Incremental GC: 1

  Accessibility

    Activated: 0
    Prevent Accessibility: 0

  Library Versions

      Expected minimum version
      Version in use

      NSPR
      4.10.4
      4.10.4

      NSS
      3.16 Basic ECC
      3.16 Basic ECC

      NSS Util
      3.16
      3.16

      NSS SSL
      3.16 Basic ECC
      3.16 Basic ECC

      NSS S/MIME
      3.16 Basic ECC
      3.16 Basic ECC

Comment 5

[Wayne Mery (:wsmwk)]

Thanks for the memory log. Unfortunately it errors on loading "SyntaxError: JSON.parse: unexpected character at line 1 column 1 of the JSON data"

1. Please copy and paste the about:memory display

2. And try disabling Lookout addon.

Comment 6

[Craig Arno]

Attachment: Thunderbird-memory-report20140420c.json.gz

Unfortunately disabling Lookout required a restart and I've now lost the memory map.  I'm uploading this one so you can tell me if it will at least load.  If it does load, then maybe you can hand edit the Lookout lines from the original (there are 7 of them) then see if the original minus Lookout lines will load.

Or if you can explain to me how to load this JSON file, I can load the original and post results.

I'm getting on an airplane 8am tomorrow morning, will be back Friday, don't know what else I can do to help.

Comment 7

[Craig Arno]

Ah, after a little poking around, it became self evident.  I loaded the original map and here's a copy:

Main Process (pid 4528)

WARNING: the following values are negative or unreasonably large.

    explicit/maildb
    explicit/maildb/database(imap://[e-mail]/INBOX)
    explicit/maildb/database(imap://[e-mail]/Sent%20Items)
    explicit/(20 tiny)
    explicit/(20 tiny)/heap-unclassified 

This indicates a defect in one or more memory reporters. The invalid values are highlighted.
Explicit Allocations

5,737.70 MB (100.0%) -- explicit
├──38,269.36 MB (666.98%) -- maildb [?!]
│  ├──19,178.68 MB (334.26%) ── database(imap://[e-mail]/INBOX) [?!]
│  ├───7,856.02 MB (136.92%) ── database(imap://[e-mail]/Sent%20Items) [?!]
│  ├───2,647.68 MB (46.15%) ── database(imap://[e-mail]/people/Donna)
│  ├───2,098.91 MB (36.58%) ── database(imap://[e-mail]/people/Fay)
│  ├───1,386.75 MB (24.17%) ── database(imap://[e-mail]/Inbox2008)
│  ├───1,074.50 MB (18.73%) ── database(imap://[e-mail]/%5BGmail%5D/All%20Mail)
│  ├─────953.64 MB (16.62%) ── database(imap://[e-mail]/Inbox2007)
│  ├─────664.57 MB (11.58%) ── database(imap://[e-mail]/INBOX)
│  ├─────472.35 MB (08.23%) ── database(imap://[e-mail]/Inbox2006)
│  ├─────439.10 MB (07.65%) ++ (40 tiny)
│  ├─────385.11 MB (06.71%) ── database(imap://[e-mail]/Junk)
│  ├─────323.54 MB (05.64%) ── database(imap://[e-mail]/%5BGmail%5D/All%20Mail)
│  ├─────260.96 MB (04.55%) ── database(imap://[e-mail]/Match.com)
│  ├─────197.13 MB (03.44%) ── database(imap://[e-mail]/INBOX)
│  ├─────165.98 MB (02.89%) ── database(imap://[e-mail]/INBOX)
│  ├─────106.21 MB (01.85%) ── database(imap://[e-mail]/%5BGmail%5D/Important)
│  └──────58.23 MB (01.01%) ── database(imap://[e-mail]/people/Pam)
├─────82.85 MB (01.44%) -- js-non-window
│     ├──70.21 MB (01.22%) -- zones
│     │  ├──59.94 MB (01.04%) ++ zone(0x7f3d8ac9f000)
│     │  └──10.27 MB (00.18%) ++ (24 tiny)
│     └──12.64 MB (00.22%) ++ (2 tiny)
└──-32,614.50 MB (-568.42%) -- (20 tiny) [?!]
   ├───────48.16 MB (00.84%) ++ window-objects
   ├───────43.56 MB (00.76%) ++ workers/workers()/worker(resource:///modules/attachmentChecker.js, 0x7f3ca2746000)
   ├───────23.54 MB (00.41%) ++ storage/sqlite
   ├────────4.58 MB (00.08%) ── xpconnect
   ├────────1.71 MB (00.03%) ++ gfx
   ├────────1.61 MB (00.03%) ── xpti-working-set
   ├────────1.40 MB (00.02%) ── atom-tables
   ├────────1.04 MB (00.02%) ++ startup-cache
   ├────────0.55 MB (00.01%) ++ images
   ├────────0.51 MB (00.01%) ── preferences
   ├────────0.49 MB (00.01%) ++ network
   ├────────0.43 MB (00.01%) ++ xpcom
   ├────────0.38 MB (00.01%) ── dom/event-listener-managers-hash
   ├────────0.37 MB (00.01%) ++ layout
   ├────────0.29 MB (00.00%) ++ cycle-collector
   ├────────0.15 MB (00.00%) ── script-namespace-manager
   ├────────0.03 MB (00.00%) ── telemetry
   ├────────0.00 MB (00.00%) ── history-links-hashtable
   ├────────0.00 MB (00.00%) ── spell-check
   └──-32,743.29 MB (-570.67%) ── heap-unclassified [?!]

Resident Set Size (RSS) Breakdown

5,887.66 MB (100.0%) ++ rss

Proportional Set Size (PSS) Breakdown

5,874.11 MB (100.0%) ++ pss

Virtual Size Breakdown

7,052.72 MB (100.0%) ++ size

Swap Breakdown

0.00 MB (100.0%) ++ swap

Other Measurements

23.80 MB (100.0%) -- decommitted
├──23.80 MB (100.0%) ── js-non-window/gc-heap/decommitted-arenas
└───0.00 MB (00.00%) ── workers/workers()/worker(resource:///modules/attachmentChecker.js, 0x7f3ca2746000)/gc-heap/decommitted-arenas

460 (100.0%) -- js-compartments
├──449 (97.61%) ── system
└───11 (02.39%) ── user

115.01 MB (100.0%) -- js-main-runtime
├───58.94 MB (51.25%) -- compartments
│   ├──41.33 MB (35.94%) -- gc-heap
│   │  ├──19.52 MB (16.97%) -- objects
│   │  │  ├──11.15 MB (09.70%) ── function
│   │  │  ├───6.70 MB (05.82%) ── ordinary
│   │  │  ├───1.15 MB (01.00%) ── dense-array
│   │  │  └───0.52 MB (00.45%) ── cross-compartment-wrapper
│   │  ├──14.18 MB (12.33%) -- shapes
│   │  │  ├───6.92 MB (06.01%) -- tree
│   │  │  │   ├──5.83 MB (05.07%) ── global-parented
│   │  │  │   └──1.09 MB (00.95%) ── non-global-parented
│   │  │  ├───5.41 MB (04.70%) ── base
│   │  │  └───1.86 MB (01.62%) ── dict
│   │  └───7.63 MB (06.63%) ── scripts
│   ├──10.38 MB (09.03%) -- shapes-extra
│   │  ├───5.69 MB (04.94%) ── compartment-tables
│   │  ├───3.32 MB (02.88%) ── tree-tables
│   │  └───1.38 MB (01.20%) ++ (2 tiny)
│   ├───4.03 MB (03.50%) -- objects-extra
│   │   ├──3.56 MB (03.09%) ── slots
│   │   └──0.47 MB (00.41%) ++ (3 tiny)
│   ├───1.72 MB (01.50%) ++ (7 tiny)
│   └───1.47 MB (01.28%) ── script-data
├───43.44 MB (37.77%) -- zones
│   ├──40.19 MB (34.95%) -- gc-heap
│   │  ├──33.61 MB (29.23%) ── unused-gc-things
│   │  ├───4.49 MB (03.90%) -- strings
│   │  │   ├──2.64 MB (02.30%) ── short
│   │  │   └──1.85 MB (01.60%) ── normal
│   │  ├───1.20 MB (01.05%) ── arena-admin
│   │  └───0.89 MB (00.77%) ++ (3 tiny)
│   ├───3.11 MB (02.71%) -- string-chars
│   │   ├──2.99 MB (02.60%) ── non-huge
│   │   └──0.13 MB (00.11%) ++ huge
│   └───0.13 MB (00.11%) ++ (2 tiny)
├───10.97 MB (09.53%) ── runtime
└────1.67 MB (01.45%) -- gc-heap
     ├──1.67 MB (01.45%) ── chunk-admin
     └──0.00 MB (00.00%) ++ (2 tiny)

83.20 MB (100.0%) -- js-main-runtime-gc-heap-committed
├──49.59 MB (59.60%) -- used
│  ├──46.71 MB (56.14%) ── gc-things
│  ├───1.67 MB (02.01%) ── chunk-admin
│  └───1.20 MB (01.45%) ── arena-admin
└──33.61 MB (40.40%) -- unused
   ├──33.61 MB (40.40%) ── gc-things
   └───0.00 MB (00.00%) ++ (2 tiny)

15.99 MB (100.0%) -- window-objects
├──10.88 MB (68.04%) -- layout
│  ├───3.73 MB (23.34%) ── style-sets
│  ├───2.50 MB (15.63%) ── pres-shell
│  ├───2.50 MB (15.62%) ── frames
│  ├───0.92 MB (05.77%) ── style-contexts
│  ├───0.62 MB (03.85%) ── rule-nodes
│  ├───0.34 MB (02.14%) ── pres-contexts
│  ├───0.17 MB (01.04%) ── text-runs
│  └───0.10 MB (00.65%) ── line-boxes
├───3.54 MB (22.10%) -- dom
│   ├──2.06 MB (12.90%) ── element-nodes
│   ├──0.70 MB (04.35%) ── other
│   ├──0.57 MB (03.59%) ── orphan-nodes
│   ├──0.18 MB (01.10%) ── text-nodes
│   └──0.03 MB (00.17%) ++ (3 tiny)
├───1.56 MB (09.73%) ── style-sheets
└───0.02 MB (00.13%) ── property-tables

    0.21 MB ── gfx-surface-image
    2.21 MB ── gfx-surface-xlib
    0.00 MB ── gfx-textures
          0 ── ghost-windows
5,637.90 MB ── heap-allocated
5,707.51 MB ── heap-committed
   69.61 MB ── heap-committed-unused
      1.23% ── heap-committed-unused-ratio
    2.91 MB ── heap-dirty
  165.10 MB ── heap-unused
    0.00 MB ── images-content-used-uncompressed
  107.00 MB ── js-gc-heap
    0.51 MB ── js-main-runtime-temporary-peak
      1,775 ── page-faults-hard
 27,449,171 ── page-faults-soft
5,884.73 MB ── resident
5,870.57 MB ── resident-unique
   23.54 MB ── storage-sqlite
7,052.72 MB ── vsize

Comment 8

[Craig Arno]

Attachment: Thunderbird x86 on Vista x64 memory usage

I'm not sure how much to believe about:memory.  Here is a snapshot of Thunderbird 32-bit running under Vista x64 which is running fine without problems.  The memory report shows I should have already exhausted physical memory, but this isn't the case as you can clearly see in Task Manager.

Here is the build info for this Windows 32-bit build:
about:buildconfig
Build Machine

W64-IX-SLAVE91
Source

Built from http://hg.mozilla.org/releases/mozilla-esr24/rev/6756aa79a839
Build platform
target
i686-pc-mingw32
Build tools
Compiler 	Version 	Compiler flags
c:/builds/moz2_slave/tb-rel-c-esr24-w32_bld-0000000/build/objdir-tb/mozilla/_virtualenv/Scripts/python.exe -O c:/builds/moz2_slave/tb-rel-c-esr24-w32_bld-0000000/build/mozilla/build/cl.py cl 	16.00.30319.01 	-TC -nologo -W3 -Gy -Fdgenerated.pdb -wd4244 -wd4819 -we4553 -DNDEBUG -DTRIMMED -Zi -UDEBUG -DNDEBUG -O1 -Oy
c:/builds/moz2_slave/tb-rel-c-esr24-w32_bld-0000000/build/objdir-tb/mozilla/_virtualenv/Scripts/python.exe -O c:/builds/moz2_slave/tb-rel-c-esr24-w32_bld-0000000/build/mozilla/build/cl.py cl 	16.00.30319.01 	-wd4099 -TP -nologo -W3 -Gy -Fdgenerated.pdb -wd4251 -wd4244 -wd4345 -wd4351 -wd4482 -wd4800 -wd4819 -we4553 -GR- -DNDEBUG -DTRIMMED -Zi -UDEBUG -DNDEBUG -O1 -Oy
Configure arguments

--enable-application=mail --enable-update-channel=release --enable-update-packaging --enable-jemalloc --enable-official-branding --enable-calendar --enable-application=mail --enable-update-channel=release --enable-update-packaging --enable-jemalloc --enable-official-branding --enable-calendar --enable-application=../mail --with-external-source-dir=c:/builds/moz2_slave/tb-rel-c-esr24-w32_bld-0000000/build --disable-official-branding --with-branding=../other-licenses/branding/thunderbird --cache-file=.././config.cache --srcdir=c:/builds/moz2_slave/tb-rel-c-esr24-w32_bld-0000000/build/mozilla

Comment 9

[Wayne Mery (:wsmwk)]

(In reply to Wayne Mery (:wsmwk) from comment #5)
> Thanks for the memory log. Unfortunately it errors on loading "SyntaxError:
> JSON.parse: unexpected character at line 1 column 1 of the JSON data"

This may be fixed in version 29 which can be found at http://www.mozilla.org/en-US/thunderbird/channel/

Comment 10

[Wayne Mery (:wsmwk)]

You are correct, about:memory can sometimes be some orders of magnitude off base. However, it often still surfaces folders that need help. Starting with these, some of which you have already mentioned...

│  ├──19,178.68 MB (334.26%) ── database(imap://[e-mail]/INBOX) [?!]
│  ├───7,856.02 MB (136.92%) ── database(imap://[e-mail]/Sent%20Items) [?!]
│  ├───2,647.68 MB (46.15%) ── database(imap://[e-mail]/people/Donna)
│  ├───2,098.91 MB (36.58%) ── database(imap://[e-mail]/people/Fay)
│  ├───1,386.75 MB (24.17%) ── database(imap://[e-mail]/Inbox2008)
│  ├───1,074.50 MB (18.73%) ── database(imap://[e-mail]/%5BGmail%5D/All%20Mail)

1. Unsubscribe all your gmail All Mail folder - In each account, do File | Subscribe | uncheck "All Mail"  then OK and restart Thunderbird.

2. what are the REAL sizes on disk for the .msf files of [e-mail]/INBOX and  [e-mail]/Inbox2008)  and imap://[e-mail]/Sent%20Items ??  (you can right click on folder and pick properties to get the folder size, but to get the .msf size you must look at the actual windows directory)

3. Pick ONE of these folders, delete and archive as much much as you can from that one folder to some other folder(s), restart

see how that plays out for a day or two and report back

Comment 11

[Craig Arno]

#2 - Actual sizes on the disk:

│  ├──19,178.68 MB (334.26%) ── database(imap://[e-mail]/INBOX) [?!]
  -rw------- 1 craig     users  548398140 Apr 27 08:58 craig
  Folder Properties can't be copied/pasted but say:
  Linux - "Size on disk: 532 MB", "Number of messages: 10152"
  Windows - "Size on disk: 528 MB", "Number of messages: 10152"

│  ├───7,856.02 MB (136.92%) ── database(imap://[e-mail]/Sent%20Items) [?!]
  -rw-------  1 craig users 801685303 Apr 25 10:43 Sent Items
  Linux - "Size on disk: 775 MB", "Number of messages: 6106"
  Windows - "Size on disk: 775 MB", "Number of messages: 6103"

│  ├───2,647.68 MB (46.15%) ── database(imap://[e-mail]/people/Donna)
  -rw------- 1 craig users 215911058 Dec 19  2012 Donna
  Linux - "Size on disk: 209 MB", "Number of messages: 4329"
  Windows - "Size on disk: 209 MB", "Number of messages: 4329"

│  ├───2,098.91 MB (36.58%) ── database(imap://[e-mail]/people/Fay)
  -rw------- 1 craig users 482830011 Dec 18  2011 Fay
  Linux - "Size on disk: 469 MB", "Number of messages: 7965"
  Windows - "Size on disk: 469 MB", "Number of messages: 7965"

│  ├───1,386.75 MB (24.17%) ── database(imap://[e-mail]/Inbox2008)
  -rw-------  1 craig users 199218127 May  6  2010 Inbox2008
  Linux - "Size on disk: 193 MB", "Number of messages: 2344"
  Windows - "Size on disk: 193 MB", "Number of messages: 2344"

│  ├───1,074.50 MB (18.73%) ── database(imap://[e-mail]/%5BGmail%5D/All%20Mail)
  Linux - "Size on disk: 101 MB", "Number of messages: 1161"
  Windows - "Size on disk: 101 MB", "Number of messages: 1161"

Performed #1, #2 (information above), #3-I modified this step by adding 8GB to my Linux workstation (16GB total) and maxing out my Laptop by ordering/replacing memory to increase from 3GB to 4GB.  This extends the time I can use my laptop from ½-1hr to about ½-1day.  My laptop is now maxed out and can't be extended beyond 4GB.  My workstation no longer has issues running Thunderbird, but does use 10-12GB of memory after running about a week.  I was out of town all week, so this hasn't been a "normal" week.
 
Other than running out of memory and Thunderbird instantly closing/"exploding", when Thunderbird is running, it runs quickly and responsively in both Windows and Linux.  I would prefer that Thunderbird run a little slower (having to refresh expired/released caches) than "exploding" when it runs out of cache memory.

My server is Linux based running a Dovecot IMAP server.  My workstation is also Linux based.  Windows is only involved when I use my laptop.  All machines, including laptop, run off SSD drives.  My laptop with an older Turion 64/X2 processor and Windows Vista x64 (HP DV9823CL), and it still runs responsively with Thunderbird and Firefox until it runs out of memory and Mozilla applications start crashing.

I have a similar problem with Firefox v28, Bugzilla 998753- Feature Request: Firefox uses too much memory, flush page caches as needed.  I recently received a response to 998753 saying this issue will be addressed in v29 of Firefox.  This is good except half my Firefox Sync support will disappear between v28 and v29 "Bug 989756 - Custom server support in Firefox Accounts" / "https://github.com/owncloud/mozilla_sync/issues/33#issuecomment-40572620"  Hopefully we can address this Thunderbird memory usage issue and I'll have one less issue to follow/address.

Comment 12

[Craig Arno]

I would like to add to what I wrote above that a "better" caching scheme would recognize "Inbox2008, people/Donna, people/Fay" and other not listed folders as relatively inactive folders.  Meaning that if usage time/activity stamps are honored Mozilla Thunderbird would favor caching INBOX and "Sent Items" when the machine's Memory Resource becomes scarce (Memory + Swap) and dump caching the rest.  And of INBOX and "Sent Items", INBOX is the more active of the two by about 10x or more.

As I mentioned in the Firefox thread Bug 998753, creating gargantuan Swap areas and consuming most of my available SSD to address aggressive Mozilla caching strategies is not a solution to this issue.  Caching strategies need to adapt to the machine resources, not the other way around.  Hopefully this comment will be informative if you need to discuss this issue with other Mozilla developers.

And thank you for your help with this issue.

Comment 13

[Wayne Mery (:wsmwk)]

I think we can safely skip any conversation of Firefox here - it's highly unlikely to be related at all

None of your folder sizes seems abnormal, on the surface. (I did however also ask for the size of your .msf files)

Which addons run on both your linux and windows machines?
Does memory usage reduce substantially if you eliminate them by running safe mode? 
  https://support.mozilla.org/en-US/kb/safe-mode

Comment 14

[Craig Arno]

I'm not sure where to find my MSF files.  I don't keep copies of IMAP mail locally.  In my account setup "Synchronization & Storage" > "Keep messages for this account on this computer" is -not- selected.  Under the "Advanced" button, no folders are selected.  I assumed you meant mail folders, which I keep on the server in my user login area.  This is what I provided above which starts with "-rw-------  1 craig users".  If I'm missing something, I need more instruction to provide what you need.

I'll disable Add-ons for as long as I can.  This disables Calendar (Lightning) features and all server side data Synchronization for anything other than basic IMAP email, i.e. Addressbook through Sogo Connector.

Here are my TB Addons:
======================

Linux -
-------
Extensions
Name 	Version 	Enabled 	ID
Contact Tabs	2.0.8	true	[e-mail]
Encrypt if possible	1.0	true	[e-mail]
FoxClocks	3.4.14	true	{d37dc5d0-431d-44e5-8c91-49419370caa1}
Google Contacts	0.7.12	true	{BDD92442-0534-4D6F-A966-BAB7D561D781}
Grammar Checker	0.6	true	[e-mail]
Inverse SOGo Connector	24.0.4	true	[e-mail]
Lightning	2.6.4	true	{e2fda1a4-762b-4020-b5ad-a41df1933103}
Provider for Google Calendar	0.25	true	{a62ef8ec-5fdc-40c2-873c-223b8a6925cc}
Saved Password Editor	2.7.2	true	[e-mail]
Select Addressbook Text	1.5	true	[e-mail]
LookOut	1.2.13	false	[e-mail]

Windows -
---------
Extensions
Name 	Version 	Enabled 	ID
Grammar Checker	0.6	true	[e-mail]
Inverse SOGo Connector	24.0.2a	true	[e-mail]
Lightning	2.6.4	true	{e2fda1a4-762b-4020-b5ad-a41df1933103}
Lightning Month Tabs	1.9	true	lightningmonthtabs@jlx.84
Provider for Google Calendar	0.25	true	{a62ef8ec-5fdc-40c2-873c-223b8a6925cc}
Saved Password Editor	2.7.2	true	[e-mail]

Comment 15

[Craig Arno]

Attachment: TB24W20140428a-SAFE-memory-report.json.gz

This is a Windows Thunderbird memory map from SAFE mode shortly after restarting Thunderbird.  In the amount of time its taken to write this, memory usage is now at 380MB reported by about:memory(insignificant on a 4GB machine). Taskmanager says TB is using 145MB.

Comment 16

[Wayne Mery (:wsmwk)]

(In reply to Craig Arno from comment #15)

> This is a Windows Thunderbird memory map from SAFE mode shortly after
> restarting Thunderbird.  In the amount of time its taken to write this,
> memory usage is now at 380MB reported by about:memory(insignificant on a 4GB
> machine). Taskmanager says TB is using 145MB.

Only the memory usage concerns me - not the amount of memory you have installed :)

380MB is I think nominal for 10 accounts.

.msf files can be found in each account directory, under Imapmail directory, in the thunderbird profile https://support.mozilla.org/en-US/kb/profiles-tb#w_where-is-my-profile-stored

Comment 17

[Craig Arno]

Here are the MSF files from the Linux system:

./mwl9kov2.default/ImapMail:
-rw-r--r--  1 craig users 1206 Mar  4  2012 imap.arno.com.msf
-rw-r-----  1 craig users 1206 May 23  2013 imap.frontier.com.msf
-rw-r--r--  1 craig users 1206 Mar 13  2012 imap.googlemail-1.com.msf
-rw-r--r--  1 craig users 1206 Mar 19  2012 imap.googlemail-2.com.msf
-rw-r--r--  1 craig users 1206 Apr 18  2012 imap.googlemail-3.com.msf
-rw-r-----  1 craig users 1223 Dec 11  2012 imap.googlemail-4.com.msf
-rw-r-----  1 craig users 1223 Dec 11  2012 imap.googlemail-5.com.msf
-rw-r-----  1 craig users 1240 Dec 27  2012 imap.googlemail-6.com.msf
-rw-r--r--  1 craig users 1206 Mar  9  2012 imap.googlemail.com.msf
-rw-r-----  1 craig users 1257 Jan  7  2013 imap.mail.yahoo.com.msf
-rw-r--r--  1 craig users 1206 Jul  6  2012 mail.koczarski.com.msf
./mwl9kov2.default/ImapMail/imap.arno.com:
-rw-r--r--  1 craig users   1113975 Apr 28 18:45 advertising.msf
-rw-r--r--  1 craig users      2858 Apr 17 17:33 Archives-1.msf
-rw-r--r--  1 craig users      1140 Mar  4  2012 Archives.msf
-rw-r--r--  1 craig users     17709 Mar 29 08:41 arno.com.msf
-rw-r--r--  1 craig users     29427 Oct 26  2013 Crystal Ridge.msf
-rw-r--r--  1 craig users      7629 Apr 27 10:31 Drafts-1.msf
-rw-r--r--  1 craig users      1137 Mar  4  2012 Drafts.msf
-rw-r-----  1 craig users     30037 Dec  6 09:45 High School Program.msf
-rw-r--r--  1 craig users    584036 Mar 17 15:35 Inbox2006.msf
-rw-r--r--  1 craig users   1312111 Mar 17 16:13 Inbox2007.msf
-rw-r--r--  1 craig users   1379223 Apr 27 10:31 Inbox2008.msf
-rw-r--r--  1 craig users   8203886 Apr 28 18:57 INBOX.msf
-rw-r--r--  1 craig users     27067 Mar 11 19:58 Inbox-Save.msf
-rw-r-----  1 craig users      2989 Oct 26  2013 Job Search.msf
-rw-r-----  1 craig users    248271 Apr 28 16:45 Junk.msf
-rw-r--r--  1 craig users     66927 Mar 20 16:55 keys.msf
-rw-r--r--  1 craig users     15841 Oct 26  2013 Life Insurance.msf
-rw-r-----  1 craig users    338339 Jan  6 00:37 Match.com.msf
-rw-r-----  1 craig users      1541 Oct 26  2013 mom.msf
-rw-r--r--  1 craig users     53704 Oct 26  2013 OOI.msf
-rw-r--r--  1 craig users    363752 Apr 28 14:38 parted.msf
-rw-------  1 craig users      2173 May 11  2013 people-1.msf
-rw-r--r--  1 craig users      1312 Apr 10  2012 people.msf
-rw-r--r--  1 craig users      8952 Oct 26  2013 Pet Rock.msf
-rw-r--r--  1 craig users   1723928 Apr 28 18:45 Schwab.msf
-rw-r--r--  1 craig users   4049750 Apr 28 18:45 Sent Items.msf
-rw-r--r--  1 craig users      1233 Mar  4  2012 Sent.msf
-rw-r-----  1 craig users      1613 Dec 20 10:25 taxes.msf
-rw-r--r--  1 craig users      1241 Mar  4  2012 Templates.msf
-rw-r-----  1 craig users     81572 Apr 28 11:18 Trash.msf
-rw-r-----  1 craig users      7186 Jan  2 10:37 Washington Benefits.msf
./mwl9kov2.default/ImapMail/imap.arno.com/people-1.sbd:
-rw-r----- 1 craig users   2214150 Apr 27 10:23 Donna.msf
-rw-r----- 1 craig users   3442593 Oct 26  2013 Fay.msf
-rw-r----- 1 craig users     53067 Oct 26  2013 Jean.msf
-rw-r----- 1 craig users     19351 Oct 26  2013 Jena.msf
-rw-r--r-- 1 craig users    124149 Oct 26  2013 Pam.msf
./mwl9kov2.default/ImapMail/imap.arno.com/people.sbd:
-rw-r----- 1 craig users 1371 Dec 19  2012 Donna.msf
-rw-r--r-- 1 craig users 1316 Apr 10  2012 Pam.msf
./mwl9kov2.default/ImapMail/imap.frontier.com:
-rw-r-----  1 craig users  1238 May 24  2013 Archives.msf
-rw-r-----  1 craig users  1383 May 25  2013 Bulk Mail.msf
-rw-r-----  1 craig users  2596 Dec  1 18:52 Draft.msf
-rw-r-----  1 craig users  1235 May 24  2013 Drafts.msf
-rw-r-----  1 craig users 11620 Mar 23 09:26 INBOX-1.msf
-rw-r-----  1 craig users  2254 May 23  2013 INBOX.msf
-rw-r-----  1 craig users  3090 Nov 29 11:35 Sent-1.msf
-rw-r-----  1 craig users  1135 May 23  2013 Sent.msf
-rw-r-----  1 craig users  1241 May 24  2013 Templates.msf
-rw-r-----  1 craig users  1379 May 25  2013 Trash.msf
./mwl9kov2.default/ImapMail/imap.googlemail-1.com:
-rw-r--r--  1 craig users      1244 Mar 12  2012 Archives.msf
-rw-r--r--  1 craig users      2618 Apr 27 10:30 d:\mail\[e-mail]
-rw-r--r--  1 craig users      2596 Apr 27 10:30 d:\mail.msf
-rw-r--r--  1 craig users      3698 Sep 10  2013 Drafts-1.msf
-rw-r--r--  1 craig users      1137 Mar 12  2012 Drafts.msf
-rw-r--r--  1 craig users      2201 Apr 27 11:02 [Gmail].msf
-rw-r--r--  1 craig users    927975 Apr 28 19:17 INBOX.msf
-rw-r--r--  1 craig users      2462 Mar 17 18:19 OX System Folders.msf
-rw-r--r--  1 craig users     28613 Apr 28 14:12 Sent-1.msf
-rw-r--r--  1 craig users      1135 Mar 12  2012 Sent.msf
-rw-r--r--  1 craig users      2449 Mar 17 18:19 Spam.msf
-rw-r--r--  1 craig users      1241 Mar 12  2012 Templates.msf
-rw-r--r--  1 craig users      2452 Apr 28 18:52 Trash.msf
./mwl9kov2.default/ImapMail/imap.googlemail-1.com/d:\mail\[e-mail]:
-rw-r--r-- 1 craig users   2487 Mar 17 18:18 Junk E-mail.msf
-rw-r--r-- 1 craig users   5173 Mar 17 18:18 Sent Items.msf
./mwl9kov2.default/ImapMail/imap.googlemail-1.com/d:\mail.sbd:
-rw-r--r-- 1 craig users 2465 Mar 17 18:18 Junk E-mail.msf
./mwl9kov2.default/ImapMail/imap.googlemail-1.com/[Gmail].sbd:
-rw-r----- 1 craig users     1246 Apr 28 11:04 All Mail.msf
-rw-r--r-- 1 craig users     2424 Mar 17 18:18 Drafts.msf
-rw-r--r-- 1 craig users   355088 Apr 27 10:35 Important.msf
-rw-r--r-- 1 craig users   285269 Apr 28 18:52 Sent Mail.msf
-rw-r--r-- 1 craig users     5742 Mar 17 18:18 Spam.msf
-rw-r--r-- 1 craig users    42995 Sep 10  2013 Starred.msf
-rw-r----- 1 craig users   305576 Mar 17 18:20 Trash.msf
./mwl9kov2.default/ImapMail/imap.googlemail-1.com/[Gmail].sbd/Trash.sbd:
./mwl9kov2.default/ImapMail/imap.googlemail-1.com/OX System Folders.sbd:
-rw-r--r-- 1 craig users 12855 Mar 17 18:19 OX Global Addressbook.msf
-rw-r--r-- 1 craig users  2481 Mar 17 18:19 Shared Addressbook.msf
./mwl9kov2.default/ImapMail/imap.googlemail-2.com:
-rw-r--r--  1 craig users     1140 Mar 19  2012 Archives.msf
-rw-r--r--  1 craig users     1137 Mar 19  2012 Drafts.msf
-rw-r--r--  1 craig users     1383 Mar 19  2012 [Gmail].msf
-rw-r--r--  1 craig users   800984 Oct 13  2012 INBOX.msf
-rw-r--r--  1 craig users     8399 Oct  8  2012 Junk.msf
-rw-r--r--  1 craig users     1627 Mar 27  2012 Personal.msf
-rw-r--r--  1 craig users     1633 Mar 27  2012 Receipts.msf
-rw-r--r--  1 craig users     1135 Mar 19  2012 Sent.msf
-rw-r--r--  1 craig users     1241 Mar 19  2012 Templates.msf
-rw-r--r--  1 craig users     1585 Mar 19  2012 Travel.msf
-rw-r--r--  1 craig users     1564 Mar 19  2012 Work.msf
./mwl9kov2.default/ImapMail/imap.googlemail-2.com/[Gmail].sbd:
-rw-r--r-- 1 craig users   653992 Oct 13  2012 All Mail.msf
-rw-r--r-- 1 craig users     4299 Oct 13  2012 Drafts.msf
-rw-r--r-- 1 craig users   286114 Oct 13  2012 Important.msf
-rw-r--r-- 1 craig users    89499 Oct 13  2012 Sent Mail.msf
-rw-r--r-- 1 craig users    13951 Oct 13  2012 Spam.msf
-rw-r--r-- 1 craig users     2971 May 31  2012 Starred.msf
-rw-r--r-- 1 craig users    16351 Oct 13  2012 Trash.msf
./mwl9kov2.default/ImapMail/imap.googlemail-3.com:
-rw-r--r--  1 craig users    1244 Apr 16  2012 Archives.msf
-rw-r--r--  1 craig users    1137 Apr 16  2012 Drafts.msf
-rw-r--r--  1 craig users    1383 Apr 20  2012 [Gmail].msf
-rw-r--r--  1 craig users   33566 Oct 13  2012 INBOX.msf
-rw-r--r--  1 craig users    1627 Apr 24  2012 Personal.msf
-rw-r--r--  1 craig users    1633 Apr 24  2012 Receipts.msf
-rw-r--r--  1 craig users    1135 Apr 16  2012 Sent.msf
-rw-r--r--  1 craig users    1241 Apr 16  2012 Templates.msf
-rw-r--r--  1 craig users    1585 Apr 18  2012 Travel.msf
-rw-r--r--  1 craig users    1564 Apr 18  2012 Work.msf
./mwl9kov2.default/ImapMail/imap.googlemail-3.com/[Gmail].sbd:
-rw-r--r-- 1 craig users   35445 Oct 13  2012 All Mail.msf
-rw-r--r-- 1 craig users    1980 Sep 15  2012 Drafts.msf
-rw-r--r-- 1 craig users   19333 Oct 13  2012 Important.msf
-rw-r--r-- 1 craig users   21876 Sep 19  2012 Sent Mail.msf
-rw-r--r-- 1 craig users    7783 Oct 13  2012 Spam.msf
-rw-r--r-- 1 craig users    1640 Apr 24  2012 Starred.msf
-rw-r--r-- 1 craig users   21160 Oct 13  2012 Trash.msf
./mwl9kov2.default/ImapMail/imap.googlemail-4.com:
-rw-r-----  1 craig users    1261 Dec 11  2012 Archives.msf
-rw-r-----  1 craig users    1137 Dec 11  2012 Drafts.msf
-rw-r-----  1 craig users    1537 Apr 27 10:32 [Gmail].msf
-rw-r-----  1 craig users  274315 Apr 28 19:17 INBOX.msf
-rw-r-----  1 craig users    1135 Dec 11  2012 Sent.msf
-rw-r-----  1 craig users    1241 Dec 11  2012 Templates.msf
./mwl9kov2.default/ImapMail/imap.googlemail-4.com/[Gmail].sbd:
-rw-r----- 1 craig users    1246 Apr 28 18:47 All Mail.msf
-rw-r----- 1 craig users    1655 Jul 24  2013 Drafts.msf
-rw-r----- 1 craig users  122431 Sep 10  2013 Important.msf
-rw-r----- 1 craig users    2672 Mar 19 09:39 Sent Mail.msf
-rw-r----- 1 craig users    2870 Sep 28  2013 Spam.msf
-rw-r----- 1 craig users    1702 Jul 24  2013 Starred.msf
-rw-r----- 1 craig users    3358 Jul 24  2013 Trash.msf
./mwl9kov2.default/ImapMail/imap.googlemail-5.com:
-rw-r-----  1 craig users     1261 Dec 11  2012 Archives.msf
-rw-r-----  1 craig users     1137 Dec 11  2012 Drafts.msf
-rw-r-----  1 craig users     2781 Apr 27 21:07 [Gmail].msf
-rw-r-----  1 craig users  1050235 Apr 28 19:17 INBOX.msf
-rw-r-----  1 craig users     2809 Mar 26 11:14 Junk-1.msf
-rw-r-----  1 craig users     1140 Oct 18  2013 Junk.msf
-rw-r-----  1 craig users     1135 Dec 11  2012 Sent.msf
-rw-r-----  1 craig users     1241 Dec 11  2012 Templates.msf
./mwl9kov2.default/ImapMail/imap.googlemail-5.com/[Gmail].sbd:
-rw-r----- 1 craig users    1246 Apr 28 18:47 All Mail.msf
-rw-r----- 1 craig users    3415 Apr 17 19:45 Drafts.msf
-rw-r----- 1 craig users  264037 Sep 10  2013 Important.msf
-rw-r----- 1 craig users   31907 Apr 27 21:08 Sent Mail.msf
-rw-r----- 1 craig users    2830 Sep  6  2013 Spam.msf
-rw-r----- 1 craig users    1719 May 25  2013 Starred.msf
-rw-r----- 1 craig users   70999 Apr 27 15:09 Trash.msf
./mwl9kov2.default/ImapMail/imap.googlemail-6.com:
-rw-r-----  1 craig users   1140 Dec 27  2012 Archives.msf
-rw-r-----  1 craig users   1137 Dec 27  2012 Drafts.msf
-rw-r-----  1 craig users   1537 Apr 27 10:32 [Gmail].msf
-rw-r-----  1 craig users  10679 Apr 28 19:18 INBOX.msf
-rw-r-----  1 craig users   1135 Dec 27  2012 Sent.msf
-rw-r-----  1 craig users   1241 Dec 27  2012 Templates.msf
./mwl9kov2.default/ImapMail/imap.googlemail-6.com/[Gmail].sbd:
-rw-r----- 1 craig users  1246 Apr 28 18:47 All Mail.msf
-rw-r----- 1 craig users  2062 May 25  2013 Drafts.msf
-rw-r----- 1 craig users  1704 May 25  2013 Important.msf
-rw-r----- 1 craig users  1785 May 25  2013 Sent Mail.msf
-rw-r----- 1 craig users  2817 May 25  2013 Spam.msf
-rw-r----- 1 craig users  1656 May 25  2013 Starred.msf
-rw-r----- 1 craig users  4170 May 25  2013 Trash.msf
./mwl9kov2.default/ImapMail/imap.googlemail.com:
-rw-r--r--  1 craig users   1244 Mar  9  2012 Archives.msf
-rw-r--r--  1 craig users   5454 Apr 27 19:38 Drafts-1.msf
-rw-r--r--  1 craig users   1137 Mar  9  2012 Drafts.msf
-rw-r--r--  1 craig users   2833 Apr  9 20:08 [Gmail].msf
-rw-r--r--  1 craig users 697102 Apr 28 19:18 INBOX.msf
-rw-r--r--  1 craig users   1135 Mar  9  2012 Sent.msf
-rw-r--r--  1 craig users   1241 Mar  9  2012 Templates.msf
-rw-r--r--  1 craig users   2951 Apr 28 18:52 Trash.msf
./mwl9kov2.default/ImapMail/imap.googlemail.com/[Gmail].sbd:
-rw-r----- 1 craig users   1246 Apr 27 10:33 All Mail.msf
-rw-r--r-- 1 craig users   2477 May 25  2013 Drafts.msf
-rw-r--r-- 1 craig users  16725 Sep 10  2013 Important.msf
-rw-r----- 1 craig users  18693 Sep 10  2013 Jena.msf
-rw-r--r-- 1 craig users 460610 Apr 28 15:07 Sent Mail.msf
-rw-r--r-- 1 craig users   2911 Mar 29 09:37 Spam.msf
-rw-r--r-- 1 craig users   2355 May 25  2013 Starred.msf
-rw-r----- 1 craig users  23640 Apr 17 14:41 Trash.msf
./mwl9kov2.default/ImapMail/imap.googlemail.com/[Gmail].sbd/Trash.sbd:
-rw-r----- 1 craig users 1563 May 21  2013 Sent.msf
./mwl9kov2.default/ImapMail/imap.googlemail.com/Trash.sbd:
./mwl9kov2.default/ImapMail/imap.mail.yahoo.com:
-rw-r-----  1 craig users   1238 Jan  9  2013 Archives.msf
-rw-r-----  1 craig users   1567 May 25  2013 Bulk Mail.msf
-rw-r-----  1 craig users   1563 May 25  2013 Draft.msf
-rw-r-----  1 craig users   2744 May 25  2013 Drafts-1.msf
-rw-r-----  1 craig users   1235 Jan  7  2013 Drafts.msf
-rw-r-----  1 craig users  14269 Apr 28 19:18 INBOX.msf
-rw-r-----  1 craig users   5382 Nov 28 14:30 Sent-1.msf
-rw-r-----  1 craig users   1135 Jan  7  2013 Sent.msf
-rw-r-----  1 craig users   1241 Jan  9  2013 Templates.msf
-rw-r-----  1 craig users   1563 May 25  2013 Trash.msf
-rw-r-----  1 craig users  29925 Sep 13  2013 Y! Conversations.msf
./mwl9kov2.default/ImapMail/mail.koczarski.com:
-rw-r--r--  1 craig users    1238 Jul  6  2012 Archives.msf
-rw-r--r--  1 craig users    3656 May 25  2013 Drafts-1.msf
-rw-r--r--  1 craig users    1137 Jul  5  2012 Drafts.msf
-rw-r--r--  1 craig users   77635 Apr 27 10:32 INBOX.msf
-rw-r--r--  1 craig users  357350 Apr 27 10:32 Junk.msf
-rw-r--r--  1 craig users    4841 Dec  3 00:36 Sent-1.msf
-rw-r--r--  1 craig users    1135 Jul  5  2012 Sent.msf
-rw-r--r--  1 craig users    1686 May 25  2013 Spam.msf
-rw-r--r--  1 craig users    1241 Jul  5  2012 Templates.msf
-rw-r--r--  1 craig users    9892 Nov  7 22:35 Trash.msf
./mwl9kov2.default/Mail:
./mwl9kov2.default/Mail/Local Folders:
-rw-r--r-- 1 craig users 1958 Mar  4  2012 Trash.msf
-rw-r--r-- 1 craig users 2014 Mar  4  2012 Unsent Messages.msf

I expect these files to be about the same on the Windows system.  I'll see if I can find a reasonably easy way to list them.

Comment 18

[Craig Arno]

Attachment: TB24W-ProfileDir.7z

I couldn't find any MSF files on the Windows system.  Here is a compressed listing of the entire profile area.  Maybe you can make heads or tails out of this information.

Comment 19

[Craig Arno]

Attachment: Windows Vista x64 Thunderbird profile MSF file listing

Ignore comment #18.  I found
APPDATA=C:\Users\craig\AppData\Roaming
And got this attached listing from that profile area.
I performed a small amount of pre-processing to pare the listing down to Directory identification and MSF files.

Comment 20

[Craig Arno]

Attachment: TB Linux SAFE-MODE about:memory ~24hrs

Coming up on 24 hours running TB 24.4.0 Linux in Safe Mode.  TB is using close to 2GB of memory.  Usage of TB has been light during this 24 hour period.  Only a few emails sent from 2-3 accounts.

about:memory Summary-
====================
Main Process

WARNING: the following values are negative or unreasonably large.

    explicit/maildb
    explicit/maildb/database(imap://[e-mail]/INBOX)
    explicit/(17 tiny)
    explicit/(17 tiny)/heap-unclassified 

This indicates a defect in one or more memory reporters. The invalid values are highlighted.
Explicit Allocations

551.49 MB (100.0%) -- explicit
├──1,899.00 MB (344.34%) ++ maildb [?!]
├───32.32 MB (05.86%) ++ js-non-window
├───24.21 MB (04.39%) ++ window-objects
├───11.57 MB (02.10%) ++ storage/sqlite
├────5.58 MB (01.01%) ++ workers/workers()/worker(resource:///modules/attachmentChecker.js, 0x7f38d2754800)
└──-1,421.20 MB (-257.70%) ++ (17 tiny) [?!]

Other Measurements

3.65 MB (100.0%) ++ decommitted

283 (100.0%) ++ js-compartments

42.69 MB (100.0%) ++ js-main-runtime

27.35 MB (100.0%) ++ js-main-runtime-gc-heap-committed

13.85 MB (100.0%) ++ window-objects

    0.02 MB ── gfx-surface-image
    0.78 MB ── gfx-surface-xlib
    0.00 MB ── gfx-textures
          0 ── ghost-windows
  519.60 MB ── heap-allocated
  533.23 MB ── heap-committed
   13.65 MB ── heap-committed-unused
      2.61% ── heap-committed-unused-ratio
    2.61 MB ── heap-dirty
   28.40 MB ── heap-unused
    0.00 MB ── images-content-used-uncompressed
   31.00 MB ── js-gc-heap
    0.32 MB ── js-main-runtime-temporary-peak
         15 ── page-faults-hard
  4,466,193 ── page-faults-soft
  644.98 MB ── resident
  627.42 MB ── resident-unique
   11.57 MB ── storage-sqlite
1,624.88 MB ── vsize

This result is real.  Here is the "ps ux" output:
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
craig     5873  1.0  4.0 1673088 666996 ?      Sl   Apr27  30:43 /usr/lib64/thunderbird/thunderbird-bin

Thunderbird and Firefox Mozilla applications combined are using 5GB of memory while running in SAFE MODE.
I'm also running Firefox 28 in Safe Mode.  FF28 about:memory says it is using 3.4GB of memory.  On many machines this means next to nothing is left for other applications, like Office and such.  Like we said in the other thread, I need memory relief.  I've seen other bugs opened and then closed on this subject (usually more poorly worded than mine) as non-repro or not enough information, so I know this is also a real issue for other users.  I hope we can get traction on this issue for both Mozilla applications.  I'm glad to see you escalated this issue to "Major", because this kind of memory usage is a major issue for many computing platforms still in use today.

Comment 21

[Craig Arno]

Attachment: TB 24.5.0 SAFE Mode several days claims 2.4GB memory

% ps aux
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
craig    26942  0.6  7.7 2463792 1265560 ?     Sl   Apr30  22:59 /usr/lib64/thunderbird/thunderbird-bin

Verified No Add-ons loaded.  I noticed Thunderbird (Linux) was updated yesterday, about a day and a half ago to v24.5.0.  This report is from v24.5.0.  I thought at first it was using less memory, but a day later it appears to be behaving pretty much the same as 24.4.0.  2.4GB is a -lot- of memory!

Comment 22

[Craig Arno]

Attachment: TB 24.5.0 SAFE Mode claims 4.5GB memory

Thunderbird 24.5.0 (Linux) has been running in SAFE mode since my last memory posting.  Here is the attached memory report.  And a ps shows the large amount of memory usage is real:

USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
craig    26942  0.6 20.6 4609148 3386080 ?     Sl   Apr30  63:02 /usr/lib64/thunderbird/thunderbird-bin

This works on a workstation with absurd amounts of memory (16GB), but not on a laptop which is limited to 4GB for -all- running applications to share.  My workstation is also running Firefox which is showing similar memory consuming behavior.  Linux shows that 10GB of the 16GB are currently consumed, 20% of 16GB by Thunderbird.  When I shutdown Thunderbird, this drops to 6.7GB.

I need to take Thunderbird out of safemode to return my calendar, password manager, addressbook sync, etc provided by Add-ons.  I think it is now safe to say this problem exists without Add-ons running, and I need substantial memory relief from this Thunderbird memory consuming behavior.

On my 4GB Windows Vista x64 Laptop, the OS forcibly removes Thunderbird and/or Firefox when this kind of memory behavior occurs.  So I can't leave them running for more than a few hours (1/2 day) when I'm performing other work.

Let me know what I can do to provide more information, if it's needed.

Comment 23

[Wayne Mery (:wsmwk)]

Craig, sorry it's been so long.  Thanks for the detailed info.  Do you still see this when running version 31?  

(File sizes noted in comment 17 look OK)

Comment 24

[Craig Arno]

I'll make an effort to use the 4GB Laptop (Vista x64) system in about ½ week when I return from out of town. My workstation is a 16GB OpenSUSE Linux 12.3 x64 Thunderbird 31.3.0.  With 16GB RAM the issue is largely hidden. With 4GB, Firefox, LibreOffice, and a CAD program running, the issue displays quicker.  I rebooted the workstation this morning and haven't used it most of the day, and this is what I see (1.5GB memory usage):

% ps aux|grep thun
craig     4481  0.7  3.4 1514832 564496 ?      Sl   10:45   5:18 /usr/lib64/thunderbird/thunderbird-bin --sm-config-prefix /thunderbird-bin-FbRakd/ --sm-client-id 101721a81b217e000141904647200000038990011 --screen 0

I think it is safe to say the issue still exists, but may not be as severe as version 24.  I leave the Linux Thunderbird running because it is the instance with most of the "Junk Filter" and "Other Filter" operations setup.  My laptop is run infrequently and can't easily copy these worstation filter settings into its installation (No Sync ability for Filter information).  I receive a fair amount of spam (unsolicited bulk email) and Thunderbird is the third layer in my SPAM defenses.

I'm glad this memory issue is getting attention now.

Comment 25

[Wayne Mery (:wsmwk)]

According to bug 998753 comment 8 lets call this WFM.

To recap slightly, 400-800MB memory may be considered normal with that many accounts and calendar addon. But 800+MB is getting into questinoable territory.  Also, comment 10 is important.

Comment 26

[Wayne Mery (:wsmwk)]

Craig, please try this...

In edit | Preferences (on Windows Tools|Options)->Advanced->Config editor, find
these 2 preferences, hopefully with these values:
mail.db.idle_limit 300000
mail.db.max_open 30

1. Are they at those values?
2. Try to increase mail.db.max_open to 10000 or more than the number of your
folders in total. Do you get better results?
3. If you do not have better results, please also post in this bug report, the
contents of Help | Troubleshooting

Comment 27

[Craig Arno]

Attachment: Linux TB 31.3.0 & Windows TB 31.5.0 Memory information

Linux
-----
mail.db.idle_limit;300000
mail.db.max_open;10000
mail.db_timestamp_leeway;4000

Windows 7 x64
---------------------
mail.db.idle_limit;300000
mail.db.max_open;30
mail.db_timestamp_leeway;4000


Windows is a new install this week being used while I start a new job.

TB31.7z:

   Date      Time    Attr         Size   Compressed  Name
------------------- ----- ------------ ------------  ------------------------
2015-02-28 11:31:36 ....A        54196        79588  TB31-3-0Linux_MemoryReport-20150228a.gif
2015-02-28 11:30:13 ....A        21544               TB31-3-0Linux_MemoryReport-20150228b.gif
2015-02-28 11:35:30 ....A        26832               TB31-3-0Linux_TroubleshootingInformation-20150228.txt
2015-02-28 12:51:06 ....A         4467               TB31-5-0Windows_TroubleshootingInformation-20150228.txt
2015-02-28 11:28:14 ....A        52381       127340  TB31-3-0Linux_MemoryReport_20150228.json.gz
2015-02-28 12:45:44 ....A        39430               TB31-5-0Windows_MemoryReport_20150228.json.gz
2015-02-28 12:44:42 ....A        18734               TB31-5-0Windows_MemoryReport-20150228a.gif
2015-02-28 12:44:10 ....A        16454               TB31-5-0Windows_MemoryReport-20150228b.gif
------------------- ----- ------------ ------------  ------------------------
                                234038       206928  8 files, 0 folders

GIF files capture information (in RED) which appears to get lost in the JSON files.  Also did a Troubleshooting Information capture for both systems.

I thought I'd modified mail.db.max_open in Windows, but apparently not.  I think I only did this on my Vista x64 Laptop.  The Windows 7 version is only looking at my arno.com account and TB was restarted mid week, meaning it doesn't have the same run-time as the Linux TB version, and it is looking at one large IMAP account instead of 10.  I use the Windows 7 machine from work to home using Remote Desktop.

Comment 28

[Wayne Mery (:wsmwk)]

Craig, can you try the beta from http://www.mozilla.org/en-US/thunderbird/channel/ ?

Comment 29

[Wayne Mery (:wsmwk)]

It would be great to determine whether 38 fixes this.

Comment 30

[Craig Arno]

Sorry for delay Wayne... your request coincided with tax time (15-Apr; read crazy busy) here in the US.  I have Thunderbird Beta2 running on my Vista Laptop for 2 days now.  I can't find about:memory for the reporting.  Also, not being able to use Lightning prevents me from using Beta2 on one of my more heavily used "production" machines.

This said, Thunderbird Beta2 has been running on the Vista x64 machine for 2 days.  So if I can figure out how to produce a memory report for you, I'll upload results.  I have a homeowners association meeting tonight, so patience.  I suspect my timezone (US-PST) is 9 hours behind yours. Yes, I'm still here, as my schedule allows.  :)

Comment 31

[Wayne Mery (:wsmwk)]

(In reply to Craig Arno from comment #30)
> Sorry for delay Wayne... your request coincided with tax time (15-Apr; read
> crazy busy) here in the US.  

no problem, as long as we knwo you didn't get lost :)

> I have Thunderbird Beta2 running on my Vista
> Laptop for 2 days now.  I can't find about:memory for the reporting. 
 Help | Troubleshooting | about:memory | measure and save

> Also,
> not being able to use Lightning prevents me from using Beta2 on one of my
> more heavily used "production" machines.

You want version 4.0b1 available under "Development Channel" at https://addons.mozilla.org/en-US/thunderbird/addon/lightning/

More generally, https://developer.mozilla.org/en-US/docs/Mozilla/Calendar/Calendar_Versions will indicate what you need. https://developer.mozilla.org/en-US/docs/Mozilla/Calendar/ is worthy of bookmarking

Comment 32

[Wayne Mery (:wsmwk)]

(In reply to Wayne Mery (:wsmwk, use Needinfo for questions) from comment #31)
> https://developer.mozilla.org/en-US/docs/Mozilla/Calendar/Calendar_Versions
> will indicate what you need.
> https://developer.mozilla.org/en-US/docs/Mozilla/Calendar/ is worthy of
> bookmarking

You want to bookmark https://www.mozilla.org/en-US/projects/calendar/ not what I mentioned above

Comment 33

[Craig Arno]

Attachment: Thunderbird 38-Beta2 Memory usage information

Wayne, Since the information is somewhat sensitive, contact me for the archive password... I'll look around to see if I can figure out how to contact you first.

Summary:
If I believe the about:memory figures, it's not good.  When I look at task manager, results look great!  I tend to believe what task manager is reporting more than about:memory.

Comment 34

[Wayne Mery (:wsmwk)]

Craig sent me info that I need to check.

Comment 35

[Wayne Mery (:wsmwk)]

(In reply to Craig Arno from comment #33)
> Created attachment 8595999 [details]
> Thunderbird 38-Beta2 Memory usage information
> 
> Wayne, Since the information is somewhat sensitive, contact me for the
> archive password... I'll look around to see if I can figure out how to
> contact you first.
> 
> Summary:
> If I believe the about:memory figures, it's not good.  When I look at task
> manager, results look great!  I tend to believe what task manager is
> reporting more than about:memory.

Craig, thanks for the info. Nothing I can hang my hat on in the memory profile. Yes, task manager will be more trustworthy for total memory usage.

Are you still having trouble?

Comment 36

[Wayne Mery (:wsmwk)]

(In reply to Craig Arno from comment #33)
> Created attachment 8595999 [details]
> Thunderbird 38-Beta2 Memory usage information

Explicit Allocations
242.62 MB (100.0%) -- explicit
├──2,202.94 MB (907.98%) -- maildb [?!]
│  ├──1,318.84 MB (543.58%) ── database(imap://craig@.../INBOX) [?!]
│  ├────299.97 MB (123.64%) ── database(imap://craig@.../people/1) [?!]
│  ├────162.83 MB (67.11%) ── database(imap://craig@.../people/2)


Other Measurements
4,095.94 MB (100.0%) -- address-space
├──3,379.63 MB (82.51%) ── free [393]
├────521.36 MB (12.73%) -- commit
│    ├──332.01 MB (08.11%) -- private
│    │  ├──328.71 MB (08.03%) ── readwrite [569]
│    │  └────3.30 MB (00.08%) ++ (5 tiny)


> Summary:
> If I believe the about:memory figures, it's not good.  When I look at task
> manager, results look great!  I tend to believe what task manager is
> reporting more than about:memory.

yes, task manager is what you want to go by. There is a bug in about:memory for Thunderbird.
So there isn't a problem with what you last reported.

Are you still seeing the problem?

Comment 37

[Wayne Mery (:wsmwk)]

(Needs retesting with a current version)

Comment 38

[Wayne Mery (:wsmwk)]

Craig, you are still seeing the super high memory usage?

Comment 39

[Craig Arno]

Yes.  Left running for nearly 20 days caused TB 57 beta 2 to consume nearly 16GB.  This seems quite excessive to me.  To perform well TB shouldn't need to keep this much stuff in memory.

# top

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
16410 craig     20   0 15.456g 0.999g  91176 S   4.0  6.4   1555:01 thunderbird 

I'll send you the memory output for this.

Comment 40

[Wayne Mery (:wsmwk)]

Craig, Have you learned anything new?

The list of most likely matches would be in this bug query https://mzl.la/2IWr7qD
And of those, most notable is Bug 1240722 - Thunderbird leaks file descriptors like a sieve (mostly .msf files)
For others
- bug 1438455 looks headed for resolution (related to RSS feeds)
- Bug 1322233 speculates the problem doesn't happen version 38* (leaks memory over a few days. One imap account, 38 folders, no rss)   *but this bug is circa version 31

Comment 41

[Wayne Mery (:wsmwk)]

Craig reported in May

My inbox on arno.com /var/spool/mail is:

-rw------- 1 craig     users  787689460 May 22 16:11 craig

# ll imap.arno.com
total 28008
drwxr-xr-x 10 craig users    4096 Jan 31 16:32 ./
drwx------  9 craig users    4096 Feb 21  2017 ../
-rw-r--r--  1 craig users    1643 Apr 27  2017 april.msf
-rw-r--r--  1 craig users    5000 Jul 17  2016 Archives-1.msf
-rw-r--r--  1 craig users    1238 Jun 20  2016 Archives.msf
-rw-r--r--  1 craig users    1642 Nov 23  2016 ARNO.msf
drwx------  2 craig users    4096 Dec  1  2016 ARNO.sbd/
-rw-r--r--  1 craig users 6114356 Apr  8 15:26 Cobra.msf
drwx------  2 craig users    4096 Jan 18 09:36 Cobra.sbd/
-rw-r--r--  1 craig users    1623 Nov 21 18:52 Decrypt.msf
-rw-r--r--  1 craig users   11767 Apr 15 12:10 Drafts-1.msf
-rw-r--r--  1 craig users    1235 Jun 20  2016 Drafts.msf
-rw-r--r--  1 craig users    1612 Jun 21  2016 EKOS.msf
drwx------  2 craig users    4096 Jun 14  2017 EKOS.sbd/
-rw-r--r--  1 craig users    2548 Jan 31 16:29 electronics.msf
drwx------  2 craig users    4096 Mar  3 13:27 electronics.sbd/
-rw-r--r--  1 craig users     198 Jun  2  2017 filterlog.html
-rw-r--r--  1 craig users    1616 Jun 21  2016 Frontier.msf
-rw-r--r--  1 craig users   82060 Sep 21  2017 Genealogy.msf
-rw-r--r--  1 craig users    1641 Nov 23  2016 HOA.msf
drwx------  2 craig users    4096 Nov 17  2016 HOA.sbd/
-rw-r--r--  1 craig users 5145688 May 11 14:47 INBOX.msf
-rw-r--r--  1 craig users   68611 May 20  2017 IPC.msf
-rw-r--r--  1 craig users    1648 Nov 23  2016 Job Search.msf
-rw-r--r--  1 craig users  685248 Mar 20 08:28 Junk-1.msf
-rw-r--r--  1 craig users    1627 Jun 25  2017 Junk E-mail.msf
-rw-r--r--  1 craig users    1238 Jun 21  2016 Junk.msf
-rw-r--r--  1 craig users   57424 Jul 16  2016 keys.msf
-rw-r--r--  1 craig users    1611 Jun 21  2016 LCM.msf
drwx------  2 craig users    4096 Nov 17  2016 LCM.sbd/
-rw-r--r--  1 craig users   89628 Jan 16 23:04 Mozilla Sync 1.5.msf
-rw-r--r--  1 craig users     852 Jan 31 16:32 msgFilterRules.dat
-rw-r--r--  1 craig users    1614 Jun 21  2016 parted.msf
-rw-r--r--  1 craig users    2395 Jul 12  2016 people.msf
drwx------  2 craig users    4096 Jul 12  2016 people.sbd/
-rw-r--r--  1 craig users    1616 Jun 21  2016 Pet Rock.msf
drwx------  2 craig users    4096 Nov 17  2016 Pet Rock.sbd/
-rw-r--r--  1 craig users 1896327 Jul 16  2016 Schwab.msf
-rw-------  1 craig users 5507992 Nov 19  2017 Sent Items
-rw-r--r--  1 craig users    1630 Nov 13  2017 Sent Items2017.msf
-rw-r--r--  1 craig users    1657 Mar 15  2017 Sent Items-feb-2017.msf
-rw-r--r--  1 craig users    1657 Mar 15  2017 Sent Items-jan-2017.msf
-rw-r--r--  1 craig users  194479 May 10 13:03 Sent Items.msf
-rw-r--r--  1 craig users    1233 Jun 20  2016 Sent.msf
-rw-r--r--  1 craig users  309939 Feb 22  2017 SentPeggy-1.msf
-rw-r--r--  1 craig users    1391 Feb 22  2017 SentPeggy.msf
-rw-r--r--  1 craig users   74831 Sep 26  2017 SolTerra.msf
-rw-r--r--  1 craig users  834515 Apr 30 10:29 SpamCop.msf
-rw-r--r--  1 craig users    1616 Jun 21  2016 SPAM.tng.msf
-rw-r--r--  1 craig users  238650 Apr 30 10:40 SquirrelMail.msf
-rw-r--r--  1 craig users    1307 Jan 10 20:49 Templates.msf
-rw-r--r--  1 craig users 7171875 May 10 13:03 Trash.msf
-rw-r--r--  1 craig users    1627 Jun 21  2016 Washington Benefits.msf

root@pluto:/home/craig/.thunderbird/25odqldu.default/ImapMail# du
13024   ./imap.gmail-3.com/[Gmail].sbd
28604   ./imap.gmail-3.com
12      ./imap.arno.com/HOA.sbd
12      ./imap.arno.com/Pet Rock.sbd
1200    ./imap.arno.com/EKOS.sbd
184     ./imap.arno.com/ARNO.sbd
124     ./imap.arno.com/electronics.sbd
824     ./imap.arno.com/Cobra.sbd
68      ./imap.arno.com/people.sbd
12      ./imap.arno.com/LCM.sbd
30408   ./imap.arno.com
12      ./imap.gmail-2.com/OX System Folders.sbd
12      ./imap.gmail-2.com/d5f580571.sbd
48      ./imap.gmail-2.com/[Gmail].sbd
8       ./imap.gmail-2.com/d3ccff1e4.sbd
548     ./imap.gmail-2.com
892     ./imap.mail.yahoo-1.com
976     ./imap.gmail-1.com/[Gmail].sbd
3644    ./imap.gmail-1.com
580     ./imap.mail.yahoo.com
404     ./imap.gmail.com/[Gmail].sbd
13576   ./imap.gmail.com
78284   .

root@pluto:/home/craig/.thunderbird/25odqldu.default# find|grep -i archive
./ImapMail/imap.gmail-3.com/Archives.msf
./ImapMail/imap.arno.com/Archives.msf
./ImapMail/imap.arno.com/Archives-1.msf
./ImapMail/imap.gmail-2.com/Archives.msf
./ImapMail/imap.mail.yahoo-1.com/Archive.msf
./ImapMail/imap.mail.yahoo-1.com/Archives.msf
./ImapMail/imap.gmail-1.com/Archives.msf
./ImapMail/imap.mail.yahoo.com/Archive.msf
./ImapMail/imap.mail.yahoo.com/Archives.msf
./ImapMail/imap.gmail.com/Archives.msf

Comment 42

[Wayne Mery (:wsmwk)]

(PM to Craig fails https://support.google.com/mail/answer/69585 - perhaps bugmail will get through)

Craig, are you running the beta 60 and still seeing the problem?

Comment 43

[Craig Arno]

1) Not sure why mail can't be delivered to my address unless your server is blocked by one of my RBL's, or strict RFC SMTP checking is killing delivery.  If it's an RBL blocking you should receive a notification explaining which RBL blocked your email.  My email isn't handled by Google, I run my own Postfix based server.

2) Memory issues with Linux (and Windows 10) appear to be handled quite nicely.  Memory usage seems to stay around 250MB/450MB, which is quite acceptable, even on a 4GB system (which I don't own anymore, but a friend does {who doesn't do CAD work}).

3) I'm running into other 60.0 release issues, like long (almost 6 minute) difficult startup times under Windows 10 on a 4-core i7 processor SSD based system with 16GB RAM, which I am reporting as a different bug.

I switched all my systems over 60.0 release as I change seats.  This should be taken as an indicator of how performance compares to prior Thunderbird releases... like highly desirable even with the current batch of new issues.

The only hard to accept new behavior is significantly long indexing/load times on large folders (16,000+ messages).  This is understandable and still much preferred mailtool behavior to the earlier memory hogging behavior.  Multi-threading doesn't appear to be optimized as all 8-cores go to 100% and the Linux system becomes much less responsive when I hit one of these large folders, and the Thunderbird application gray's out when Thunderbird 60.0 stops responding to system events.  So a different threading strategy leaving the application UI responsive to system events might keep the system UI more usable to users without extending large folder load times too significantly.

Summary: good work!  And there are still a few more significant "opportunities".

Comment 44

[Phoenix]

Resolved per Comment 43

Comment 45

[Wayne Mery (:wsmwk)]

I cannot explain the improvement between version 57 (beta) and version 60, but it's good to hear that it has improved for you.
And to recap previous info, your folders are large, but not excessively that would explain the high memory usage.

It is curious that the reporter of bug 1322233,  also linux and also dovecot server, reports improvement in version 52, vs your improvement doesn't come  until after version 57.  He had server side filters and only one account. I don't recall you saying you had server side filters.


(In reply to Craig Arno from comment #43)
> ...
> 3) I'm running into other 60.0 release issues, like long (almost 6 minute)
> difficult startup times under Windows 10 on a 4-core i7 processor SSD based
> system with 16GB RAM, which I am reporting as a different bug.

Before filing bug report about performance on windows please see https://wiki.mozilla.org/Thunderbird:Testing:Memory_Usage_Problems

Comment 46

[Craig Arno]

(In reply to Wayne Mery (:wsmwk) from comment #45)
> I cannot explain the improvement between version 57 (beta) and version 60,
> but it's good to hear that it has improved for you.
> And to recap previous info, your folders are large, but not excessively that
> would explain the high memory usage.

I didn't check v52.  You asked me to check v60, so that's what I checked and commented on this time in Ubuntu 16.04 and Windows 10.  Improvement may have been in v52, I just didn't look for it.  Any of these checks take a fair amount of my time and critical thinking to perform.  I try to limit the impact on my time.  v60 is much improved and the latest, so I went with that, and it is much improved over what I was seeing in prior responses.  I don't check every release version.

 
> It is curious that the reporter of bug 1322233,  also linux and also dovecot
> server, reports improvement in version 52, vs your improvement doesn't come 
> until after version 57.  He had server side filters and only one account. I
> don't recall you saying you had server side filters.

I have a lot of different accounts, my primary one local to my server with 3 layers of incoming filters, and outbound SMTP forwarding through my ISP's proxy.  Local outbound Postfix (SMTP port 25) is both deliberately unconfigured and blocked due to too many efforts to abuse my system as a SPAM proxy clogging up my mail queues.  My other accounts are a scattering of another remote Linux system running a different version of Linux, several GMail and Yahoo accounts.  A pretty good mix of everything.  My system and primary email address seems to be a solid target for anyone in the SPAM business.  That is why I opened bug #1485190, even a small percentage is a huge volume of SPAM in my INBOX.  This is also why so much filtering.  500 SPAM's/day means an hour of my life doing nothing but reviewing SPAM, every day, which is unacceptable in a production environment (or any environment).

Glad to see so much improvement in v60 memory handling, comment #43 Item 2).  This is improvement success any way you want to measure.