1229294 - High CPU-Load while downloading messages

Status: RESOLVED INCOMPLETE

(Thunderbird :: Untriaged, defect)

Description

[[e-mail]]

User Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/46.0.2486.0 Safari/537.36

Steps to reproduce:

Start thunderbird, then "Get all new messages"

This problem seems to exist with stable versions too.


  Application Basics

    Name: Thunderbird
    Version: 45.0a1
    User Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:45.0) Gecko/20100101 Thunderbird/45.0a1
    Profile Folder: Show Folder

              (Local drive)
    Application Build ID: 20151127030224
    Enabled Plugins: about:plugins
    Build Configuration: about:buildconfig
    Memory Use: about:memory

  Mail and News Accounts
    account1:
      INCOMING: account1, , (imap) mail-muc.bfs.de:993, SSL, passwordCleartext
      OUTGOING: , mail-muc.bfs.de:465, SSL, none, true

    account2:
      INCOMING: account2, , (none) Local Folders, plain, passwordCleartext

    account3:
      INCOMING: account3, , (rss) Feeds, plain, passwordCleartext

    account4:
      INCOMING: account4, , (im) prpl-facebook, plain, 0

    account5:
      INCOMING: account5, , (im) prpl-gtalk, plain, 0

    account6:
      INCOMING: account6, , (nntp) news.individual.de:563, SSL, passwordCleartext
      OUTGOING: , mail-muc.bfs.de:465, SSL, none, true

    account8:
      INCOMING: account8, , (im) prpl-jabber, plain, 0

  Crash Reports
    http://crash-stats.mozilla.com/report/index/bp-9ad7580f-79c9-4e57-b05f-12b8f2151106 (06.11.2015)
    http://crash-stats.mozilla.com/report/index/bp-c6f4a9da-68a4-45b2-94b2-1584c2150817 (17.08.2015)
    http://crash-stats.mozilla.com/report/index/bp-8a1f385b-9d52-43c4-baf3-563922150728 (28.07.2015)
    http://crash-stats.mozilla.com/report/index/bp-03d91947-1885-4e8b-b7a3-3a5f92150720 (20.07.2015)
    http://crash-stats.mozilla.com/report/index/bp-8c1549d4-d99a-4a48-a714-f0b572150610 (10.06.2015)

  Extensions
    .vcs Support, 0.6.4, true, {efcbec50-6821-11db-bd13-0800200c9a66}
    Adblock Plus, 2.6.13, true, {d10d0bf8-f5b5-c8b4-a8b2-2b9879e08c5d}
    Auto Resize Image, 0.13.7, true, [e-mail]
    Display Quota, 0.3.7, true, {c1ac4523-76c2-9995-adbd-d93bf5141bea}
    Dropbox for Filelink, 1.0.1, true, [e-mail]
    Enigmail, 1.9a1pre, true, {847b3a00-7ab1-11d4-8f02-006008948af5}
    Extension List Dumper, 1.15.2.1-signed, true, [e-mail]
    FiltaQuilla, 1.3.1, true, [e-mail]
    FoxClocks, 4.1.4, true, {d37dc5d0-431d-44e5-8c91-49419370caa1}
    Gantt View, 1.0.0.4, true, {1510928E-A4FA-43C2-A9AF-99E521B90BC5}
    Launchy, 4.4.0.1-signed, true, [e-mail]
    Lightning, 4.7a1, true, {e2fda1a4-762b-4020-b5ad-a41df1933103}
    LookOut, 1.2.13, true, [e-mail]
    Mail Redirect, 0.8.7, true, {CC3C233D-6668-41bc-AAEB-F3A1D1D594F5}
    Mark All Read Button, 0.7.1, true, {DA506923-55C4-4fbe-9E4C-D24B80D7DE9F}
    ownCloud for Filelink, 1.3, true, [e-mail]
    Provider for Google Calendar, 2.6a1, true, {a62ef8ec-5fdc-40c2-873c-223b8a6925cc}
    Quick Locale Switcher, 1.7.8.5.1-signed, true, {25A1388B-6B18-46c3-BEBA-A81915D0DE8F}
    Remove Duplicate Messages (Alternate), 0.3.12, true, {a300a000-5e21-4ee0-a115-9ec8f4eaa92b}
    Sieve, 0.2.2, true, [e-mail]
    SQLite Manager, 0.8.3.1-signed, true, [e-mail]
    Thunderbird Chat Notification, 1.3.0, true, [e-mail]
    WebDAV for Filelink, 1.5, true, [e-mail]
    Account Colors, 9.1, false, accountcolors@DW-dev
    Before Tabs Toolbar, 1.5, false, [e-mail]
    Colored Diffs, 0.6.2012.01.27.14.07.45, false, {282C3C7A-15A8-4037-A30D-BBEB17FFC76B}
    Icelandic Dictionary, 1.3, false, [e-mail]
    Mnenhy, 0.8.6.1-signed, false, {bf591015-b599-4125-9428-3cb746ddca31}

  Important Modified Preferences

    Name: Value

      accessibility.typeaheadfind.flashBar: 0
      browser.cache.disk.capacity: 358400
      browser.cache.disk.filesystem_reported: 1
      browser.cache.disk.smart_size_cached_value: 358400
      browser.cache.disk.smart_size.first_run: false
      browser.cache.disk.smart_size.use_old_max: false
      dom.apps.reset-permissions: true
      dom.max_chrome_script_run_time: 0
      dom.mozApps.used: true
      dom.w3c_touch_events.expose: false
      extensions.lastAppVersion: 45.0a1
      font.internaluseonly.changed: true
      font.name.monospace.el: Consolas
      font.name.monospace.tr: Consolas
      font.name.monospace.x-baltic: Consolas
      font.name.monospace.x-central-euro: Consolas
      font.name.monospace.x-cyrillic: Consolas
      font.name.monospace.x-unicode: Consolas
      font.name.monospace.x-western: Consolas
      font.name.sans-serif.el: Calibri
      font.name.sans-serif.tr: Calibri
      font.name.sans-serif.x-baltic: Calibri
      font.name.sans-serif.x-central-euro: Calibri
      font.name.sans-serif.x-cyrillic: Calibri
      font.name.sans-serif.x-unicode: Calibri
      font.name.sans-serif.x-western: Calibri
      font.name.serif.el: Cambria
      font.name.serif.tr: Cambria
      font.name.serif.x-baltic: Cambria
      font.name.serif.x-central-euro: Cambria
      font.name.serif.x-cyrillic: Cambria
      font.name.serif.x-unicode: Cambria
      font.name.serif.x-western: Cambria
      font.size.fixed.el: 14
      font.size.fixed.tr: 14
      font.size.fixed.x-baltic: 14
      font.size.fixed.x-central-euro: 14
      font.size.fixed.x-cyrillic: 14
      font.size.fixed.x-unicode: 14
      font.size.fixed.x-western: 14
      font.size.variable.el: 17
      font.size.variable.tr: 17
      font.size.variable.x-baltic: 17
      font.size.variable.x-central-euro: 17
      font.size.variable.x-cyrillic: 17
      font.size.variable.x-unicode: 17
      font.size.variable.x-western: 17
      general.useragent.extra.mnenhy: Mnenhy/0.8.6
      gfx.driver-init.appVersion: 42.0a1
      gfx.driver-init.deviceID: 0x0405
      gfx.driver-init.driverVersion: 8.14.1.51
      gfx.driver-init.feature-d2d: false
      gfx.driver-init.feature-d3d11: false
      gfx.driver-init.status: 2
      mail.openMessageBehavior.version: 1
      mail.winsearch.firstRunDone: true
      mailnews.database.global.datastore.id: d9f63304-88af-4875-bfb2-a2b1877a438
      network.automatic-ntlm-auth.allow-non-fqdn: true
      network.automatic-ntlm-auth.trusted-uris: <local>,bfs.de,10.*.*.*
      network.cookie.prefsMigrated: true
      network.negotiate-auth.delegation-uris: bfs.de
      network.negotiate-auth.trusted-uris: bfs.de
      network.ntlm.send-lm-response: true
      network.predictor.cleaned-up: true
      places.database.lastMaintenance: 1358927865
      places.history.expiration.transient_current_max_pages: 104858
      plugin.disable_full_page_plugin_for_types: application/pdf
      plugin.importedState: true
      plugin.state.flash: 0
      plugin.state.npctrl: 0
      plugin.state.npdeployjava: 0
      print.printer_\\ps-muc\dru-muc-e017.print_bgcolor: false
      print.printer_\\ps-muc\dru-muc-e017.print_bgimages: false
      print.printer_\\ps-muc\dru-muc-e017.print_colorspace:
      print.printer_\\ps-muc\dru-muc-e017.print_command:
      print.printer_\\ps-muc\dru-muc-e017.print_downloadfonts: false
      print.printer_\\ps-muc\dru-muc-e017.print_duplex: -811995822
      print.printer_\\ps-muc\dru-muc-e017.print_edge_bottom: 0
      print.printer_\\ps-muc\dru-muc-e017.print_edge_left: 0
      print.printer_\\ps-muc\dru-muc-e017.print_edge_right: 0
      print.printer_\\ps-muc\dru-muc-e017.print_edge_top: 0
      print.printer_\\ps-muc\dru-muc-e017.print_evenpages: true
      print.printer_\\ps-muc\dru-muc-e017.print_footercenter:
      print.printer_\\ps-muc\dru-muc-e017.print_footerleft: &PT
      print.printer_\\ps-muc\dru-muc-e017.print_footerright: &D
      print.printer_\\ps-muc\dru-muc-e017.print_headercenter:
      print.printer_\\ps-muc\dru-muc-e017.print_headerleft: &T
      print.printer_\\ps-muc\dru-muc-e017.print_headerright: &U
      print.printer_\\ps-muc\dru-muc-e017.print_in_color: true
      print.printer_\\ps-muc\dru-muc-e017.print_margin_bottom: 0.5
      print.printer_\\ps-muc\dru-muc-e017.print_margin_left: 0.5
      print.printer_\\ps-muc\dru-muc-e017.print_margin_right: 0.5
      print.printer_\\ps-muc\dru-muc-e017.print_margin_top: 0.5
      print.printer_\\ps-muc\dru-muc-e017.print_oddpages: true
      print.printer_\\ps-muc\dru-muc-e017.print_orientation: 0
      print.printer_\\ps-muc\dru-muc-e017.print_page_delay: 50
      print.printer_\\ps-muc\dru-muc-e017.print_paper_data: 9
      print.printer_\\ps-muc\dru-muc-e017.print_paper_height: 11,00
      print.printer_\\ps-muc\dru-muc-e017.print_paper_name:
      print.printer_\\ps-muc\dru-muc-e017.print_paper_size_type: 0
      print.printer_\\ps-muc\dru-muc-e017.print_paper_size_unit: 1
      print.printer_\\ps-muc\dru-muc-e017.print_paper_width: 8,50
      print.printer_\\ps-muc\dru-muc-e017.print_plex_name:
      print.printer_\\ps-muc\dru-muc-e017.print_resolution: 121512960
      print.printer_\\ps-muc\dru-muc-e017.print_resolution_name:
      print.printer_\\ps-muc\dru-muc-e017.print_reversed: false
      print.printer_\\ps-muc\dru-muc-e017.print_scaling: 1,00
      print.printer_\\ps-muc\dru-muc-e017.print_shrink_to_fit: true
      print.printer_\\ps-muc\dru-muc-e017.print_to_file: false
      print.printer_\\ps-muc\dru-muc-e017.print_unwriteable_margin_bottom: 0
      print.printer_\\ps-muc\dru-muc-e017.print_unwriteable_margin_left: 0
      print.printer_\\ps-muc\dru-muc-e017.print_unwriteable_margin_right: 0
      print.printer_\\ps-muc\dru-muc-e017.print_unwriteable_margin_top: 0
      print.printer_dru-muc-e017_(PCL).print_bgcolor: false
      print.printer_dru-muc-e017_(PCL).print_bgimages: false
      print.printer_dru-muc-e017_(PCL).print_colorspace:
      print.printer_dru-muc-e017_(PCL).print_command:
      print.printer_dru-muc-e017_(PCL).print_downloadfonts: false
      print.printer_dru-muc-e017_(PCL).print_duplex: 1515870810
      print.printer_dru-muc-e017_(PCL).print_edge_bottom: 0
      print.printer_dru-muc-e017_(PCL).print_edge_left: 0
      print.printer_dru-muc-e017_(PCL).print_edge_right: 0
      print.printer_dru-muc-e017_(PCL).print_edge_top: 0
      print.printer_dru-muc-e017_(PCL).print_evenpages: true
      print.printer_dru-muc-e017_(PCL).print_footercenter:
      print.printer_dru-muc-e017_(PCL).print_footerleft: &PT
      print.printer_dru-muc-e017_(PCL).print_footerright: &D
      print.printer_dru-muc-e017_(PCL).print_headercenter:
      print.printer_dru-muc-e017_(PCL).print_headerleft: &T
      print.printer_dru-muc-e017_(PCL).print_headerright: &U
      print.printer_dru-muc-e017_(PCL).print_in_color: true
      print.printer_dru-muc-e017_(PCL).print_margin_bottom: 0.5
      print.printer_dru-muc-e017_(PCL).print_margin_left: 0.5
      print.printer_dru-muc-e017_(PCL).print_margin_right: 0.5
      print.printer_dru-muc-e017_(PCL).print_margin_top: 0.5
      print.printer_dru-muc-e017_(PCL).print_oddpages: true
      print.printer_dru-muc-e017_(PCL).print_orientation: 0
      print.printer_dru-muc-e017_(PCL).print_page_delay: 50
      print.printer_dru-muc-e017_(PCL).print_paper_data: 9
      print.printer_dru-muc-e017_(PCL).print_paper_height: 11,00
      print.printer_dru-muc-e017_(PCL).print_paper_name:
      print.printer_dru-muc-e017_(PCL).print_paper_size_type: 0
      print.printer_dru-muc-e017_(PCL).print_paper_size_unit: 1
      print.printer_dru-muc-e017_(PCL).print_paper_width: 8,50
      print.printer_dru-muc-e017_(PCL).print_plex_name:
      print.printer_dru-muc-e017_(PCL).print_resolution: 1515870810
      print.printer_dru-muc-e017_(PCL).print_resolution_name:
      print.printer_dru-muc-e017_(PCL).print_reversed: false
      print.printer_dru-muc-e017_(PCL).print_scaling: 1,00
      print.printer_dru-muc-e017_(PCL).print_shrink_to_fit: true
      print.printer_dru-muc-e017_(PCL).print_to_file: false
      print.printer_dru-muc-e017_(PCL).print_unwriteable_margin_bottom: 0
      print.printer_dru-muc-e017_(PCL).print_unwriteable_margin_left: 0
      print.printer_dru-muc-e017_(PCL).print_unwriteable_margin_right: 0
      print.printer_dru-muc-e017_(PCL).print_unwriteable_margin_top: 0
      print.printer_FreePDF.print_bgcolor: false
      print.printer_FreePDF.print_bgimages: false
      print.printer_FreePDF.print_colorspace:
      print.printer_FreePDF.print_command:
      print.printer_FreePDF.print_downloadfonts: false
      print.printer_FreePDF.print_duplex: 1515870810
      print.printer_FreePDF.print_edge_bottom: 0
      print.printer_FreePDF.print_edge_left: 0
      print.printer_FreePDF.print_edge_right: 0
      print.printer_FreePDF.print_edge_top: 0
      print.printer_FreePDF.print_evenpages: true
      print.printer_FreePDF.print_footercenter:
      print.printer_FreePDF.print_footerleft: &PT
      print.printer_FreePDF.print_footerright: &D
      print.printer_FreePDF.print_headercenter:
      print.printer_FreePDF.print_headerleft: &T
      print.printer_FreePDF.print_headerright: &U
      print.printer_FreePDF.print_in_color: true
      print.printer_FreePDF.print_margin_bottom: 0.5
      print.printer_FreePDF.print_margin_left: 0.5
      print.printer_FreePDF.print_margin_right: 0.5
      print.printer_FreePDF.print_margin_top: 0.5
      print.printer_FreePDF.print_oddpages: true
      print.printer_FreePDF.print_orientation: 0
      print.printer_FreePDF.print_page_delay: 50
      print.printer_FreePDF.print_paper_data: 9
      print.printer_FreePDF.print_paper_height: 11,00
      print.printer_FreePDF.print_paper_name:
      print.printer_FreePDF.print_paper_size_type: 0
      print.printer_FreePDF.print_paper_size_unit: 1
      print.printer_FreePDF.print_paper_width: 8,50
      print.printer_FreePDF.print_plex_name:
      print.printer_FreePDF.print_resolution: 1515870810
      print.printer_FreePDF.print_resolution_name:
      print.printer_FreePDF.print_reversed: false
      print.printer_FreePDF.print_scaling: 1,00
      print.printer_FreePDF.print_shrink_to_fit: true
      print.printer_FreePDF.print_to_file: false
      print.printer_FreePDF.print_unwriteable_margin_bottom: 0
      print.printer_FreePDF.print_unwriteable_margin_left: 0
      print.printer_FreePDF.print_unwriteable_margin_right: 0
      print.printer_FreePDF.print_unwriteable_margin_top: 0
      privacy.donottrackheader.enabled: true
      security.disable_button.openCertManager: false

  Graphics

      Adapter Description: VMware SVGA 3D
      Vendor ID: 0x15ad
      Device ID: 0x0405
      Adapter RAM: 1032
      Adapter Drivers: vm3dum64 vm3dum64_10 vm3dum vm3dum_10
      Driver Version: 8.15.1.32
      Driver Date: 7-15-2015
      Direct2D Enabled: Blocked for your graphics card because of unresolved driver issues.
      DirectWrite Enabled: false (6.2.9200.17461)
      ClearType Parameters: Gamma: 1800 Pixel Structure: R ClearType Level: 100 Enhanced Contrast: 200
      WebGL Renderer: Blocked for your graphics card because of unresolved driver issues.
      GPU Accelerated Windows: 0. Blocked for your graphics card because of unresolved driver issues.

      AzureCanvasBackend: skia
      AzureSkiaAccelerated: 0
      AzureFallbackCanvasBackend: cairo
      AzureContentBackend: cairo

  JavaScript

  Incremental GC: 1

  Accessibility

    Activated: 0
    Prevent Accessibility: 0

  Library Versions

      Expected minimum version
      Version in use

      NSPR
      4.11
      4.11

      NSS
      3.21 Basic ECC
      3.21 Basic ECC

      NSS Util
      3.21
      3.21

      NSS SSL
      3.21 Basic ECC
      3.21 Basic ECC

      NSS S/MIME
      3.21 Basic ECC
      3.21 Basic ECC


Actual results:

CPU load for one core is at 100%, the second core is occupied by gpg with 100% too. Internally thunderbird seems to regenerate indexes for every fetched message creating one task per message. Fetching some messages quickly produces a bunch of re-indexing tasks running concurrently, pushing CPU load to 100%. Some of these tasks are restarted as soon as some of the others notice changes to the index database. This keeps the CPU load high for a longer time, since if for example there are 200 messages fetched, the database is changed, 199 tasks are started again. Next time 198 tasks are started again, then 197. And so on.

What message type is fetched does not really mater: RSS-Feeds, IMAP-Mail, POP3-Mail.


Expected results:

Don't start new tasks if there is already one re-indexing task running.

Comment 1

[Wayne Mery (:wsmwk)]

> Internally thunderbird seems to regenerate indexes for every fetched message creating one task per message. 

Please screen shot this for us.  

Also, there are many questions. Just 3 to start
- About the messages - you do not say *when* you are seeing this and their characteristics. Was it the very first startup of Thunderbird in a new Thunderbird profile? Or is it a recurring issue?  Are these 200 messages typically large?
- Does it also happen with Thunderbird started in safe mode?
- Is Windows Search disabled in Thunderbird  Tools | Options | Advanced | General ?

Comment 2

[Wayne Mery (:wsmwk)]

Thomas seems to be gone