842962 - High resource consumption (ram/memory + pixmaps) when scrolling large pdf

Status: RESOLVED FIXED

(Firefox :: PDF Viewer, defect, P3)

Description

[Clemens Eisserer]

Attachment: friefox_resource_useage.png

User Agent: Mozilla/5.0 (X11; Linux x86_64; rv:19.0) Gecko/20100101 Firefox/19.0
Build ID: 20130215130331

Steps to reproduce:

Loaded the PDF located at http://93.83.133.214/thesis_eissererc_20130220.pdf and scrolled up&down fast


Actual results:

Beside many rendering issues, I saw a very high resource consumption, as illustrated by the screenshot. Firefox consumed 1.4GB RSS and allocated 36k pixmaps with 477MB in total size.


Expected results:

more efficient resource management

Comment 1

[Wayne Mery (:wsmwk)]

confirm high memory usage.

I could see this OOMing on a 32 bit build with some other heavy tab load.

On 64bit windows build, increase +100MB while downloading. And then when rendering shot up another +400MB.  After idling it dropped 100MB, sitting at +400MB. Next, some scrolling shoots it up another 300MB, putting Ffox  working set briefly over 2GB

Comment 2

[Virtual_ManPL [:Virtual] 🇵🇱 - (please needinfo? me - so I will see your comment/reply/question/etc.)]

Can you still reproduce it?

Comment 3

[Clemens Eisserer]

Yes, scrolling the linked document up & down leads to > 950mb of X11 pixmaps (video memory!) allocated, please see the new screenshot.

Comment 4

[Clemens Eisserer]

Attachment: firefox_ressource_consumption.png

screenshot of xrestop with FF31

Comment 5

[Nicholas Nethercote [inactive]]

I just tried this with a trunk version of pdf.js on my Linux machine. Scrolling fairly quickly through the whole document, speed was pretty good, RSS peaked at 393 MiB, and I didn't see pixmaps go above 60,000 KB.

I bet the improvements I wrote about in https://blog.mozilla.org/nnethercote/2014/06/16/an-even-slimmer-pdf-js/ have helped this. They will be in Firefox 33.

Comment 6

[Nicholas Nethercote [inactive]]

> I bet the improvements I wrote about in https://blog.mozilla.org/nnethercote/2014/06/16/an-even-slimmer-pdf-js/ have helped this. They will be in Firefox 33.

Clemens, if you're willing to try an Aurora build (at aurora.mozilla.org) you'll be able to see if the improvement has occurred.

Comment 7

[Clemens Eisserer]

The pixmap issue has improved a lot with Aurora, it stays at around 60mb.
However scolling like mad still causes firefox to consume 1GB RSS (granted, this is not a normal use case - but to some degree occurs when people search manually for something in large PDFs).

Comment 8

[Nicholas Nethercote [inactive]]

Thanks for the update, Clemens. I'll claim that this bug was about the pixmap issue, and mark it as fixed. There's a pre-existing GitHub issue (https://github.com/mozilla/pdf.js/issues/1887) that covers the "scrolling like mad" case.