1425070 - High memory usage due to many anonymous sandboxes on yahoo email

Status: RESOLVED INCOMPLETE

(Web Compatibility :: Site Reports, defect)

Description

[Harry Schweitzer]

User Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:57.0) Gecko/20100101 Firefox/57.0
Build ID: 20171206182557

Steps to reproduce:

Normal processing.  New "faster" release seems slow. 


Actual results:

A scan from my printer was going extremely sloiw so I started the "task manager" on my Windows PC.  It showed high CPU momentarily but it showed extremely high memory usage - 1,718 MB.  All that is open on Firefox is a YAHOO tab, a YAHOO email tab, and the Mozilla website.  The memory seems to continue to increase over time - now at 1,770 MB.  


Expected results:

I don;'t knoiw what the prior release of Firefox used but certainly not 73% of my available memory.

Comment 1

[Andre Klapper]

Please enter the address "about:memory?verbose" (with a lower-case "v") in the address bar and attach (using the "Attach File" link above) the output here.

Comment 2

[Harry Schweitzer]

Attachment: memory-report.json.gz

Comment 3

[Valentina Claudia Ona]

Hi Harry, 
Can you please capture a performance profile? You can get more info about how to install and use the Cleopatra add-on (that helps you get the performance profile) by going to:
https://developer.mozilla.org/en-US/docs/Mozilla/Performance/Profiling_with_the_Built-in_Profiler

Comment 4

[Bob Owen (:bobowen)]

I don't think this is the correct component.
It appears Firefox's memory usage was causing a problem with a scan on a multi-functional printer, but it's not a Firefox 
printing problem. My suspicion is that the latest Firefox isn't playing nicely with Yahoo email and causing the high memory usage.

It should be a general memory component if we have one or something even more general.

Comment 5

[Harry Schweitzer]

URL for performance profile output is https://perfht.ml/2BtYBdt

Comment 6

[Harry Schweitzer]

I ran the profile with only one tab open - yahoo.com as memory was approaching 1 GB.

Comment 7

[Valentina Claudia Ona]

thanks for your help!

Comment 8

[Julien Wajsberg [:julienw] (PTO -> Aug 14)]

Not a devtools issue for sure. Let's redirect to a general component until it's clearer.

Comment 9

[Eric Rahm [:erahm]]

Pretty sure this is web extension related, there are a ton of anonymous sandboxes for the ads. Can you we get a list of addons in use? Can you reproduce in safe mode?

> 1,113.94 MB (100.0%) -- explicit
> ├────433.88 MB (38.95%) -- js-non-window
> │    ├──338.70 MB (30.41%) -- zones
> │    │  ├──221.89 MB (19.92%) -- zone(0x1bb6827a000)
> │    │  │  ├──119.54 MB (10.73%) -- (37 tiny)
> │    │  │  │  ├────8.60 MB (00.77%) ++ compartment([Expanded Principal [https://us-mg5.mail.yahoo.com/neo/launch?.partner=sbc&.rand=8en3qsslf5s5e#mail, moz-extension://5230bb15-0a34-4f25-8db6-f2843a455ca6/]], [anonymous sandbox] (from: resource://gre/modules/ExtensionContent.jsm:442))
> │    │  │  │  ├────7.29 MB (00.65%) ++ compartment([Expanded Principal [https://ads.pubmatic.com/AdServer/js/showad.js#PIX&kdntuid=1&SPug=true&p=133799&s=133800&predirect=https%3A%2F%2Fpr-bh.ybp.yahoo.com%2Fsync%2Fpubmatic%2F&it=0&np=0, moz-extension://5230bb15-0a34-4f25-8db6-f2843a455ca6/]], [anonymous sandbox] (from: resource://gre/modules/ExtensionContent.jsm:442))
> │    │  │  │  ├────7.29 MB (00.65%) ++ compartment([Expanded Principal [https://us-mg5.mail.yahoo.com/neo/darla/php/fc.php?trace=msgread_tabview&tID=100&d=0&f=978556302&l=LREC%2CTL1%2CLREC4&rn=1513268205904&en=utf-8&lang=en-US&filter=no_expandable%253Bexp_iframe_expandable%253B&ref=https%253A//us-mg5.mail.yahoo.com/neo/launch&secure=true&tgt=_blank&sa=uctopid%253D%2522%2522%2520uccc%253D%2522Inbox%253Btheme-blue%2522%2520MON%253D%2522300x250%253B300x600%2522%2520LREC%253D%2522300x250%2522%2520secure%253D1%2520resln%253D2400x1184%2520, moz-extension://5230bb15-0a34-4f25-8db6-f2843a455ca6/]], [anonymous sandbox] (from: resource://gre/modules/ExtensionContent.jsm:442))
> │    │  │  │  ├────7.29 MB (00.65%) ++ compartment([Expanded Principal [https://aax-us-east.amazon-adsystem.com/e/is/5fe011609a91fb63958a721da7e9a1dd/impi?b=Iolob-pOR0HRuXLBlq9z9QoAAAFgVdBmiQEAAATiASbvSrI&w=CjjFcbCXUmGnPtZPq_9gUWymrdTYgrylQ15HsG1O3JztGuMFsphwepvnePFpq59o&bi=5HAlZMOY8rH9fppsxIko4QSU2t5v-rgauc8.9azAKpDbWkQ5YaDfYjMt7HE4j6WmgzBCQsTPoUuSQ2Z2ab1BfjJnA61Mg4fkIQznTcssXTslV61jjSB.1MPJldndjq1oxjKkMSSkIpjofRuab4c6Dv5SWtJjkXLI.jlqoTlmIlkPNIVV-qWUwjmevVH5ha7.EvE0za8HsScDqr5KchgSOFK2l4G3lr1lzIJMCmBs9bdP8n2d4vIV1FfnIrUPgrVa1TXAoFk8JAEYSvfTJmJfyRAtDq2pTdAcoCMnKwliFXG8s3QKvXMM.S1VSYIyTfQK7T.UwVUMeo-uIOrGHYBIFNKhxU105gPBfQfJwgn91IUeug6AIvIFvMgU2erFgFsBHstJ6SwCxSY.UY8Fc1Pf6-d4szEHUXCG1AVzvMrvXJhtKcSaRIZPqq8kTVYKpmveLwWOXBu7KxYVxM.yOv7X9NkYXjzod8tIh1Tev7ZrUZUuWP20BxcipKey4Iyl46dwgLtqmdRKestY8KSsulWb1P.nx0s2KcKeku302z5k4wU_, moz-extension://5230bb15-0a34-4f25-8db6-f2843a455ca6/]], [anonymous sandbox] (from: resource://gre/modules/ExtensionContent.jsm:442))
> │    │  │  │  ├────7.27 MB (00.65%) ++ compartment([Expanded Principal [https://s.yimg.com/rq/darla/3-0-8/html/r-csc.html, moz-extension://5230bb15-0a34-4f25-8db6-f2843a455ca6/]], [anonymous sandbox] (from: resource://gre/modules/ExtensionContent.jsm:442))
> │    │  │  │  ├────7.27 MB (00.65%) ++ compartment([Expanded Principal [https://googleads.g.doubleclick.net/pagead/ads?client=ca-pub-5786243031610172&output=html&h=250&slotname=9087896442&adk=1009400333&adf=2170632797&w=300&loeid=38893312%2C368226211&format=300x250&url=https%3A%2F%2Fmail.yahoo.com&ea=0&flash=0&contents=Yahoo%20Mail&hl=en&avail_w=0&wgl=1&adsid=NT&dt=1513268208416&bpp=10&bdt=2110&fdt=81&idt=194&shv=r20171206&cbv=r20170110&saldr=aa&correlator=3153751740914&frm=24&ga_vid=1536653170.1494852143&ga_sid=1513268209&ga_hid=404539838&ga_fc=0&pv=2&icsg=2&nhd=2&dssz=2&mdo=33554432&mso=0&u_tz=-300&u_his=18&u_java=0&u_h=1350&u_w=2400&u_ah=1300&u_aw=2400&u_cd=24&u_nplug=0&u_nmime=0&adx=0&ady=0&biw=-12245933&bih=-12245933&isw=0&ish=0&ifk=2917681579&eid=21061122%2C38893302%2C191880502%2C368226201&oid=3&nmo=1&zm=Infi&loc=https%3A%2F%2Fus-mg5.mail.yahoo.com%2Fneo%2Flaunch%3F.partner%3Dsbc%26.rand%3D8en3qsslf5s5e%23mail&rx=0&eae=2&brdim=%2C%2C-8%2C-8%2C2400%2C0%2C1936%2C1056%2C0%2C0&vis=1&rsz=%7C%7Cc%7C&abl=NS&ppjl=f&pfx=0&fu=16&bc=1&jar=2017-12-13-18&ifi=1&dtd=223, moz-extension://5230bb15-0a34-4f25-8db6-f2843a455ca6/]], [anonymous sandbox] (from: resource://gre/modules/ExtensionContent.jsm:442))
> │    │  │  │  ├────7.26 MB (00.65%) ++ compartment([Expanded Principal [https://ads.pubmatic.com/AdServer/js/user_sync.html?p=133799&s=133800&predirect=https%3A%2F%2Fpr-bh.ybp.yahoo.com%2Fsync%2Fpubmatic%2F, moz-extension://5230bb15-0a34-4f25-8db6-f2843a455ca6/]], [anonymous sandbox] (from: resource://gre/modules/ExtensionContent.jsm:442))
> │    │  │  │  ├────7.26 MB (00.65%) ++ compartment([Expanded Principal [https://s.yimg.com/dh/ap/ssp_cookie_sync/us2.html, moz-extension://5230bb15-0a34-4f25-8db6-f2843a455ca6/]], [anonymous sandbox] (from: resource://gre/modules/ExtensionContent.jsm:442))
> │    │  │  │  ├────7.01 MB (00.63%) ++ compartment([Expanded Principal [https://secure-ds.serving-sys.com/BurstingRes/Site-37572/WSFolders/11138244_2//K83632_LDA_DSE17_Memories_300x250.html?v=_2_92_1_0&n=1&r=_1_45_0_0&clickTa

Comment 10

[Kris Maglione [:kmag]]

Yeah, those sandboxes are pretty out of control. Most of them are from the same add-on, and are tens of megabytes each. (Though the memory usage of Yahoo window itself is almost 400MB, which isn't great either...)

This is most likely an issue with the add-on itself, though, rather than anything in the browser.

The data from about:support would be helpful in tracking down the details.

Comment 11

[Harry Schweitzer]

I uninstalled Firefox and reinstalled it using Microsoft Edge.  Current memory usage is lower, around 800 - 900 MB.  Currently there are no addons.  Extensions are 1) Dashlane and 2 ) Yahoo Homepage.  Plugins are 1) OpenH264 Video Codec 2) Widevine Content Decryption Module provided by Google.

Comment 12

[Kris Maglione [:kmag]]

My guess is that this is caused by Dashlane, based on our experience in bug 1369274.

Comment 13

[Eric Rahm [:erahm]]

Sounds like an addon problem, clearing MemShrink for now.

Comment 14

[Harry Schweitzer]

Has anyone any suggestions on how to solve this?  Today I started Firefox with only the Yahoo.com homepage.  In less than 20 seconds the storage rose to over 1 GB.  It dropped down to 850 MB.  When I started a second tab for yahoo email the storage rose to 1.4 - 1.6 GB.  After I opened this window to update the issue it rose to 2 GB. I don't know what is the cause of the storage, but, as you can imagine, continuously adding and releasing large amounts of storage make Firefox run extremely slow.  At times I cannot get the Task Manager to start for many minutes because of everything that Firefox is doing.

Comment 15

[Rob Wu [:robwu]]

The lot of anonymous sandbox leaks was likely caused by bug 1459404, which was fixed in Firefox 62.

Is this bug still reproducible?

Comment 16

[Harry Schweitzer]

I guess so. I just started Firefox with task manager running. In about 10-15 seconds storage rose to 700-800 MB with only yahoo homepage running. After a few minutes with yahoo homepage, yahoo email, and bugzilla running storage is 1.2 GB. At one point it peaked at 1.5 GB.

Comment 17

[Harry Schweitzer]

Regarding the initial reporting of the problem during a scan of the printer, the scan obviously had nothing to do with the problem.

Comment 18

[Rob Wu [:robwu]]

Could you provide a performance profile? And if your list of add-ons has changed compared to before, also provide a list of add-ons.

To check which add-on might be responsible for the leak, check whether your issue also occurs if you disable some (or all) of your add-ons. E.g. run Firefox with Dashlane only, and also run Firefox with Yahoo Homepage (the add-on) only.

Comment 19

[Harry Schweitzer]

http://bit.ly/2E4mDxh

Addons are:
Dashlane
Eno from Capital One
Norton Safe Search
Norton Safe Web
Gecko Profiler

Comment 20

[Rob Wu [:robwu]]

The performance profile shows that Dashlane is doing lots of work, but it doesn't appear to be using 100% of the CPU.

Does the issue still occur if you disable Dashlane? If not, can you disable your add-ons one by one until you see a change in behavior?

And please generate a verbose memory report at about:memory and attach it to this bug.

Comment 21

[David Durst [:ddurst]]

Closing. Please reopen if necessary.

Comment 22

[Harry Schweitzer]

Attachment: memory-report.json.gz

here is the about memory verbose

Comment 23

[Harry Schweitzer]

about memory executed

Comment 24

[Kris Maglione [:kmag]]

(In reply to Harry Schweitzer from comment #22)

Created attachment 9055225 [details]
memory-report.json.gz

here is the about memory verbose

By far the biggest chunk of memory in this report is yimg.com workers, which is almost certainly caused by the website itself.

Comment 25

[Eric Rahm [:erahm]]

22% of the memory is sitting in unused-gc-things which is some pretty impressive fragmentation. Another 8% is in tons of copies of strings:

1,200.57 MB (100.0%) -- explicit
├────785.72 MB (65.45%) -- workers/workers(yimg.com)
│    ├──393.26 MB (32.76%) -- worker(blob:https://s.yimg.com/da3b88c9-56a8-4be5-a980-a215943064f0, 0x225b5a2a800)
│    │  ├──381.21 MB (31.75%) -- zone(0x225dba47000)
│    │  │  ├──194.60 MB (16.21%) ++ realm(web-worker)
│    │  │  ├──131.99 MB (10.99%) ── unused-gc-things
│    │  │  ├───50.17 MB (04.18%) -- strings
│    │  │  │   ├──37.72 MB (03.14%) ++ (34 tiny)
│    │  │  │   └──12.45 MB (01.04%) ++ string(length=36, copies=181370, "5b02b335-bf93-c419-2365-2b7d3f860e01")
│    │  │  └────4.45 MB (00.37%) ++ (12 tiny)
│    │  └───12.05 MB (01.00%) ++ (3 tiny)
│    └──392.46 MB (32.69%) -- worker(blob:https://s.yimg.com/f6c99912-2760-47c2-af44-a477f4281c12, 0x225c7839000)
│       ├──381.70 MB (31.79%) -- zone(0x225b47cb000)
│       │  ├──194.93 MB (16.24%) ++ realm(web-worker)
│       │  ├──131.99 MB (10.99%) ── unused-gc-things
│       │  ├───50.32 MB (04.19%) -- strings
│       │  │   ├──37.85 MB (03.15%) ++ (34 tiny)
│       │  │   └──12.47 MB (01.04%) ++ string(length=36, copies=181606, "07df8262-cedd-2400-e946-ca7ddb40bc9e")
│       │  └────4.45 MB (00.37%) ++ (11 tiny)
│       └───10.76 MB (00.90%) ++ (3 tiny)

I wonder if this is another worker-gc isn't doing its best type issue.

Comment 26

[Harry Schweitzer]

Attachment: memory-report.json.gz

This is an above:memory?verbose with memory at 1.3 GB. Only tabs open are Yahoo homepage and yahoo mail.

Comment 27

[Harry Schweitzer]

Attachment: memory-report2.json

about:memory?verbose where memory has risen to 1.9 GB with only yahoo homepage and yahoo mail tabs open.

Comment 28

[Kris Maglione [:kmag]]

(In reply to Harry Schweitzer from comment #27)

Created attachment 9055454 [details]
memory-report2.json

about:memory?verbose where memory has risen to 1.9 GB with only yahoo homepage and yahoo mail tabs open.

The worker and content window are still the biggest chunks of this.

There are a ton of content scripts that several of your add-ons seem to inject into every iframe, but in your last report they only add up to 20MB, and in the one before that, they only added up to 50MB. That's not ideal, and I wish they didn't indiscriminately inject so many large content scripts, but they're also clearly not the main problem.

And Dashlane, alas, uses well over 100MB in its background page for... whatever. Which is, again, unfortunate, but also not the major problem.

This really seems to be mostly an issue with Yahoo Mail.