1085143 - old cache does not clear

Status: RESOLVED WORKSFORME

(Core :: Networking: Cache, defect)

Description

[illumilor.e]

User Agent: Mozilla/5.0 (X11; Linux x86_64; rv:32.0) Gecko/20100101 Firefox/32.0
Build ID: 2014092000

Steps to reproduce:

When using firefox, it will favor old cache data over new, so that new cache data is not stored, such as a video that will no longer stay buffered until the old cache is manually removed.

Comment 1

[Nickolay_Ponomarev]

Please provide steps to reproduce. Writing a bug report like this will not lead to a fix. See https://developer.mozilla.org/en-US/docs/Mozilla/QA/Bug_writing_guidelines

Comment 2

[illumilor.e]

What info do you need?

Comment 3

[:Gijs (he/him)]

(In reply to illumilor.e from comment #2)
> What info do you need?

Your report was formulated in very generic terms. It's generally much more helpful to have a concrete case that shows broken behaviour (aka testcase), with clear steps on how to use that testcase, how Firefox behaves on the testcase, and how you think Firefox should behave on the testcase.

Comment 4

[illumilor.e]

Testcase: Using firefox and flash videos
How firefox behaves: It doesn't clear old cache out
How firefox should behave: It should value the newer cache over the old so that flash videos will stay buffered.

Comment 5

[Andre Klapper]

Please provide a *clear* testcase so anyone else could see your problem. 
"Using firefox and flash videos" is not a clear testcase that allowed me to see your problem.
It's up to you to provide a good description, otherwise your issues will not be fixable by anybody else.

Comment 6

[Wayne Mery (:wsmwk)]

illumilor.e, PLEASE STOP ABANDONING YOUR BUG REPORTS.

(my apologies to everyone else for yelling)

Comment 7

[illumilor.e]

I didn't abandon anything. Firefox doesn't seem to empty the flash content out and then the videos stop staying buffered and only by increasing firefox's cache manually or removing manually does it start to work again. I don't know what you want.

Comment 8

[Andre Klapper]

> I don't know what you want.

See comment 5.
Only reopen this ticket after clearly and completely providing the information requested. 
Thank you for your understanding.

Comment 9

[illumilor.e]

I have provided everything asked. Using flash videos until the cache fills up is the only way that I can replicate this, so what more information can I tell you?

Comment 10

[:Gijs (he/him)]

(In reply to illumilor.e from comment #9)
> I have provided everything asked. Using flash videos until the cache fills
> up is the only way that I can replicate this, so what more information can I
> tell you?

Specific steps including URLs and cache sizes, starting from a clean profile. Something like:

1. create a clean firefox profile
2. set the maximum cache size to NNN mb in the preferences
3. restart firefox
4. open website www.example.com
5. wait for the video to be cached completely (bar with color X on the video element to fill up entirely).
6. close the tab with www.example.com (or not? I don't know...)
7. go to site anotherexample.com, click link to "Funny video for Mozilla", wait for the video to be cached completely

Expected: 
it behaves the same as the one on example.com

Actual:
it doesn't, it never gets cached/preloaded

Obviously the steps should be such that you can reproduce by following the steps, which gives us the best chance that we can reproduce by following the steps, too.

Comment 11

[illumilor.e]

Normally this bug only happens after a few days of browsing on my normal profile, so on that profile I increased the cache to several gigabytes and then after that the problem only happened every week or two. The problem of videos not keeping their cache persisted if I closed firefox and reopened it. It went away when I cleared .cache/mozilla/firefox/xxxxx.default/cache2/entries of everything.

I created a clean profile by deleting profiles.ini in .mozilla/firefox. I set the cache to 30MB. I opened firefox. I went to liveleak.com as a test site and clicked a video. One of the videos was 25MB and it never kept its buffer after hitting replay. If I threw in a 29MB file into the cache, then none of the videos keep their buffer after hitting replay and I can see the video file appear in the entries folder and then disappear as they grow in size and hit the cache limit, as firefox decides it cares more for other video files whose tabs I have closed a long time ago than it does for the current one.

Comment 12

[illumilor.e]

It only happens naturally after a week of browsing for me so I don't know how to replicate it quickly on a clean profile other than put something in entries and then notice that firefox refuses to remove it.

Comment 13

[illumilor.e]

Expected:
replaying a video to not loose it's buffer without having to remove cache

Actual:
replaying a video stops keeping buffer until cache is manually removed

Comment 14

[:Gijs (he/him)]

(In reply to illumilor.e from comment #11)
> I created a clean profile by deleting profiles.ini in .mozilla/firefox. I
> set the cache to 30MB. I opened firefox. I went to liveleak.com as a test
> site and clicked a video. One of the videos was 25MB and it never kept its
> buffer after hitting replay. If I threw in a 29MB file into the cache, then
> none of the videos keep their buffer after hitting replay and I can see the
> video file appear in the entries folder and then disappear as they grow in
> size and hit the cache limit, as firefox decides it cares more for other
> video files whose tabs I have closed a long time ago than it does for the
> current one.

I can't reproduce this. On liveleak.com, I see both youtube and "liveleak" video players. Neither seems to ever leave files bigger than ~700k in my cache folder on a clean profile, and pressing 'replay' works.

Can you link to the 25MB video you were using to test?

Comment 15

[illumilor.e]

This one is 17.1 MiB: http://www.liveleak.com/view?i=dfa_1422206496

Comment 16

[illumilor.e]

This is the 25 one that I was using in my test: http://www.liveleak.com/view?i=bed_1421940991

Comment 17

[illumilor.e]

Most of the cached videos should be larger than 700kB though. Even if I have only a single tab open in firefox, I still am seeing dozens of video files in the cache that are still there, and once that folder fills up to the total limit size is when replay stops staying buffered. I assume firefox should start deleting old files to make room for new ones when it becomes full.

Comment 18

[Honza Bambas (:mayhemer)]

ilumilor:

The disk HTTP cache doesn't keep any resource larger than 50MB.  The memory HTTP cache is limited to 5MB per resources.  Caching is dependent on response headers and may not always be obvious to common users what is better to cache and what not.

Also, cache is not obligated to actually cache.

I'm trying to understand your still pretty vague report.  Seems like what you expect is that older cached videos are automatically removed from the cache so that there is a place for a newer one.  This is something we of course do.

What is not clear from your report:
* "it never kept its buffer after hitting replay" - it's not clear what you mean, please be more concrete.  That line of yours may have too many meanings.

* "I threw in a 29MB file into the cache" - also, not sure what exactly that means.


Please provide a list of steps you do (one by one, detailed as for dummies ;)) and what exactly you expect to happen but what actually happens.

Thanks.

Comment 19

[illumilor.e]

* "it never kept its buffer after hitting replay" - it's not clear what you mean, please be more concrete.  That line of yours may have too many meanings.

I replayed the video. It had to reload all of the video data. Normally it does not do this.

* "I threw in a 29MB file into the cache" - also, not sure what exactly that means.

mv ~/.cache/mozilla/firefox/mi14mtfc5.default/cache2/entries/395DDA0D18632DC1B685C14B8AAC967064E13452 ~/.cache/mozilla/firefox/40ilaqpz.default/cache2/entries/

ls -lh|grep 395DDA
-rw------- 1 ill users  29M jan 20 15:09 395DDA0D18632DC1B685C14B8AAC967064E13452

Comment 20

[Honza Bambas (:mayhemer)]

(In reply to illumilor.e from comment #19)
> * "it never kept its buffer after hitting replay" - it's not clear what you
> mean, please be more concrete.  That line of yours may have too many
> meanings.
> 
> I replayed the video. It had to reload all of the video data. Normally it
> does not do this.

Still unclear.  Please say exactly what you've been doing, step by step, what exactly has happened etc...

Comment 21

[illumilor.e]

I just did that. step by step. What is unclear?

Comment 22

[Andre Klapper]

> What is unclear?

See comment 18, last sentence.  If you continue to not be absolutely clear and specific, this report will end up as WORKSFORME as noone can reproduce the problems that you see.

Comment 23

[illumilor.e]

I answered that in comment 19, step by step, specifically and clearly. What part is unclear? Do you not know what replay means? Or reload? Or buffer? You are being unclear about what part you do not understand.

Comment 24

[illumilor.e]

I literally don't know what else I can tell you, or why you are having difficulty understanding. After the video plays, I hit the "X" in the upper right of the video, then a replay icon appears in the middle, then I click that. If it then has to redownload the entire video, then it has lost it's buffer. That only happens when the cache is full. I can literally look into the cache folder, see the video file grow in size as it downloads and then disappear when the cache is full.

Comment 25

[Honza Bambas (:mayhemer)]

(In reply to illumilor.e from comment #24)
> After the video plays, I hit the "X" in the upper
> right of the video, then a replay icon appears in the middle, then I click
> that. If it then has to redownload the entire video, then it has lost it's
> buffer. That only happens when the cache is full. I can literally look into
> the cache folder, see the video file grow in size as it downloads and then
> disappear when the cache is full.

This is the detailed description of the steps.  Thanks.  I'll try to take a look soon.

Comment 28

[Honza Bambas (:mayhemer)]

(In reply to illumilor.e from comment #24)
> I hit the "X" in the upper
> right of the video, 

I don't see it.  Do you have an exact URL where this "X" appears?  None of the URL (comment 15/16) have that.

Comment 29

[Honza Bambas (:mayhemer)]

One more question:
- please go to about:config
- search for browser.cache.frecency_experiment
- tell me the value (should be from 1 to 4 inclusive)

Thanks.

Comment 30

[illumilor.e]

" Do you have an exact URL where this "X" appears?"

It appears in http://www.liveleak.com/view?i=dfa_1422206496 after the video plays as described in comment 24.


user set integer 3

Comment 31

[Honza Bambas (:mayhemer)]

The first request is for URL:

http://edge.liveleak.com/80281E/ll_a_s/2015/Jan/25/LiveLeak-dot-com-dfa_1422206496-SaveDuke-1111_1422206502.mp4.h264_720p.mp4?d5e8cc8eccfb6039332f41f6249e92b06c91b4db65f5e99818bdd5934d42d2d72137&ec_rate=230&ec_seek=0

The second request is for:

http://edge.liveleak.com/80281E/ll_a_s/2015/Jan/25/LiveLeak-dot-com-dfa_1422206496-SaveDuke-1111_1422206502.mp4.h264_720p.mp4?d5e8cc8eccfb6039332f41f6249e92b06c91b4db65f5e99818bdd5934d42d2d72137&ec_rate=230


which is apparently missing the "&ec_seek=0" at the end.  Despite the response is fully cachible, the players asks a different resource from our point of view - hence a new network request.

Contact server admin if you think this is that serious problem.

Comment 32

[illumilor.e]

"the players asks a different resource from our point of view - hence a new network request."

So wouldn't that imply that it would never keep the video cache/buffer when replaying? If it's asking ffor a different resource, then why does it stay in cache when the cache folder is not full?

Comment 33

[Honza Bambas (:mayhemer)]

(In reply to illumilor.e from comment #32)
> "the players asks a different resource from our point of view - hence a new
> network request."
> 
> So wouldn't that imply that it would never keep the video cache/buffer when
> replaying? 

Don't understand the question.

> If it's asking ffor a different resource, then why does it stay
> in cache when the cache folder is not full?

As well.

We are not under the control of what the player requests.  If any response is cachible we attempt to cache it.  If there are two distinct requests, we do (and cache) two requests (responses).

Comment 34

[illumilor.e]

"If there are two distinct requests, we do (and cache) two requests (responses)."

Only one video stream is cached though, not two.

"Don't understand the question."

Why does this problem only occur when the cache folder is full? Why does the video player not redownload its video file if the cache folder has been recently emptied? Your statement implies that the video would always need to redownload the video file, when it is dependant on the size that the user has set firefox's cache to.

Comment 35

[Honza Bambas (:mayhemer)]

(In reply to illumilor.e from comment #34)
> "If there are two distinct requests, we do (and cache) two requests
> (responses)."
> 
> Only one video stream is cached though, not two.

No.  Both are - there are two distinct requests.

> 
> "Don't understand the question."
> 
> Why does this problem only occur when the cache folder is full? 

I can reproduce with an empty cache too.

> Why does the
> video player not redownload its video file if the cache folder has been
> recently emptied? 

I already explained that.

> Your statement implies that the video would always need to
> redownload the video file, when it is dependant on the size that the user
> has set firefox's cache to.

I don't follow the line.


I don't think there is more to take care of here.  Case closed unless I'm still missing something in explanation of your problem.

Comment 36

[illumilor.e]

"I can reproduce with an empty cache too."

It never happens with an empty cache for me. Only when the cache is full. If the player is asking for a different resource, and firefox is giving it a different one than it asked for, then it sounds like a bug from my end.

Comment 37

[illumilor.e]

Ever since going to firefox 36, this now happens on youtube as well. Halfway through playing the video it will just stop act as it finished the video.

Comment 38

[Andre Klapper]

Comment 35 still applies. Please do not reopen while ignoring comment 35.

Comment 39

[illumilor.e]

"Comment 35 still applies."

I am not ignoring comment 35. It does not reproduce with an empty cache for me unless the video is larger than the max cache size set in user pref.

Comment 40

[Honza Bambas (:mayhemer)]

Illuminator, problem here is that with the steps to reproduce you provide we simply identified the cause of the problem as something that is not a bug.

You either don't provide all information (then don't expect we bother doing more then already has been done) or you provide misleading information or what you perceive as a bug is not a bug.

In any way, I don't see a help for you.


Feel free to reopen but only with more correct and decent information that would lead to confirmation and a fix.  Empty claims will be ignored.

Comment 41

[illumilor.e]

This bug doesn't happen in chrome, or konquerer. I just reproduced it on a new profile with no extensions enabled after going to said website, although on a new profile it seems that the website defaults to a different player right now, so I had to hit switch player button right below the video so it looks like the screenshot. It then will always have to waste bandwidth and reload the video when replaying but only when the cache is full. Firefox shouldn't drop content from still open tabs in favor of old already closed tab content. Replaying the video without reloading content from server then starts working again when the user then manually wipes the cache or manually increases its max size for a while.

>> You either don't provide all information (then don't expect we bother doing more then already has been done) 

I must have missed the switch player when I tried from a clean profile last time or maybe the default has changed on the site since then. Sorry.

Comment 42

[Andre Klapper]

Please stop changing the status. You can comment without changing the status.

Comment 43

[illumilor.e]

(In reply to Andre Klapper from comment #42)
> Please stop changing the status. You can comment without changing the status.

Then can you tell me why you are marking it invalid?

Comment 44

[Andre Klapper]

See comment 40. 
If WORKSFORME makes you happier, I can also set this to WORKSFORME. 
Which I am doing now. Do not reopen.