Removing Cookies and Site Data clears Cached Web Content

VERIFIED FIXED in Firefox 67

Status

()

defect
P1
normal
VERIFIED FIXED
4 months ago
Last month

People

(Reporter: euthanasia_waltz, Assigned: johannh)

Tracking

(Blocks 1 bug, Regression, {regression})

67 Branch
mozilla68
Points:
---
Dependency tree / graph

Firefox Tracking Flags

(firefox-esr60 unaffected, firefox66 unaffected, firefox67+ verified, firefox68 verified)

Details

Attachments

(3 attachments)

Reporter

Description

4 months ago

STR:

  1. Launch firefox with *new* profile
  2. Open New Tab -> YouTube (for example)
  3. Open Options(Preferences) -> Privacy & Security -> Cookies and Site Data
  4. (make sure cache(Cached Web Content) size)
  5. Open Manage Data
  6. Select doubleclick.net and remove it (Remove Selected -> Save Changes -> Remove)

ER:
Only cookies of doubleclick.net is removed.

AR:
Cached Web Content is cleared.

mozregression:
https://hg.mozilla.org/integration/autoland/pushloghtml?fromchange=6c289d94dcca88ecfe3893633a31370119c061c7&tochange=143b9e605ff029b2772687a36ae8e727910f37d9

Assignee

Comment 1

4 months ago

Thanks for the report!

Blocks: 1523272
Status: UNCONFIRMED → NEW
Component: Preferences → Data Sanitization
Ever confirmed: true
Flags: needinfo?(jhofmann)
Keywords: regression
Priority: -- → P1
Product: Firefox → Toolkit
Assignee

Updated

3 months ago
Assignee: nobody → jhofmann
Status: NEW → ASSIGNED
Flags: needinfo?(jhofmann)

Comment 3

3 months ago
Pushed by jhofmann@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/a75c0f1d25e5
Implement deleteByHost for NetworkCacheCleaner and ImageCacheCleaner. r=baku
Assignee

Updated

3 months ago
Depends on: 1536387
Assignee

Comment 6

3 months ago

We're blocked on bug 1536387 to resolve the (rightly occurring) failures.

Flags: needinfo?(jhofmann)

Johann, with bug 1536387 now resolved, is this patch safe to re-land? And also safe to uplift to 67 beta?

Flags: needinfo?(jhofmann)
Assignee

Comment 8

3 months ago

No, there are other problems, which seem to require a closer investigation. I don't have time for it this week but will try to tackle it next.

Flags: needinfo?(jhofmann)

Johann, checking in to see if there is any update for this P1 bug?

Flags: needinfo?(jhofmann)
Assignee

Updated

3 months ago
Blocks: 1301562
Assignee

Comment 10

3 months ago

This also moves SiteDataTestUtils to have it available in toolkit.

Assignee

Comment 11

3 months ago

This test was not actually testing what it expected, and we need to properly solve that (clearing by hostname across OAs) in bug 1541885.

Assignee

Comment 13

3 months ago

Landing now, I'd say this is upliftable...

We're making a difficult compromise here, causing bug 1541885 through this patch (for cache). But (obviously) I'd say it's the right call.

Flags: needinfo?(jhofmann)

Comment 14

3 months ago
Pushed by jhofmann@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/0ac60b9d0ffc
Implement deleteByHost for NetworkCacheCleaner and ImageCacheCleaner. r=baku
https://hg.mozilla.org/integration/autoland/rev/9268318dee79
Add a basic test for clearing network cache with ClearDataService. r=baku
https://hg.mozilla.org/integration/autoland/rev/72bccd93ed10
Disable browser/components/contextualidentity/test/browser/browser_forgetaboutsite.js because of bug 1541885. r=baku

Comment 15

3 months ago
bugherder
Status: ASSIGNED → RESOLVED
Closed: 3 months ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla68
Assignee

Comment 16

2 months ago

Comment on attachment 9050957 [details]
Bug 1532203 - Implement deleteByHost for NetworkCacheCleaner and ImageCacheCleaner. r=baku

Beta/Release Uplift Approval Request

  • Feature/Bug causing the regression: Bug 1523272 + other long standing issues
  • User impact if declined: Users will clear their entire cache when deleting sites in the site data manager or using Forget About this Site (bug 1301562)
  • Is this code covered by automated tests?: Yes
  • Has the fix been verified in Nightly?: No
  • Needs manual test from QE?: Yes
  • If yes, steps to reproduce: See comment 0, feel free to also test if this fixes bug 1301562
  • List of other uplifts needed: None, bug 1536387 was uplifted already
  • Risk to taking this patch: Low
  • Why is the change risky/not risky? (and alternatives if risky): The code here is straightforward, well understood and introduces tests for stuff that was previously untested. Note that we chose to introduce a new regression for users with container tabs (bug 1541885) as a trade-off to fix this issue. This isn't really a "risk" (the effects are well understood), just something to be aware of.
  • String changes made/needed: None
Attachment #9050957 - Flags: approval-mozilla-beta?
Assignee

Updated

2 months ago
Attachment #9055996 - Flags: approval-mozilla-beta?
Attachment #9055997 - Flags: approval-mozilla-beta?
Assignee

Updated

2 months ago
Flags: qe-verify?

I'd like to see it verified by QA on Nightly before uplifting to beta.

No longer blocks: 1523272
Has Regression Range: --- → no
Has STR: --- → yes
Flags: qe-verify? → qe-verify+
Regressed by: 1523272
QA Whiteboard: [qa-triaged]

I reproduced the issue on Firefox Nightly 67.0a1 (2019-03-03) under Windows 10 (x64) using the STR from Comment 0 and some additional infos from Johann.

The issue is no longer reproducible on latest Nightly 68.0a1 (2019-04-09). Tests were performed on Windows 10 (x64), macOS 10.12 and Ubuntu 18.04 (x64).

Status: RESOLVED → VERIFIED

Comment on attachment 9050957 [details]
Bug 1532203 - Implement deleteByHost for NetworkCacheCleaner and ImageCacheCleaner. r=baku

Tracked 67 regression + patch with tests + fix verified on nightly. Uplift approved for 67 beta 10, thanks!

Attachment #9050957 - Flags: approval-mozilla-beta? → approval-mozilla-beta+
Attachment #9055996 - Flags: approval-mozilla-beta? → approval-mozilla-beta+
Attachment #9055997 - Flags: approval-mozilla-beta? → approval-mozilla-beta+
Reporter

Comment 21

2 months ago

Excuse me.
I'm expecting this feature(Manage Data/Manage Cookies and Site Data) to remove selected(or all) cookies and storage data but not cached contents.
https://support.mozilla.org/en-US/kb/clear-cookies-and-site-data-firefox
"Clear Data" dialog shows "Cookies and Site Data" and "Cached Web Content" as different data.
"Manage Cookies and Site Data" dialog is not joined to cached contents.(no content size, no sites which has cached content but not cookies or storage data)
(the missing piece may be "Manage Cached Web Content", but it doesn't matter here)

Even if this feature is changed to remove cached contents, I cannot recognize which content will be removed.
Steps for example:

  1. Clear all data (Options -> Privacy & Security -> Cookies and Site Data -> Clear Data -> Clear)
  2. Go to YouTube
  3. Go to about:cache -> disk -> List Cache Entries
  4. Find "doubleclick.net", remember matched count and Number of entries (3, 87)
  5. Open Options -> Privacy & Security -> Cookies and Site Data -> Manage Data
  6. Select "doubleclick.net" -> Remove Selected -> Save Changes -> Remove
  7. Go to about:cache tab and click Update
    => Number of entries is reduced to 23. Not 87-3.

Also, this may be another story though, there are two site's cookies in "Manage Cookies and Site Data" dialog after visiting https://support.mozilla.org/en-US/kb/get-started-firefox-overview-main-features
support.mozilla.org 5
mozilla.org 3
If I select "support.mozilla.org", Remove Selected, Save Changes, and Remove on confirmation dialog for "support.mozilla.org", cookies of "mozilla.org" are removed too.

(Build ID 20190409221047 now)

What am I misunderstanding?
Are there any document about this something new feature?

Assignee

Comment 22

2 months ago

(In reply to atlanto from comment #21)

Excuse me.
I'm expecting this feature(Manage Data/Manage Cookies and Site Data) to remove selected(or all) cookies and storage data but not cached contents.
https://support.mozilla.org/en-US/kb/clear-cookies-and-site-data-firefox
"Clear Data" dialog shows "Cookies and Site Data" and "Cached Web Content" as different data.
"Manage Cookies and Site Data" dialog is not joined to cached contents.(no content size, no sites which has cached content but not cookies or storage data)
(the missing piece may be "Manage Cached Web Content", but it doesn't matter here)

I think clearing the cache for that specific origin is intended and helpful.

Even if this feature is changed to remove cached contents, I cannot recognize which content will be removed.
Steps for example:

  1. Clear all data (Options -> Privacy & Security -> Cookies and Site Data -> Clear Data -> Clear)
  2. Go to YouTube
  3. Go to about:cache -> disk -> List Cache Entries
  4. Find "doubleclick.net", remember matched count and Number of entries (3, 87)
  5. Open Options -> Privacy & Security -> Cookies and Site Data -> Manage Data
  6. Select "doubleclick.net" -> Remove Selected -> Save Changes -> Remove
  7. Go to about:cache tab and click Update
    => Number of entries is reduced to 23. Not 87-3.

Sorry, I can't really figure out if there's an issue based on these numbers. It could be fine, depending on the way the cache eviction works. If we're deleting a specific entry that you think we should not be deleting, feel free to file a new bug.

Also, this may be another story though, there are two site's cookies in "Manage Cookies and Site Data" dialog after visiting https://support.mozilla.org/en-US/kb/get-started-firefox-overview-main-features
support.mozilla.org 5
mozilla.org 3
If I select "support.mozilla.org", Remove Selected, Save Changes, and Remove on confirmation dialog for "support.mozilla.org", cookies of "mozilla.org" are removed too.

This is expected, since support.mozilla.org may be able to access storage from mozilla.org under the right circumstances.

The issue is no longer reproducible on Firefox Beta 67.0b13. Tests were performed on Windows 10 (x64), macOS 10.13.6 and Ubuntu 18.04 (x64).

Flags: qe-verify+
Assignee

Updated

Last month
Blocks: 1538633
You need to log in before you can comment on or make changes to this bug.