1748405 - Intermittent devtools/client/storage/test/browser_storage_cache_overflow.js | Table should initially display 50 items - Got 47, expected 50

Status: RESOLVED FIXED

(DevTools :: Storage Inspector, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: nfay [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=362956186&repo=autoland
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/fDzgdFHwRMSVCBN-cmo1cw/runs/0/artifacts/public/logs/live_backing.log

---

[task 2022-01-04T07:54:27.574Z] 07:54:27     INFO - TEST-START | devtools/client/storage/test/browser_storage_cache_overflow.js
[task 2022-01-04T07:54:29.388Z] 07:54:29     INFO - TEST-INFO | started process screenshot
[task 2022-01-04T07:54:29.444Z] 07:54:29     INFO - TEST-INFO | screenshot: exit 0
[task 2022-01-04T07:54:29.445Z] 07:54:29     INFO - Buffered messages logged at 07:54:27
[task 2022-01-04T07:54:29.445Z] 07:54:29     INFO - Entering test bound 
[task 2022-01-04T07:54:29.446Z] 07:54:29     INFO - Adding a new tab with URL: https://example.com/browser/devtools/client/storage/test/storage-cache-overflow.html
[task 2022-01-04T07:54:29.446Z] 07:54:29     INFO - Tab added and finished loading
[task 2022-01-04T07:54:29.446Z] 07:54:29     INFO - Found a window: complete
[task 2022-01-04T07:54:29.447Z] 07:54:29     INFO - Opening the storage inspector
[task 2022-01-04T07:54:29.447Z] 07:54:29     INFO - Opening the toolbox
[task 2022-01-04T07:54:29.447Z] 07:54:29     INFO - Buffered messages logged at 07:54:28
[task 2022-01-04T07:54:29.448Z] 07:54:29     INFO - Console message: [JavaScript Error: "Content Security Policy: The pages settings blocked the loading of a resource at inline (default-src)." {file: "chrome" line: 511}]
[task 2022-01-04T07:54:29.448Z] 07:54:29     INFO - Console message: [JavaScript Error: "Content Security Policy: The pages settings blocked the loading of a resource at inline (default-src)." {file: "chrome" line: 511}]
[task 2022-01-04T07:54:29.449Z] 07:54:29     INFO - Console message: [JavaScript Error: "Content Security Policy: The pages settings blocked the loading of a resource at inline (default-src)." {file: "chrome" line: 62}]
[task 2022-01-04T07:54:29.449Z] 07:54:29     INFO - Making sure that the toolbox's frame is focused
[task 2022-01-04T07:54:29.449Z] 07:54:29     INFO - Selecting "Cache,https://example.com,lorem".
[task 2022-01-04T07:54:29.450Z] 07:54:29     INFO - Buffered messages finished
[task 2022-01-04T07:54:29.451Z] 07:54:29     INFO - TEST-UNEXPECTED-FAIL | devtools/client/storage/test/browser_storage_cache_overflow.js | Table should initially display 50 items - Got 47, expected 50
[task 2022-01-04T07:54:29.451Z] 07:54:29     INFO - Stack trace:
[task 2022-01-04T07:54:29.451Z] 07:54:29     INFO - chrome://mochikit/content/browser-test.js:test_is:1403
[task 2022-01-04T07:54:29.451Z] 07:54:29     INFO - chrome://mochitests/content/browser/devtools/client/storage/test/head.js:checkCellLength:1071
[task 2022-01-04T07:54:29.451Z] 07:54:29     INFO - chrome://mochitests/content/browser/devtools/client/storage/test/browser_storage_cache_overflow.js:null:19
[task 2022-01-04T07:54:29.451Z] 07:54:29     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1130
[task 2022-01-04T07:54:29.451Z] 07:54:29     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1170
[task 2022-01-04T07:54:29.451Z] 07:54:29     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:978
[task 2022-01-04T07:54:29.451Z] 07:54:29     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1041
[task 2022-01-04T07:54:29.714Z] 07:54:29     INFO - Not taking screenshot here: see the one that was previously logged
[task 2022-01-04T07:54:29.715Z] 07:54:29     INFO - TEST-UNEXPECTED-FAIL | devtools/client/storage/test/browser_storage_cache_overflow.js | Table should initially display 100 items - Got 97, expected 100
[task 2022-01-04T07:54:29.715Z] 07:54:29     INFO - Stack trace:
[task 2022-01-04T07:54:29.715Z] 07:54:29     INFO - chrome://mochikit/content/browser-test.js:test_is:1403
[task 2022-01-04T07:54:29.715Z] 07:54:29     INFO - chrome://mochitests/content/browser/devtools/client/storage/test/head.js:checkCellLength:1071
[task 2022-01-04T07:54:29.715Z] 07:54:29     INFO - chrome://mochitests/content/browser/devtools/client/storage/test/browser_storage_cache_overflow.js:null:22
[task 2022-01-04T07:54:29.715Z] 07:54:29     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1130
[task 2022-01-04T07:54:29.715Z] 07:54:29     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1170
[task 2022-01-04T07:54:29.715Z] 07:54:29     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:978
[task 2022-01-04T07:54:29.715Z] 07:54:29     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/<:1041
[task 2022-01-04T07:54:29.716Z] 07:54:29     INFO - Close Toolbox
[task 2022-01-04T07:54:29.832Z] 07:54:29     INFO - Leaving test bound 
[task 2022-01-04T07:54:30.075Z] 07:54:30     INFO - GECKO(836) | JavaScript error: , line 0: NotFoundError: No such JSWindowActor 'DevToolsFrame'
[task 2022-01-04T07:54:30.079Z] 07:54:30     INFO - Console message: [JavaScript Error: "NotFoundError: No such JSWindowActor 'DevToolsFrame'"]
[task 2022-01-04T07:54:30.083Z] 07:54:30     INFO - Removing tab.
[task 2022-01-04T07:54:30.083Z] 07:54:30     INFO - Waiting for event: 'TabClose' on [object XULElement].
[task 2022-01-04T07:54:30.089Z] 07:54:30     INFO - Got event: 'TabClose' on [object XULElement].
[task 2022-01-04T07:54:30.094Z] 07:54:30     INFO - Tab removed and finished closing
[task 2022-01-04T07:54:30.226Z] 07:54:30     INFO - TEST-PASS | devtools/client/storage/test/browser_storage_cache_overflow.js | The main process DevToolsServer has no pending connection when the test ends - 
[task 2022-01-04T07:54:30.239Z] 07:54:30     INFO - GECKO(836) | MEMORY STAT | vsize 2112383MB | vsizeMaxContiguous 64968056MB | residentFast 261MB | heapAllocated 97MB
[task 2022-01-04T07:54:30.239Z] 07:54:30     INFO - TEST-OK | devtools/client/storage/test/browser_storage_cache_overflow.js | took 2664ms
[task 2022-01-04T07:54:30.253Z] 07:54:30     INFO - checking window state
[task 2022-01-04T07:54:30.263Z] 07:54:30     INFO - TEST-START | devtools/client/storage/test/browser_storage_cookies_add.js

Comment 1

[Julian Descottes [:jdescottes]]

Attachment: Bug 1748405 - [devtools] Wait for caches and cell count in browser_storage_cache_overflow

Comment 2

[Julian Descottes [:jdescottes]]

Nothing obvious comes to mind, I used the exact same approach as for the other storage overflow tests. Maybe cache storage is slightly more async and we check for the number of cells too quickly. Or maybe we start the test too early.

Will wait for some try results.

Comment 3

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

The screenshot for the log in comment 0 doesn't show any cells yet, fwiw.

Comment 4

[Julian Descottes [:jdescottes]]

(In reply to Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout) from comment #3)

The screenshot for the log in comment 0 doesn't show any cells yet, fwiw.

Thanks! I noticed that, but the test still reports that some cells were found, so I don't know if this is a red herring or not.

Comment 5

[Julian Descottes [:jdescottes]]

Attachment: Bug 1748405 - [devtools] Update all storage cache tests to properly wait for setup and clear steps

Depends on D135054

Comment 6

[Julian Descottes [:jdescottes]]

Hopefully my last set of patches should fix the issue. The setup of the test was not correctly waiting for all caches to be populated. This seems to be an issue in all the cache storage tests, but was probably only problematic for my new test because I am creating a lot of cache entries instead of just one.

Waiting for try results, but windows jobs are taking a long time to be scheduled.

Comment 7

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/c1d0880212c0
[devtools] Wait for caches and cell count in browser_storage_cache_overflow r=Honza
https://hg.mozilla.org/integration/autoland/rev/a48d96908035
[devtools] Update all storage cache tests to properly wait for setup and clear steps r=Honza

Comment 8

[Andreea Pavel [:apavel]]

https://hg.mozilla.org/mozilla-central/rev/c1d0880212c0
https://hg.mozilla.org/mozilla-central/rev/a48d96908035

Comment 9

[Intermittent Failures Robot]

22 failures in 2801 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

This is the #40 most frequent failure this week.

Repository breakdown:

• autoland: 13
• try: 3
• mozilla-central: 6

Platform and build breakdown:

• windows10-64-2004-qr: 13
  • opt: 13
• linux1804-64-shippable-qr: 1
  • opt: 1
• windows10-64-2004-devedition-qr: 2
  • opt: 2
• windows10-64-2004-shippable-qr: 6
  • opt: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1748405&startday=2022-01-03&endday=2022-01-09&tree=all

Comment 11

[Intermittent Failures Robot]

1 failures in 3060 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform and build breakdown:

• windows10-64-2004-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1748405&startday=2022-01-10&endday=2022-01-16&tree=all

Comment 12

[Intermittent Failures Robot]

1 failures in 3444 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 1

Platform and build breakdown:

• windows10-64-2004-asan-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1748405&startday=2022-01-17&endday=2022-01-23&tree=all

Comment 13

[Intermittent Failures Robot]

1 failures in 3165 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-release: 1

Platform and build breakdown:

• windows10-64-2004-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1748405&startday=2022-01-31&endday=2022-02-06&tree=all

Comment 14

[Intermittent Failures Robot]

1 failures in 2837 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 1

Platform and build breakdown:

• windows10-64-2004-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1748405&startday=2022-03-07&endday=2022-03-13&tree=all

Comment 15

[Intermittent Failures Robot]

1 failures in 3341 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-esr91: 1

Platform and build breakdown:

• windows10-64-2004-shippable-qr: 1
  • opt: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures/bugdetails?bug=1748405&startday=2022-03-21&endday=2022-03-27&tree=all