1439332 - Intermittent browser/components/preferences/in-content/tests/browser_siteData.js | Should show no site data. - "64.0 KB" == "" -

Status: RESOLVED WORKSFORME

(Firefox :: Settings UI, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=162973269&repo=autoland

https://queue.taskcluster.net/v1/task/P6MusDLrQcyQ4rrPl5SPmA/runs/0/artifacts/public/logs/live_backing.log

[task 2018-02-19T10:05:12.232Z] 10:05:12     INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_siteData.js | All expectedStyleSheetURLs should have been found - 
[task 2018-02-19T10:05:12.233Z] 10:05:12     INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_siteData.js | The Settings dialog should be visible - 
[task 2018-02-19T10:05:12.234Z] 10:05:12     INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_siteData.js | Should list two sites with cookies - 2 == 2 - 
[task 2018-02-19T10:05:12.235Z] 10:05:12     INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_siteData.js | Should show the correct host. - "example.com" == "example.com" - 
[task 2018-02-19T10:05:12.235Z] 10:05:12     INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_siteData.js | Should show the correct number of cookies. - "2" == "2" - 
[task 2018-02-19T10:05:12.236Z] 10:05:12     INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_siteData.js | Should show no site data. - "" == "" - 
[task 2018-02-19T10:05:12.237Z] 10:05:12     INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_siteData.js | Should show the correct host. - "example.org" == "example.org" - 
[task 2018-02-19T10:05:12.238Z] 10:05:12     INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_siteData.js | Should show the correct number of cookies. - "1" == "1" - 
[task 2018-02-19T10:05:12.239Z] 10:05:12     INFO - Buffered messages finished
[task 2018-02-19T10:05:12.239Z] 10:05:12     INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_siteData.js | Should show no site data. - "64.0 KB" == "" - 
[task 2018-02-19T10:05:12.240Z] 10:05:12     INFO - Stack trace:
[task 2018-02-19T10:05:12.241Z] 10:05:12     INFO - resource://testing-common/content-task.js line 50 > eval:null:20
[task 2018-02-19T10:05:12.241Z] 10:05:12     INFO - resource://testing-common/content-task.js:null:51
[task 2018-02-19T10:05:12.242Z] 10:05:12     INFO - GECKO(1457) | [Parent 1457, Main Thread] WARNING: NS_ENSURE_SUCCESS(rv, rv) failed with result 0x80520012: file /builds/worker/workspace/build/src/layout/style/Loader.cpp, line 2108
[task 2018-02-19T10:05:12.243Z] 10:05:12     INFO - GECKO(1457) | [Parent 1457, Main Thread] WARNING: NS_ENSURE_TRUE(shell) failed: file /builds/worker/workspace/build/src/layout/base/nsDocumentViewer.cpp, line 3803
[task 2018-02-19T10:05:12.260Z] 10:05:12     INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_siteData.js | Cookies from the second host should not be cleared -

Comment 1

[Intermittent Failures Robot]

15 failures in 135 pushes (0.111 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 9
* mozilla-central: 3
* mozilla-inbound: 2
* try: 1

Platform breakdown:
* linux32-stylo-disabled: 4
* linux64-stylo-disabled: 3
* linux64: 3
* linux32: 2
* windows10-64-ccov: 1
* osx-10-10: 1
* linux64-ccov: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1439332&startday=2018-02-23&endday=2018-02-23&tree=all

Comment 2

[Narcis Beleuzu [:NarcisB]]

There are 33 failures in the last 7 days.
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1439332&startday=2018-02-17&endday=2018-02-24&tree=all

Platforms:
- Linux, Linux x64, linux32-stylo-disabled, linux64-stylo-disabled, linux64-ccov
- OS X 10.10
- windows10-64-ccov

Recent log failure:
https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=164087403&lineNumber=12504

:jaws, could you please take a look?

Comment 3

[Intermittent Failures Robot]

44 failures in 675 pushes (0.065 failures/push) were associated with this bug in the last 7 days. 

This is the #25 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 21
* mozilla-inbound: 13
* mozilla-central: 9
* try: 1

Platform breakdown:
* linux32-stylo-disabled: 15
* linux64: 11
* linux64-stylo-disabled: 10
* linux32: 4
* windows10-64-ccov: 1
* windows10-64: 1
* osx-10-10: 1
* linux64-ccov: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1439332&startday=2018-02-19&endday=2018-02-25&tree=all

Comment 4

[Intermittent Failures Robot]

18 failures in 169 pushes (0.107 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 11
* mozilla-inbound: 5
* try: 1
* mozilla-central: 1

Platform breakdown:
* linux64-stylo-disabled: 9
* linux64: 5
* linux32: 3
* linux32-stylo-disabled: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1439332&startday=2018-02-28&endday=2018-02-28&tree=all

Comment 5

[Intermittent Failures Robot]

16 failures in 179 pushes (0.089 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 9
* mozilla-inbound: 4
* mozilla-central: 3

Platform breakdown:
* linux64-stylo-disabled: 8
* linux32: 4
* linux64: 3
* linux32-stylo-disabled: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1439332&startday=2018-03-01&endday=2018-03-01&tree=all

Comment 6

[Tiberius Oros[:tiberius_oros]]

There have been 77 failures in the last week and 112 failures in the last 21 days.

For the last 7 days I see that the failures occur on: 

Platforms:
- linux64-stylo-disabled:29
- linux32-stylo-disabled: 19
- Linux x64: 16
- Linux: 12
- Windows 7: 1

Build type:
- debug: 69
- opt: 6
- asan: 2


Here is a recent log file and a snippet with the failure:
https://treeherder.mozilla.org/logviewer.html#?repo=autoland&job_id=165658781&lineNumber=12350

[task 2018-03-02T22:39:32.486Z] 22:39:32     INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_siteData.js | Should show the correct host. - "example.org" == "example.org" - 
[task 2018-03-02T22:39:32.487Z] 22:39:32     INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_siteData.js | Should show the correct number of cookies. - "1" == "1" - 
[task 2018-03-02T22:39:32.487Z] 22:39:32     INFO - Buffered messages finished
[task 2018-03-02T22:39:32.489Z] 22:39:32     INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_siteData.js | Should show no site data. - "64.0 KB" == "" - 
[task 2018-03-02T22:39:32.489Z] 22:39:32     INFO - Stack trace:
[task 2018-03-02T22:39:32.490Z] 22:39:32     INFO - resource://testing-common/content-task.js line 50 > eval:null:21
[task 2018-03-02T22:39:32.491Z] 22:39:32     INFO - resource://testing-common/content-task.js:null:51

Comment 7

[Intermittent Failures Robot]

79 failures in 831 pushes (0.095 failures/push) were associated with this bug in the last 7 days. 

This is the #15 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **   

Repository breakdown:
* autoland: 39
* mozilla-inbound: 20
* mozilla-central: 9
* mozilla-beta: 6
* try: 5

Platform breakdown:
* linux64-stylo-disabled: 31
* linux32-stylo-disabled: 18
* linux64: 16
* linux32: 12
* windows7-32: 1
* linux64-ccov: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1439332&startday=2018-02-26&endday=2018-03-04&tree=all

Comment 8

[Intermittent Failures Robot]

8 failures in 160 pushes (0.05 failures/push) were associated with this bug yesterday.    

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* mozilla-inbound: 4
* autoland: 4

Platform breakdown:
* linux64-stylo-disabled: 5
* windows7-32: 1
* linux64: 1
* linux32-stylo-disabled: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1439332&startday=2018-03-07&endday=2018-03-07&tree=all

Comment 9

[Arthur Iakab [arthur_iakab]]

This bug has failed 65 times in the last 7 days, mainly on Linux but it failed a few times on Windows 7 and Windows 10, affecting opt and debug build types.
Failing test: debug-mochitest-browser-chrome-e10, opt-mochitest-browser-chrome-e10s.
Link to a recent log: https://treeherder.mozilla.org/logviewer.html#?repo=autoland&job_id=166966972&lineNumber=13918
Part of that log: [task 2018-03-09T12:46:08.763Z] 12:46:08     INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_siteData.js | Should show the correct host. - "example.org" == "example.org" - 
[task 2018-03-09T12:46:08.766Z] 12:46:08     INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_siteData.js | Should show the correct number of cookies. - "1" == "1" - 
[task 2018-03-09T12:46:08.767Z] 12:46:08     INFO - Buffered messages finished
[task 2018-03-09T12:46:08.768Z] 12:46:08     INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_siteData.js | Should show no site data. - "64.0 KB" == "" -

:jaws,:johannh do you guys have any updates on this bug? Or should we disable it?

Comment 10

[Johann Hofmann [:johannh]]

We can disable the test for now, I'm currently refactoring those tests anyway. Arthur, can you prepare a patch for that? I'm currently on my way to the weekend.

Comment 11

[Cristian Brindusan [:cbrindusan]]

Attachment: bug1439332.patch

I've made a patch to disable this test on Linux debug. 
Please let me know if it's necessary to disable it on Windows too.

Comment 12

[Intermittent Failures Robot]

65 failures in 747 pushes (0.087 failures/push) were associated with this bug in the last 7 days. 

This is the #11 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* autoland: 27
* mozilla-inbound: 25
* mozilla-central: 7
* try: 5
* mozilla-beta: 1

Platform breakdown:
* linux64-stylo-disabled: 22
* linux64: 14
* linux32-stylo-disabled: 14
* linux32: 9
* windows10-64: 4
* windows7-32: 1
* linux32-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1439332&startday=2018-03-05&endday=2018-03-11&tree=all

Comment 13

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/90bf79e1b05e
disable browser/components/preferences/in-content/tests/browser_siteData.js for frequent failures on Linux. r=jmaher

Comment 14

[Eliza Balazs [:ebalazs_]]

https://hg.mozilla.org/mozilla-central/rev/90bf79e1b05e

Comment 15

[Intermittent Failures Robot]

16 failures in 168 pushes (0.095 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 7
* autoland: 5
* mozilla-central: 2
* try: 1
* mozilla-beta: 1

Platform breakdown:
* windows7-32: 12
* linux32-stylo-disabled: 2
* windows10-64-ccov: 1
* linux64-stylo-disabled: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1439332&startday=2018-03-16&endday=2018-03-16&tree=all

Comment 16

[Intermittent Failures Robot]

46 failures in 814 pushes (0.057 failures/push) were associated with this bug in the last 7 days. 

This is the #27 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-inbound: 15
* autoland: 13
* mozilla-central: 8
* mozilla-beta: 7
* try: 3

Platform breakdown:
* windows7-32: 22
* linux32-stylo-disabled: 8
* linux64: 5
* windows10-64: 4
* linux64-stylo-disabled: 4
* windows10-64-ccov: 2
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1439332&startday=2018-03-12&endday=2018-03-18&tree=all

Comment 17

[Tiberius Oros[:tiberius_oros]]

There have been 36 total failures in the last 7 days.
This was disabled on Linux /debug 8 days ago.
It seems that now it fails mainly on windows platforms.

Occurences per platforms and build type:

Windows 7 / debug: 23
windows10-64 / debug: 3
windows10-64-ccov/ debug: 3 
OS X 10.10 /debug: 1
linux64-stylo-disabled / opt: 2
Linux x64 / asan & pgo: 4

Recent relevant log file and snippet with the failure:
https://treeherder.mozilla.org/logviewer.html#?repo=autoland&job_id=169302144&lineNumber=13502

22:04:58     INFO -  569 INFO TEST-PASS | browser/components/preferences/in-content/tests/siteData/browser_siteData.js | Should show the correct date. - "3/20/2018, 10:04 PM" == "3/20/2018, 10:04 PM" -
22:04:58     INFO -  570 INFO TEST-PASS | browser/components/preferences/in-content/tests/siteData/browser_siteData.js | Should show the correct host. - "example.org" == "example.org" -
22:04:58     INFO -  571 INFO TEST-PASS | browser/components/preferences/in-content/tests/siteData/browser_siteData.js | Should show the correct number of cookies. - "1" == "1" -
22:04:58     INFO -  Buffered messages finished
22:04:58    ERROR -  572 INFO TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/siteData/browser_siteData.js | Should show no site data. - "64.0 KB" == "" -
22:04:58     INFO -  Stack trace:
22:04:58     INFO -  resource://testing-common/content-task.js line 50 > eval:null:21
22:04:58     INFO -  resource://testing-common/content-task.js:null:51

Comment 18

[Johann Hofmann [:johannh]]

Ugh, that damn cache is so unpredictable. I'll prepare a patch to todo the assertion for now. Maybe adding a way to set indexedDB without opening a new page in bug 1348223 would help. I'm going to look into this more soon, but I think a todo is probably best short term since that assertion isn't really important anyway...

Comment 19

[Johann Hofmann [:johannh]]

Attachment: Bug 1439332 - todo assertions for "no site data" in site data cookies tests for now.

Review commit: https://reviewboard.mozilla.org/r/230244/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/230244/

Comment 20

[Jared Wein [:jaws] (please needinfo? me)]

Comment on attachment 8961477 [details]
Bug 1439332 - todo assertions for "no site data" in site data cookies tests for now.

https://reviewboard.mozilla.org/r/230244/#review236306

rs=me, but won't todo() fail if the condition is true? So if this is interimittent failures, this will now be intermittent successes? :)

Comment 21

[Johann Hofmann [:johannh]]

(In reply to Jared Wein [:jaws] (please needinfo? me) from comment #20)
> Comment on attachment 8961477 [details]
> Bug 1439332 - todo assertions for "no site data" in site data cookies tests
> for now.
> 
> https://reviewboard.mozilla.org/r/230244/#review236306
> 
> rs=me, but won't todo() fail if the condition is true? So if this is
> interimittent failures, this will now be intermittent successes? :)

Verified that todo(true) doesn't fail :)

Comment 22

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/91835d19518c
todo assertions for "no site data" in site data cookies tests for now. r=jaws

Comment 23

[Ryan VanderMeulen (PTO, back July 27)]

Landed on Beta too:
https://hg.mozilla.org/releases/mozilla-beta/rev/1635a57d13f6

Comment 24

[Cristina Coroiu [:ccoroiu]]

https://hg.mozilla.org/mozilla-central/rev/91835d19518c

Comment 25

[Intermittent Failures Robot]

45 failures in 822 pushes (0.055 failures/push) were associated with this bug in the last 7 days. 

This is the #30 most frequent failure this week.  

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **  

Repository breakdown:
* mozilla-beta: 15
* mozilla-inbound: 12
* try: 9
* autoland: 7
* mozilla-central: 2

Platform breakdown:
* windows7-32: 14
* linux64: 10
* linux32-stylo-disabled: 10
* windows10-64: 5
* osx-10-10: 2
* windows10-64-ccov: 1
* linux64-stylo-disabled: 1
* linux64-qr: 1
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1439332&startday=2018-03-20&endday=2018-03-26&tree=trunk

Comment 26

[Intermittent Failures Robot]

7 failures in 718 pushes (0.01 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-beta: 3
* try: 2
* mozilla-inbound: 2

Platform breakdown:
* windows7-32: 3
* linux32-stylo-disabled: 2
* windows10-64: 1
* linux32: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1439332&startday=2018-03-26&endday=2018-04-01&tree=trunk

Comment 27

[Jared Wein [:jaws] (please needinfo? me)]

Bug 1464102 is changing these back from todo to is(). Note that until bug 1464102, todo() in content-tasks were not working (confirmed by comment 21 above) so the change that landed here effectively commented out the code.