1531920 - Intermittent [TV] browser/components/preferences/in-content/tests/browser_contentblocking.js | The checkbox should now be unchecked - Got false, expected true

Status: RESOLVED FIXED

(Firefox :: Settings UI, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: dluca [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=231331116&repo=autoland

https://queue.taskcluster.net/v1/task/E9ngNP6-Tvy3Ep0Ral6obQ/runs/0/artifacts/public/logs/live_backing.log

INFO - TEST-START | browser/components/preferences/in-content/tests/browser_contentblocking.js
[task 2019-03-01T20:35:05.864Z] 20:35:05 INFO - TEST-INFO | started process screentopng
[task 2019-03-01T20:35:06.334Z] 20:35:06 INFO - TEST-INFO | screentopng: exit 0
[task 2019-03-01T20:35:06.336Z] 20:35:06 INFO - Buffered messages logged at 20:35:05
[task 2019-03-01T20:35:06.337Z] 20:35:06 INFO - Entering test bound testContentBlockingMainCategory
[task 2019-03-01T20:35:06.337Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | checkbox #contentBlockingTrackingProtectionCheckbox exists -
[task 2019-03-01T20:35:06.338Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | checkbox #contentBlockingTrackingProtectionCheckbox is checked -
[task 2019-03-01T20:35:06.339Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | checkbox #contentBlockingBlockCookiesCheckbox exists -
[task 2019-03-01T20:35:06.340Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | checkbox #contentBlockingBlockCookiesCheckbox is checked -
[task 2019-03-01T20:35:06.341Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Only in private windows item should not be selected -
[task 2019-03-01T20:35:06.342Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Always item should be selected -
[task 2019-03-01T20:35:06.343Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | #trackingProtectionMenu is enabled. -
[task 2019-03-01T20:35:06.347Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | #changeBlockListLink is enabled. -
[task 2019-03-01T20:35:06.351Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | The checkbox should now be unchecked -
[task 2019-03-01T20:35:06.352Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | #trackingProtectionMenu is disabled. -
[task 2019-03-01T20:35:06.353Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | #changeBlockListLink is enabled. -
[task 2019-03-01T20:35:06.359Z] 20:35:06 INFO - Buffered messages finished
[task 2019-03-01T20:35:06.360Z] 20:35:06 INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_contentblocking.js | The checkbox should now be unchecked - Got false, expected true
[task 2019-03-01T20:35:06.361Z] 20:35:06 INFO - Stack trace:
[task 2019-03-01T20:35:06.362Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:test_is:1315
[task 2019-03-01T20:35:06.362Z] 20:35:06 INFO - chrome://mochitests/content/browser/browser/components/preferences/in-content/tests/browser_contentblocking.js:testContentBlockingMainCategory:114
[task 2019-03-01T20:35:06.362Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
[task 2019-03-01T20:35:06.363Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
[task 2019-03-01T20:35:06.363Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:990
[task 2019-03-01T20:35:06.364Z] 20:35:06 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
[task 2019-03-01T20:35:06.365Z] 20:35:06 INFO - Not taking screenshot here: see the one that was previously logged
[task 2019-03-01T20:35:06.366Z] 20:35:06 INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Only in private windows item should be selected by default, when the checkbox is checked - Got false, expected true
[task 2019-03-01T20:35:06.367Z] 20:35:06 INFO - Stack trace:
[task 2019-03-01T20:35:06.367Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:test_is:1315
[task 2019-03-01T20:35:06.368Z] 20:35:06 INFO - chrome://mochitests/content/browser/browser/components/preferences/in-content/tests/browser_contentblocking.js:testContentBlockingMainCategory:115
[task 2019-03-01T20:35:06.369Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
[task 2019-03-01T20:35:06.373Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
[task 2019-03-01T20:35:06.374Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:990
[task 2019-03-01T20:35:06.374Z] 20:35:06 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
[task 2019-03-01T20:35:06.375Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Always item should no longer be selected -
[task 2019-03-01T20:35:06.375Z] 20:35:06 INFO - Not taking screenshot here: see the one that was previously logged
[task 2019-03-01T20:35:06.377Z] 20:35:06 INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_contentblocking.js | The checkbox should now be unchecked - Got true, expected false
[task 2019-03-01T20:35:06.377Z] 20:35:06 INFO - Stack trace:
[task 2019-03-01T20:35:06.378Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:test_is:1315
[task 2019-03-01T20:35:06.378Z] 20:35:06 INFO - chrome://mochitests/content/browser/browser/components/preferences/in-content/tests/browser_contentblocking.js:testContentBlockingMainCategory:114
[task 2019-03-01T20:35:06.379Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
[task 2019-03-01T20:35:06.380Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
[task 2019-03-01T20:35:06.381Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:990
[task 2019-03-01T20:35:06.382Z] 20:35:06 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
[task 2019-03-01T20:35:06.383Z] 20:35:06 INFO - Not taking screenshot here: see the one that was previously logged
[task 2019-03-01T20:35:06.384Z] 20:35:06 INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Only in private windows item should be selected by default, when the checkbox is checked - Got true, expected false
[task 2019-03-01T20:35:06.385Z] 20:35:06 INFO - Stack trace:
[task 2019-03-01T20:35:06.386Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:test_is:1315
[task 2019-03-01T20:35:06.388Z] 20:35:06 INFO - chrome://mochitests/content/browser/browser/components/preferences/in-content/tests/browser_contentblocking.js:testContentBlockingMainCategory:115
[task 2019-03-01T20:35:06.390Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
[task 2019-03-01T20:35:06.391Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
[task 2019-03-01T20:35:06.392Z] 20:35:06 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:990
[task 2019-03-01T20:35:06.393Z] 20:35:06 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
[task 2019-03-01T20:35:06.395Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Always item should no longer be selected -
[task 2019-03-01T20:35:06.397Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | The checkbox should now be unchecked -
[task 2019-03-01T20:35:06.400Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Only in private windows item should be selected by default, when the checkbox is checked -
[task 2019-03-01T20:35:06.401Z] 20:35:06 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Always item should no longer be selected -
[task 2019-03-01T20:35:06.403Z] 20:35:06 INFO - Leaving test bound testContentBlockingMainCategory
[task 2019-03-01T20:35:06.405Z] 20:35:06 INFO - Entering test bound testContentBlockingStandardCategory

Comment 1

[Intermittent Failures Robot]

15 failures in 155 pushes (0.097 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 9
• mozilla-inbound: 6

Platform breakdown:

• linux64: 3
• windows7-32: 5
• osx-10-10: 2
• windows10-64: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-03-02&endday=2019-03-02&tree=all

Comment 2

[Intermittent Failures Robot]

23 failures in 2981 pushes (0.008 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 9
• mozilla-inbound: 6

Platform breakdown:

• linux64: 5
• osx-10-10: 4
• windows10-64: 7
• windows7-32: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-02-25&endday=2019-03-03&tree=all

Comment 3

[Intermittent Failures Robot]

19 failures in 592 pushes (0.032 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 11
• mozilla-inbound: 8

Platform breakdown:

• linux64: 5
• osx-10-10: 4
• windows10-64: 5
• windows7-32: 5

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-03-06&endday=2019-03-06&tree=all

Comment 4

[Intermittent Failures Robot]

27 failures in 2818 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-central: 11
• mozilla-inbound: 8

Platform breakdown:

• linux64: 7
• osx-10-10: 6
• windows10-64: 7
• windows7-32: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-03-04&endday=2019-03-10&tree=all

Comment 5

[Intermittent Failures Robot]

27 failures in 507 pushes (0.053 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 8
• mozilla-central: 11
• mozilla-inbound: 8

Platform breakdown:

• linux64: 7
• osx-10-10: 6
• windows7-32: 7
• windows10-64: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-03-13&endday=2019-03-13&tree=all

Comment 6

[Intermittent Failures Robot]

27 failures in 2771 pushes (0.01 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-inbound: 8
• mozilla-central: 11

Platform breakdown:

• linux64: 7
• osx-10-10: 6
• windows7-32: 7
• windows10-64: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-03-11&endday=2019-03-17&tree=all

Comment 7

[Intermittent Failures Robot]

27 failures in 557 pushes (0.048 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 8
• mozilla-central: 11
• mozilla-inbound: 8

Platform breakdown:

• linux64: 7
• osx-10-10: 6
• windows10-64: 7
• windows7-32: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-03-26&endday=2019-03-26&tree=all

Comment 8

[Andreea Pavel [:apavel]]

This appeared when Bug 1524862 landed. There are 27 total failures in the last 7 days on linux64, osx-10-10, windows10-64, windows7-32 all build types

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=236184365&repo=mozilla-inbound&lineNumber=2986

19:30:41 INFO - TEST-START | browser/components/preferences/in-content/tests/browser_contentblocking.js
19:30:43 INFO - TEST-INFO | started process screenshot
19:30:43 INFO - TEST-INFO | screenshot: exit 0
19:30:43 INFO - Buffered messages logged at 19:30:41
19:30:43 INFO - Entering test bound testListUpdate
19:30:43 INFO - Buffered messages logged at 19:30:42
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | Has tried to update after the fingerprinting checkbox was toggled -
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | Using the correct list url to update -
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | Has tried to update after the cryptomining checkbox was toggled -
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | Using the correct list url to update -
19:30:43 INFO - Leaving test bound testListUpdate
19:30:43 INFO - Entering test bound testContentBlockingMainCategory
19:30:43 INFO - Buffered messages logged at 19:30:43
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | checkbox #contentBlockingTrackingProtectionCheckbox exists -
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | checkbox #contentBlockingTrackingProtectionCheckbox is checked -
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | checkbox #contentBlockingBlockCookiesCheckbox exists -
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | checkbox #contentBlockingBlockCookiesCheckbox is checked -
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Only in private windows item should not be selected -
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Always item should be selected -
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | #trackingProtectionMenu is enabled. -
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | #changeBlockListLink is enabled. -
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | The checkbox should now be unchecked -
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | #trackingProtectionMenu is disabled. -
19:30:43 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | #changeBlockListLink is enabled. -
19:30:43 INFO - Buffered messages finished
19:30:43 INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_contentblocking.js | The checkbox should now be unchecked - Got false, expected true
19:30:43 INFO - Stack trace:
19:30:43 INFO - chrome://mochikit/content/browser-test.js:test_is:1315
19:30:43 INFO - chrome://mochitests/content/browser/browser/components/preferences/in-content/tests/browser_contentblocking.js:testContentBlockingMainCategory:132
19:30:43 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
19:30:43 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1134
19:30:43 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:990
19:30:43 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
19:30:43 INFO - Not taking screenshot here: see the one that was previously logged
19:30:43 INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Only in private windows item should be selected by default, when the checkbox is checked - Got false, expected true

Erica, please take a look.

Comment 9

[Erica Wright [:ewright]]

Looking into it.

Comment 10

[Intermittent Failures Robot]

27 failures in 3910 pushes (0.007 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-inbound: 8
• mozilla-central: 11

Platform breakdown:

• linux64: 7
• osx-10-10: 6
• windows10-64: 7
• windows7-32: 7

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-03-25&endday=2019-03-31&tree=all

Comment 11

[Intermittent Failures Robot]

27 failures in 561 pushes (0.048 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 8
• mozilla-inbound: 8
• mozilla-central: 11

Platform breakdown:

• osx-10-10: 3
• linux64: 4
• windows7-32: 4
• windows10-64: 4
• windows7-32-shippable: 3
• linux64-shippable: 3
• windows10-64-shippable: 3
• osx-10-10-shippable: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-04-05&endday=2019-04-05&tree=all

Comment 12

[Andreea Pavel [:apavel]]

There are 27 total failures in the last 7 days on linux64 debug and opt, linux64-shippable opt, osx-10-10 debug, osx-10-10-shippable opt, windows10-64 debug and opt, windows10-64-shippable opt, windows7-32 debug and opt, windows7-32-shippable opt

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=238532912&repo=mozilla-inbound&lineNumber=9442

23:55:35 INFO - TEST-START | browser/components/preferences/in-content/tests/browser_contentblocking.js
23:55:35 INFO - GECKO(1692) | JavaScript warning: chrome://global/content/elements/tree.js, line 500: Array.forEach is deprecated; use Array.prototype.forEach instead
23:55:36 INFO - GECKO(1692) | JavaScript warning: chrome://global/content/elements/tree.js, line 500: Array.forEach is deprecated; use Array.prototype.forEach instead
23:55:36 INFO - TEST-INFO | started process screenshot

23:55:36 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | #changeBlockListLink is enabled. -
23:55:36 INFO - Buffered messages finished
23:55:36 INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_contentblocking.js | The checkbox should now be unchecked - Got false, expected true
23:55:36 INFO - Stack trace:
23:55:36 INFO - chrome://mochikit/content/browser-test.js:test_is:1325
23:55:36 INFO - chrome://mochitests/content/browser/browser/components/preferences/in-content/tests/browser_contentblocking.js:testContentBlockingMainCategory:131
23:55:36 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1116
23:55:36 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1144
23:55:36 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1000
23:55:36 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
23:55:36 INFO - Not taking screenshot here: see the one that was previously logged
23:55:36 INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Only in private windows item should be selected by default, when the checkbox is checked - Got false, expected true
23:55:36 INFO - Stack trace:
23:55:36 INFO - chrome://mochikit/content/browser-test.js:test_is:1325
23:55:36 INFO - chrome://mochitests/content/browser/browser/components/preferences/in-content/tests/browser_contentblocking.js:testContentBlockingMainCategory:132
23:55:36 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1116
23:55:36 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1144
23:55:36 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1000
23:55:36 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
23:55:36 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Always item should no longer be selected -
23:55:36 INFO - Not taking screenshot here: see the one that was previously logged
23:55:36 INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_contentblocking.js | The checkbox should now be unchecked - Got true, expected false
23:55:36 INFO - Stack trace:
23:55:36 INFO - chrome://mochikit/content/browser-test.js:test_is:1325
23:55:36 INFO - chrome://mochitests/content/browser/browser/components/preferences/in-content/tests/browser_contentblocking.js:testContentBlockingMainCategory:131
23:55:36 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1116
23:55:36 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1144
23:55:36 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1000
23:55:36 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
23:55:36 INFO - Not taking screenshot here: see the one that was previously logged
23:55:36 INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Only in private windows item should be selected by default, when the checkbox is checked - Got true, expected false

Erica are there any updates here?

Comment 13

[Intermittent Failures Robot]

27 failures in 2843 pushes (0.009 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8
• mozilla-inbound: 8
• mozilla-central: 11

Platform breakdown:

• osx-10-10: 3
• linux64: 4
• windows7-32: 4
• windows10-64: 4
• windows7-32-shippable: 3
• linux64-shippable: 3
• windows10-64-shippable: 3
• osx-10-10-shippable: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-04-01&endday=2019-04-07&tree=all

Comment 14

[Erica Wright [:ewright]]

I had a small theory, but being intermittent I'm not certain about it. I ran a few tests and it did not show up, though that's not at all a guarantee seeing how rarely the error shows up.

Comment 15

[Intermittent Failures Robot]

17 failures in 607 pushes (0.028 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 8
• mozilla-central: 9

Platform breakdown:

• linux64: 3
• osx-10-10: 2
• windows7-32: 3
• windows10-64: 3
• osx-10-10-shippable: 2
• linux64-shippable: 1
• windows7-32-shippable: 1
• windows10-64-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-04-16&endday=2019-04-16&tree=all

Comment 16

[Intermittent Failures Robot]

26 failures in 543 pushes (0.048 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-inbound: 12
• autoland: 8
• mozilla-central: 6

Platform breakdown:

• osx-10-10: 2
• linux64: 2
• windows10-64: 5
• osx-10-10-shippable: 2
• windows7-32: 5
• linux64-shippable: 2
• windows7-32-shippable: 4
• windows10-64-shippable: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-04-17&endday=2019-04-17&tree=all

Comment 17

[Andreea Pavel [:apavel]]

Failure rate seems to have increased with the 15th of April, starting from the landing of bug 1543280

There are 52 failures in the last 7 days on

• debug: linux64, osx-10-10, windows10-64,windows7-32,
• opt: linux64, linux64-shippable, osx-10-10-shippable, windows7-32, windows7-32-shippable

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=241070803&repo=mozilla-inbound&lineNumber=8018

00:07:38 INFO - TEST-START | browser/components/preferences/in-content/tests/browser_contentblocking.js
00:07:39 INFO - GECKO(3428) | JavaScript warning: chrome://global/content/elements/tree.js, line 493: Array.forEach is deprecated; use Array.prototype.forEach instead
00:07:39 INFO - GECKO(3428) | JavaScript warning: chrome://global/content/elements/tree.js, line 493: Array.forEach is deprecated; use Array.prototype.forEach instead
00:07:39 INFO - TEST-INFO | started process screenshot
00:07:39 INFO - TEST-INFO | screenshot: exit 0

00:07:39 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | #changeBlockListLink is enabled. -
00:07:39 INFO - Buffered messages finished
00:07:39 INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_contentblocking.js | The checkbox should now be unchecked - Got false, expected true
00:07:39 INFO - Stack trace:
00:07:39 INFO - chrome://mochikit/content/browser-test.js:test_is:1325
00:07:39 INFO - chrome://mochitests/content/browser/browser/components/preferences/in-content/tests/browser_contentblocking.js:testContentBlockingMainCategory:132
00:07:39 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1116
00:07:39 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1144
00:07:39 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1000
00:07:39 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
00:07:39 INFO - Not taking screenshot here: see the one that was previously logged
00:07:39 INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Only in private windows item should be selected by default, when the checkbox is checked - Got false, expected true
00:07:39 INFO - Stack trace:
00:07:39 INFO - chrome://mochikit/content/browser-test.js:test_is:1325
00:07:39 INFO - chrome://mochitests/content/browser/browser/components/preferences/in-content/tests/browser_contentblocking.js:testContentBlockingMainCategory:133
00:07:39 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1116
00:07:39 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1144
00:07:39 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1000
00:07:39 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
00:07:39 INFO - TEST-PASS | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Always item should no longer be selected -
00:07:39 INFO - Not taking screenshot here: see the one that was previously logged
00:07:39 INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_contentblocking.js | The checkbox should now be unchecked - Got true, expected false
00:07:39 INFO - Stack trace:
00:07:39 INFO - chrome://mochikit/content/browser-test.js:test_is:1325
00:07:39 INFO - chrome://mochitests/content/browser/browser/components/preferences/in-content/tests/browser_contentblocking.js:testContentBlockingMainCategory:132
00:07:39 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1116
00:07:39 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1144
00:07:39 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1000
00:07:39 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
00:07:39 INFO - Not taking screenshot here: see the one that was previously logged
00:07:39 INFO - TEST-UNEXPECTED-FAIL | browser/components/preferences/in-content/tests/browser_contentblocking.js | The Only in private windows item should be selected by default, when the checkbox is checked - Got true, expected false

Comment 18

[Cristina Coroiu [:ccoroiu]]

No new failures since 17th of April

Comment 19

[Intermittent Failures Robot]

52 failures in 2673 pushes (0.019 failures/push) were associated with this bug in the last 7 days.

This is the #45 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 16
• mozilla-central: 20
• mozilla-inbound: 16

Platform breakdown:

• linux64: 8
• osx-10-10: 6
• windows7-32: 8
• windows10-64: 8
• osx-10-10-shippable: 6
• linux64-shippable: 5
• windows7-32-shippable: 5
• windows10-64-shippable: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-04-15&endday=2019-04-21&tree=all

Comment 20

[Intermittent Failures Robot]

27 failures in 521 pushes (0.052 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 8
• mozilla-central: 11
• mozilla-inbound: 8

Platform breakdown:

• linux64: 4
• osx-10-10: 3
• windows7-32: 4
• osx-10-10-shippable: 3
• windows10-64: 4
• linux64-shippable: 3
• windows7-32-shippable: 3
• windows10-64-shippable: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-04-24&endday=2019-04-24&tree=all

Comment 21

[Intermittent Failures Robot]

27 failures in 577 pushes (0.047 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 8
• mozilla-central: 11
• mozilla-inbound: 8

Platform breakdown:

• linux64: 4
• osx-10-10: 3
• windows7-32: 4
• windows10-64: 4
• osx-10-10-shippable: 3
• windows7-32-shippable: 3
• windows10-64-shippable: 3
• linux64-shippable: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-04-25&endday=2019-04-25&tree=all

Comment 22

[Andreea Pavel [:apavel]]

Erica, this has spiked again since bug 1545074 landed. Can you please take a look?

https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?startday=2019-04-19&endday=2019-04-26&tree=trunk&bug=1531920

Comment 23

[Intermittent Failures Robot]

54 failures in 3031 pushes (0.018 failures/push) were associated with this bug in the last 7 days.

This is the #42 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 16
• mozilla-central: 22
• mozilla-inbound: 16

Platform breakdown:

• linux64: 8
• osx-10-10: 6
• windows7-32: 8
• osx-10-10-shippable: 6
• windows10-64: 8
• linux64-shippable: 6
• windows7-32-shippable: 6
• windows10-64-shippable: 6

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-04-22&endday=2019-04-28&tree=all

Comment 24

[(no longer active)]

This is really a perma failure. I have a fix.

Comment 25

[(no longer active)]

Attachment: Bug 1531920 - Unlock our prefs while cleaning up;

Comment 26

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/264bdfcb9ebb
Unlock our prefs while cleaning up; r=ewright

Comment 27

[Bogdan Tara[:bogdan_tara | bogdant]]

Backed out changeset 264bdfcb9ebb (Bug 1531920) for ES lint failure on browser_contentblocking.js

Push with failure: https://treeherder.mozilla.org/#/jobs?repo=autoland&searchStr=linting%2Copt%2Csource-test-mozlint-eslint%2C%28es%29&tochange=d04770626762fde018a9aba13cbc1a8568147b3d&fromchange=40dad5764be780d7f1cae6e79075923386bd82f5&selectedJob=245153418

Backout link: https://hg.mozilla.org/integration/autoland/rev/d04770626762fde018a9aba13cbc1a8568147b3d

Failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=245153418&repo=autoland&lineNumber=303

[vcs 2019-05-07T16:46:40.330Z] TinderboxPrint:<a href=https://us-west-2.hgmointernal.net/integration/autoland/rev/264bdfcb9ebb54017a4abc88b870def85e486de8 title='Built from autoland revision 264bdfcb9ebb54017a4abc88b870def85e486de8'>264bdfcb9ebb54017a4abc88b870def85e486de8</a>
[task 2019-05-07T16:46:40.330Z] executing ['bash', '-cx', 'cd /builds/worker/checkouts/gecko/ && cp -r /build/node_modules_eslint node_modules && ln -s ../tools/lint/eslint/eslint-plugin-mozilla node_modules && ln -s ../tools/lint/eslint/eslint-plugin-spidermonkey-js node_modules && ./mach lint -l eslint -f treeherder --quiet -f json:/builds/worker/mozlint.json\n']
[task 2019-05-07T16:46:40.341Z] + cd /builds/worker/checkouts/gecko/
[task 2019-05-07T16:46:40.341Z] + cp -r /build/node_modules_eslint node_modules
[task 2019-05-07T16:46:41.841Z] + ln -s ../tools/lint/eslint/eslint-plugin-mozilla node_modules
[task 2019-05-07T16:46:41.843Z] + ln -s ../tools/lint/eslint/eslint-plugin-spidermonkey-js node_modules
[task 2019-05-07T16:46:41.844Z] + ./mach lint -l eslint -f treeherder --quiet -f json:/builds/worker/mozlint.json
[task 2019-05-07T16:46:42.930Z] New python executable in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/init/bin/python2.7
[task 2019-05-07T16:46:42.930Z] Also creating executable in /builds/worker/checkouts/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/init/bin/python
[task 2019-05-07T16:46:44.866Z] Installing setuptools, pip, wheel...done.
[task 2019-05-07T16:46:46.201Z] running build_ext
[task 2019-05-07T16:46:46.201Z] building 'psutil._psutil_linux' extension
[task 2019-05-07T16:46:46.201Z] creating build
[task 2019-05-07T16:46:46.201Z] creating build/temp.linux-x86_64-2.7
[task 2019-05-07T16:46:46.201Z] creating build/temp.linux-x86_64-2.7/psutil
[task 2019-05-07T16:46:46.201Z] x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fno-strict-aliasing -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_VERSION=543 -DPSUTIL_LINUX=1 -I/usr/include/python2.7 -c psutil/_psutil_common.c -o build/temp.linux-x86_64-2.7/psutil/_psutil_common.o
[task 2019-05-07T16:46:46.201Z] x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fno-strict-aliasing -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_VERSION=543 -DPSUTIL_LINUX=1 -I/usr/include/python2.7 -c psutil/_psutil_posix.c -o build/temp.linux-x86_64-2.7/psutil/_psutil_posix.o
[task 2019-05-07T16:46:46.201Z] x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fno-strict-aliasing -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_VERSION=543 -DPSUTIL_LINUX=1 -I/usr/include/python2.7 -c psutil/_psutil_linux.c -o build/temp.linux-x86_64-2.7/psutil/_psutil_linux.o
[task 2019-05-07T16:46:46.201Z] creating build/lib.linux-x86_64-2.7
[task 2019-05-07T16:46:46.201Z] creating build/lib.linux-x86_64-2.7/psutil
[task 2019-05-07T16:46:46.201Z] x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wl,-Bsymbolic-functions -Wl,-z,relro -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/psutil/_psutil_common.o build/temp.linux-x86_64-2.7/psutil/_psutil_posix.o build/temp.linux-x86_64-2.7/psutil/_psutil_linux.o -o build/lib.linux-x86_64-2.7/psutil/_psutil_linux.so
[task 2019-05-07T16:46:46.201Z] building 'psutil._psutil_posix' extension
[task 2019-05-07T16:46:46.201Z] x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fno-strict-aliasing -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_VERSION=543 -DPSUTIL_LINUX=1 -I/usr/include/python2.7 -c psutil/_psutil_common.c -o build/temp.linux-x86_64-2.7/psutil/_psutil_common.o
[task 2019-05-07T16:46:46.201Z] x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fno-strict-aliasing -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_VERSION=543 -DPSUTIL_LINUX=1 -I/usr/include/python2.7 -c psutil/_psutil_posix.c -o build/temp.linux-x86_64-2.7/psutil/_psutil_posix.o
[task 2019-05-07T16:46:46.201Z] x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wl,-Bsymbolic-functions -Wl,-z,relro -Wdate-time -D_FORTIFY_SOURCE=2 -g -fstack-protector-strong -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/psutil/_psutil_common.o build/temp.linux-x86_64-2.7/psutil/_psutil_posix.o -o build/lib.linux-x86_64-2.7/psutil/_psutil_posix.so
[task 2019-05-07T16:46:46.201Z] copying build/lib.linux-x86_64-2.7/psutil/_psutil_linux.so -> psutil
[task 2019-05-07T16:46:46.201Z] copying build/lib.linux-x86_64-2.7/psutil/_psutil_posix.so -> psutil
[task 2019-05-07T16:46:46.201Z]
[task 2019-05-07T16:46:46.201Z] Error processing command. Ignoring because optional. (optional:packages.txt:comm/build/virtualenv_packages.txt)
[task 2019-05-07T16:54:01.630Z] TEST-UNEXPECTED-ERROR | /builds/worker/checkouts/gecko/browser/components/preferences/in-content/tests/browser_contentblocking.js:471:1 | Unexpected tab character. (no-tabs)
[task 2019-05-07T16:54:01.630Z] TEST-UNEXPECTED-ERROR | /builds/worker/checkouts/gecko/browser/components/preferences/in-content/tests/browser_contentblocking.js:471:2 | Mixed spaces and tabs. (no-mixed-spaces-and-tabs)
[task 2019-05-07T16:54:01.630Z] TEST-UNEXPECTED-ERROR | /builds/worker/checkouts/gecko/browser/components/preferences/in-content/tests/browser_contentblocking.js:472:1 | Unexpected tab character. (no-tabs)
[taskcluster 2019-05-07 16:54:01.991Z] === Task Finished ===
[taskcluster 2019-05-07 16:54:02.891Z] Unsuccessful task run with exit code: 1 completed in 728.026 seconds

Comment 28

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/4bbf8907a6d8
Unlock our prefs while cleaning up; r=ewright

Comment 29

[Natalia Csoregi [:nataliaCs]]

https://hg.mozilla.org/mozilla-central/rev/4bbf8907a6d8

Comment 30

[:Felipe Gomes (needinfo for replies!)]

This was supposed to happen automatically. The PoliciesPrefTracker a few lines below [1] is watching all prefs changed by policies (through the functions setDefaultPref or setAndLockPref from Policies.jsm) and is attempting to reset and unlock all of them when .stop() is called [2].

Might be worth investigating why that is not case.

[1] https://hg.mozilla.org/mozilla-central/file/4bbf8907a6d8c2b7b689f83b55c5ccd892f19cfc/browser/components/preferences/in-content/tests/browser_contentblocking.js#l480

[2] https://searchfox.org/mozilla-central/rev/6d2cd4ea8b86e19ad16b1dd0b3d736d1e523e854/toolkit/components/enterprisepolicies/tests/EnterprisePolicyTesting.jsm#138

Comment 31

[Intermittent Failures Robot]

8 failures in 4705 pushes (0.002 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• autoland: 8

Platform breakdown:

• osx-10-10: 1
• linux64: 1
• windows10-64: 1
• windows7-32: 1
• linux64-shippable: 1
• osx-10-10-shippable: 1
• windows7-32-shippable: 1
• windows10-64-shippable: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1531920&startday=2019-05-06&endday=2019-05-12&tree=all