1544595 - Intermittent browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js | report breakage button has the correct visibility - Got false, expected true

Status: RESOLVED FIXED

(Firefox :: Protections UI, defect, P5)

Description

[Treeherder Bug Filer]

#[markdown(off)]
Filed by: dvarga [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=240459703&repo=autoland

https://queue.taskcluster.net/v1/task/FnHlp_b8TiKbyZok6djMRQ/runs/0/artifacts/public/logs/live_backing.log

[task 2019-04-15T21:33:54.605Z] 21:33:54 INFO - TEST-PASS | browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js | report breakage button has the correct visibility -
[task 2019-04-15T21:33:54.606Z] 21:33:54 INFO - TEST-PASS | browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js | report breakage button has the correct visibility -
[task 2019-04-15T21:33:54.607Z] 21:33:54 INFO - Buffered messages logged at 21:33:53
[task 2019-04-15T21:33:54.608Z] 21:33:54 INFO - Console message: [JavaScript Error: "The character encoding of the plain text document was not declared. The document will render with garbled text in some browser configurations if the document contains characters from outside the US-ASCII range. The character encoding of the file needs to be declared in the transfer protocol or file needs to use a byte order mark as an encoding signature." {file: "http://trackertest.org/browser/browser/base/content/test/trackingUI/cookieServer.sjs" line: 0}]
[task 2019-04-15T21:33:54.609Z] 21:33:54 INFO - Console message: [JavaScript Warning: "Request to access cookie or storage on “http://trackertest.org/browser/browser/base/content/test/trackingUI/cookieServer.sjs” was blocked because it came from a tracker and content blocking is enabled." {file: "http://not-tracking.example.com/browser/browser/base/content/test/trackingUI/cookiePage.html" line: 0}]
[task 2019-04-15T21:33:54.611Z] 21:33:54 INFO - Console message: [JavaScript Warning: "Request to access cookie or storage on “http://trackertest.org/browser/browser/base/content/test/trackingUI/cookieServer.sjs” was blocked because it came from a tracker and content blocking is enabled." {file: "http://not-tracking.example.com/browser/browser/base/content/test/trackingUI/cookiePage.html" line: 0}]
[task 2019-04-15T21:33:54.613Z] 21:33:54 INFO - Console message: [JavaScript Warning: "Request to access cookie or storage on “http://trackertest.org/browser/browser/base/content/test/trackingUI/cookieServer.sjs” was blocked because it came from a tracker and content blocking is enabled." {file: "http://not-tracking.example.com/browser/browser/base/content/test/trackingUI/cookiePage.html" line: 0}]
[task 2019-04-15T21:33:54.614Z] 21:33:54 INFO - Buffered messages finished
[task 2019-04-15T21:33:54.617Z] 21:33:54 INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js | report breakage button has the correct visibility - Got false, expected true
[task 2019-04-15T21:33:54.618Z] 21:33:54 INFO - Stack trace:
[task 2019-04-15T21:33:54.619Z] 21:33:54 INFO - chrome://mochikit/content/browser-test.js:test_is:1325
[task 2019-04-15T21:33:54.621Z] 21:33:54 INFO - chrome://mochitests/content/browser/browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js:testReportBreakageVisibility/<:114
[task 2019-04-15T21:33:54.622Z] 21:33:54 INFO - resource://testing-common/BrowserTestUtils.jsm:withNewTab:111
[task 2019-04-15T21:33:54.622Z] 21:33:54 INFO - chrome://mochitests/content/browser/browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js:testReportBreakageVisibility:110
[task 2019-04-15T21:33:54.622Z] 21:33:54 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1116
[task 2019-04-15T21:33:54.623Z] 21:33:54 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1144
[task 2019-04-15T21:33:54.623Z] 21:33:54 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1000
[task 2019-04-15T21:33:54.624Z] 21:33:54 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
[task 2019-04-15T21:33:54.625Z] 21:33:54 INFO - Leaving test bound testReportBreakageVisibility
[task 2019-04-15T21:33:54.627Z] 21:33:54 INFO - Entering test bound testReportBreakageCancel

Comment 1

[Intermittent Failures Robot]

33 failures in 607 pushes (0.054 failures/push) were associated with this bug yesterday.

Repository breakdown:

• mozilla-central: 7
• mozilla-inbound: 8
• autoland: 15
• try: 3

Platform breakdown:

• linux64: 20
• osx-10-10: 2
• windows10-64: 2
• windows7-32: 1
• osx-10-10-shippable: 2
• linux64-shippable: 2
• linux32: 4

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1544595&startday=2019-04-16&endday=2019-04-16&tree=all

Comment 2

[Andreea Pavel [:apavel]]

This is from when bug 1540416 landed.

Johann can you take a look?

There are 55 total failures in the last 7 days on

• debug: linux32, osx-10-10, windows10-64, windows7-32
• asan: linux64, windows10-64
• opt: linux64-shippable, osx-10-10-shippable

Recent failure log: https://treeherder.mozilla.org/logviewer.html#/jobs?job_id=241261319&repo=autoland&lineNumber=2454

21:28:09 INFO - TEST-START | browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js
21:28:13 INFO - TEST-INFO | started process screenshot
21:28:13 INFO - TEST-INFO | screenshot: exit 0
21:28:13 INFO - Buffered messages logged at 21:28:09
21:28:13 INFO - Entering test bound setup
21:28:13 INFO - Buffered messages logged at 21:28:10
21:28:13 INFO - Leaving test bound setup
21:28:13 INFO - Entering test bound testReportBreakageVisibility
21:28:13 INFO - Console message: [JavaScript Warning: "The resource at “http://trackertest.org/” was blocked because content blocking is enabled." {file: "http://tracking.example.org/browser/browser/base/content/test/trackingUI/trackingPage.html" line: 0}]
21:28:13 INFO - TEST-PASS | browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js | report breakage button has the correct visibility -
21:28:13 INFO - Console message: [JavaScript Warning: "The resource at “http://trackertest.org/” was blocked because content blocking is enabled." {file: "http://tracking.example.org/browser/browser/base/content/test/trackingUI/trackingPage.html" line: 0}]
21:28:13 INFO - Buffered messages logged at 21:28:11
21:28:13 INFO - TEST-PASS | browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js | report breakage button has the correct visibility -
21:28:13 INFO - Console message: [JavaScript Warning: "The resource at “http://trackertest.org/” was blocked because content blocking is enabled." {file: "http://tracking.example.org/browser/browser/base/content/test/trackingUI/trackingPage.html" line: 0}]
21:28:13 INFO - TEST-PASS | browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js | report breakage button has the correct visibility -
21:28:13 INFO - Buffered messages logged at 21:28:12
21:28:13 INFO - TEST-PASS | browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js | report breakage button has the correct visibility -
21:28:13 INFO - Console message: [JavaScript Error: "The character encoding of the plain text document was not declared. The document will render with garbled text in some browser configurations if the document contains characters from outside the US-ASCII range. The character encoding of the file needs to be declared in the transfer protocol or file needs to use a byte order mark as an encoding signature." {file: "http://trackertest.org/browser/browser/base/content/test/trackingUI/cookieServer.sjs" line: 0}]
21:28:13 INFO - Buffered messages logged at 21:28:13
21:28:13 INFO - Console message: [JavaScript Warning: "Request to access cookie or storage on “http://trackertest.org/browser/browser/base/content/test/trackingUI/cookieServer.sjs” was blocked because it came from a tracker and content blocking is enabled." {file: "http://not-tracking.example.com/browser/browser/base/content/test/trackingUI/cookiePage.html" line: 0}]
21:28:13 INFO - Console message: [JavaScript Warning: "Request to access cookie or storage on “http://trackertest.org/browser/browser/base/content/test/trackingUI/cookieServer.sjs” was blocked because it came from a tracker and content blocking is enabled." {file: "http://not-tracking.example.com/browser/browser/base/content/test/trackingUI/cookiePage.html" line: 0}]
21:28:13 INFO - Console message: [JavaScript Warning: "Request to access cookie or storage on “http://trackertest.org/browser/browser/base/content/test/trackingUI/cookieServer.sjs” was blocked because it came from a tracker and content blocking is enabled." {file: "http://not-tracking.example.com/browser/browser/base/content/test/trackingUI/cookiePage.html" line: 0}]
21:28:13 INFO - Buffered messages finished
21:28:13 INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js | report breakage button has the correct visibility - Got false, expected true
21:28:13 INFO - Stack trace:
21:28:13 INFO - chrome://mochikit/content/browser-test.js:test_is:1325
21:28:13 INFO - chrome://mochitests/content/browser/browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js:testReportBreakageVisibility/<:114
21:28:13 INFO - resource://testing-common/BrowserTestUtils.jsm:withNewTab:111
21:28:13 INFO - chrome://mochitests/content/browser/browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js:testReportBreakageVisibility:110
21:28:13 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1116
21:28:13 INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1144
21:28:13 INFO - chrome://mochikit/content/browser-test.js:nextTest/<:1005
21:28:13 INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:803
21:28:13 INFO - Leaving test bound testReportBreakageVisibility
21:28:13 INFO - Entering test bound testReportBreakageCancel
21:28:13 INFO - Console message: [JavaScript Warning: "The resource at “http://trackertest.org/” was blocked because content blocking is enabled." {file: "http://tracking.example.org/browser/browser/base/content/test/trackingUI/trackingPage.html" line: 0}]
21:28:13 INFO - TEST-PASS | browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js | report breakage button is visible -
21:28:14 INFO - TEST-PASS | browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js | recorded telemetry for the click -
21:28:14 INFO - TEST-PASS | browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js | Report breakage view was shown -
21:28:14 INFO - TEST-PASS | browser/base/content/test/trackingUI/browser_trackingUI_report_breakage.js | Main view was shown -
21:28:14 INFO - Leaving test bound testReportBreakageCancel

Comment 3

[Intermittent Failures Robot]

87 failures in 2673 pushes (0.033 failures/push) were associated with this bug in the last 7 days.

This is the #22 most frequent failure this week.

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **

Repository breakdown:

• autoland: 51
• mozilla-central: 11
• mozilla-inbound: 17
• try: 8

Platform breakdown:

• linux64: 62
• osx-10-10: 4
• windows10-64: 5
• osx-10-10-shippable: 3
• windows7-32: 2
• linux64-shippable: 3
• linux32: 8

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1544595&startday=2019-04-15&endday=2019-04-21&tree=all

Comment 4

[Intermittent Failures Robot]

35 failures in 499 pushes (0.07 failures/push) were associated with this bug yesterday.

Repository breakdown:

• autoland: 13
• try: 5
• mozilla-inbound: 9
• mozilla-central: 8

Platform breakdown:

• linux64: 17
• linux32: 2
• windows10-64: 4
• osx-10-10: 4
• windows7-32: 3
• linux64-shippable: 3
• osx-10-10-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1544595&startday=2019-04-23&endday=2019-04-23&tree=all

Comment 5

[Johann Hofmann [:johannh]]

Attachment: Bug 1544595 - Wait for report breakage button visibility in browser_trackingUI_report_breakage.js. r=ewright

We made changes to change the visibility of this button whenever the panel is opened, so
more lazily. I think this caused some intermittents where the assertion was runinng before
the hide/show code executed.

Comment 6

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/347e8f171413
Wait for report breakage button visibility in browser_trackingUI_report_breakage.js. r=ewright

Comment 7

[Bogdan Tara[:bogdan_tara | bogdant]]

https://hg.mozilla.org/mozilla-central/rev/347e8f171413

Comment 8

[Intermittent Failures Robot]

56 failures in 3031 pushes (0.018 failures/push) were associated with this bug in the last 7 days.

This is the #40 most frequent failure this week.

** This failure happened more than 30 times this week! Resolving this bug is a high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Repository breakdown:

• mozilla-inbound: 14
• autoland: 26
• mozilla-central: 10
• try: 6

Platform breakdown:

• linux64: 34
• linux32: 6
• windows10-64: 4
• osx-10-10: 4
• windows7-32: 3
• linux64-shippable: 3
• osx-10-10-shippable: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1544595&startday=2019-04-22&endday=2019-04-28&tree=all

Comment 9

[Intermittent Failures Robot]

1 failures in 4131 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• try: 1

Platform breakdown:

• linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1544595&startday=2019-04-29&endday=2019-05-05&tree=all