1483648 - Permafailing test-verify browser/base/content/test/permissions/browser_autoplay_blocked.js | Blocked icon is shown -

Status: RESOLVED FIXED

(Firefox :: Site Identity, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: ncsoregi [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=194131385&repo=autoland

https://queue.taskcluster.net/v1/task/TY-EfI-gTM-A30iSNBhmTA/runs/0/artifacts/public/logs/live_backing.log

[task 2018-08-15T18:34:14.654Z] 18:34:14     INFO - TEST-PASS | browser/base/content/test/permissions/browser_autoplay_blocked.js | Blocked icon not shown - 
[task 2018-08-15T18:34:14.654Z] 18:34:14     INFO - TEST-PASS | browser/base/content/test/permissions/browser_autoplay_blocked.js | List of permissions is empty - 
[task 2018-08-15T18:34:14.655Z] 18:34:14     INFO - Buffered messages finished
[task 2018-08-15T18:34:14.655Z] 18:34:14     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/permissions/browser_autoplay_blocked.js | Blocked icon is shown - 
[task 2018-08-15T18:34:14.655Z] 18:34:14     INFO - Stack trace:
[task 2018-08-15T18:34:14.655Z] 18:34:14     INFO - chrome://mochitests/content/browser/browser/base/content/test/permissions/browser_autoplay_blocked.js:testMainViewVisible/<:45
[task 2018-08-15T18:34:14.656Z] 18:34:14     INFO - resource://testing-common/BrowserTestUtils.jsm:withNewTab:108
[task 2018-08-15T18:34:14.656Z] 18:34:14     INFO - chrome://mochitests/content/browser/browser/base/content/test/permissions/browser_autoplay_blocked.js:testMainViewVisible:41
[task 2018-08-15T18:34:14.656Z] 18:34:14     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
[task 2018-08-15T18:34:14.657Z] 18:34:14     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1097
[task 2018-08-15T18:34:14.658Z] 18:34:14     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:994
[task 2018-08-15T18:34:14.658Z] 18:34:14     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:795
[task 2018-08-15T18:34:14.663Z] 18:34:14     INFO - Not taking screenshot here: see the one that was previously logged
[task 2018-08-15T18:34:14.665Z] 18:34:14     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/permissions/browser_autoplay_blocked.js | List of permissions is not empty - 
[task 2018-08-15T18:34:14.666Z] 18:34:14     INFO - Stack trace:
[task 2018-08-15T18:34:14.666Z] 18:34:14     INFO - chrome://mochitests/content/browser/browser/base/content/test/permissions/browser_autoplay_blocked.js:testMainViewVisible/<:48
[task 2018-08-15T18:34:14.667Z] 18:34:14     INFO - resource://testing-common/BrowserTestUtils.jsm:withNewTab:108
[task 2018-08-15T18:34:14.668Z] 18:34:14     INFO - chrome://mochitests/content/browser/browser/base/content/test/permissions/browser_autoplay_blocked.js:testMainViewVisible:41
[task 2018-08-15T18:34:14.668Z] 18:34:14     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest/<:1106
[task 2018-08-15T18:34:14.670Z] 18:34:14     INFO - chrome://mochikit/content/browser-test.js:Tester_execTest:1097
[task 2018-08-15T18:34:14.670Z] 18:34:14     INFO - chrome://mochikit/content/browser-test.js:nextTest/<:994
[task 2018-08-15T18:34:14.671Z] 18:34:14     INFO - chrome://mochikit/content/tests/SimpleTest/SimpleTest.js:SimpleTest.waitForFocus/waitForFocusInner/focusedOrLoaded/<:795
[task 2018-08-15T18:34:14.672Z] 18:34:14     INFO - Not taking screenshot here: see the one that was previously logged
[task 2018-08-15T18:34:14.673Z] 18:34:14     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/permissions/browser_autoplay_blocked.js | One permission visible in main view - Got 0, expected 1

Comment 1

[Dale Harvey (:daleharvey)]

Hrm, is there any way for it to be possible that this is using an artifact build? I have those exact failures when I pushed to try and it wronly picked up that I was using an artifact build, but a full build is passing those tests for me

I also pushed this to try before landing and this failure was not on there https://treeherder.mozilla.org/#/jobs?repo=try&revision=0bc9594227b57682f12620c0267df55b4beace6a

Comment 2

[Dale Harvey (:daleharvey)]

So weirdly this is only failing on linux64 debug builds - https://treeherder.mozilla.org/#/jobs?repo=autoland&revision=1cee6e0d07e7aaf3a152d2eb15e2114937ce4151&filter-searchStr=verify&selectedJob=194111361

Comment 3

[Dale Harvey (:daleharvey)]

Took a look into this, Aryx gave me https://sql.telemetry.mozilla.org/queries/58492#151778 which shows it failed 3 seperate times during TV runs on autoland + inbound, hasnt failed a TV on central and passed TV runs @ https://treeherder.mozilla.org/#/jobs?repo=try&revision=17f6db95f3d0d824bb9641a97a97d2f0e78175ad and havent been able to reproduce locally.

There isnt an obvious problem with the code, and given the low rate of failure will close this out.

Comment 4

[Intermittent Failures Robot]

3 failures in 2672 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* autoland: 2
* mozilla-inbound: 1

Platform breakdown:
* linux64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1483648&startday=2018-08-13&endday=2018-08-19&tree=all

Comment 5

[Natalia Csoregi [:nataliaCs]]

https://treeherder.mozilla.org/logviewer.html#?job_id=198084818&repo=autoland&lineNumber=37716

Comment 6

[Intermittent Failures Robot]

2 failures in 2667 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:
* mozilla-central: 1
* autoland: 1

Platform breakdown:
* linux64: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1483648&startday=2018-09-03&endday=2018-09-09&tree=all

Comment 7

[Dale Harvey (:daleharvey)]

Attachment: 0001-Bug-1483648-Skip-failing-test-on-linux-debug-builds..patch

So this is only failing on linux64 debug builds, seems to go in and out of intermittency, I cant see anything in the logs to indicate whats up nor reproduce locally. Also I can see other tests around here need to skip this particular configuration (https://dxr.mozilla.org/mozilla-central/source/browser/base/content/test/popupNotifications/browser.ini#6), so I think we just need to skip here

Comment 8

[Johann Hofmann [:johannh]]

Comment on attachment 9008710 [details] [diff] [review]
0001-Bug-1483648-Skip-failing-test-on-linux-debug-builds..patch

Review of attachment 9008710 [details] [diff] [review]:
-----------------------------------------------------------------

From what I can tell you want to skip only on verify

skip-if = verify && os == 'linux' && debug

Comment 9

[Dale Harvey (:daleharvey)]

Attachment: 0001-Bug-1483648-Skip-failing-test-on-linux-debug-builds..patch

Yeh you are right its only verify that seems to be failing

Comment 10

[Johann Hofmann [:johannh]]

Comment on attachment 9008759 [details] [diff] [review]
0001-Bug-1483648-Skip-failing-test-on-linux-debug-builds..patch

Review of attachment 9008759 [details] [diff] [review]:
-----------------------------------------------------------------

Thanks!

Comment 11

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/28137b2b3007
Skip failing test on linux debug builds. r=johannh

Comment 12

[Noemi Erli[:noemi_erli]]

https://hg.mozilla.org/mozilla-central/rev/28137b2b3007