Open Bug 1332646 Opened 7 years ago Updated 2 years ago

Intermittent browser/base/content/test/popupNotifications/browser_popupNotification_5.js | Test timed out -

Categories

(Firefox :: Site Identity, defect, P3)

Product:
Firefox
Component:
Site Identity
Type:
defect

Tracking

()

Iteration:
55.2 - Apr 3
Tracking Flags:
Tracking Status
firefox52 --- unaffected
firefox-esr52 --- unaffected
firefox53 --- disabled
firefox54 --- disabled
firefox55 --- disabled

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure, leave-open, Whiteboard: [stockwell disabled] [fxprivacy] [triage])

Attachments

(2 files)

disable the test temporarily
1.27 KB, patch
gbrown
: review+
Details | Diff | Splinter Review
Bug 1332646 - Ensure we start waiting for a load before initiating one in popup notifications tests.
59 bytes, text/x-review-board-request
Details 
this is from bug 1344686, but that is a security bug so I cannot associate it with this :(

the failures look to be spread across all OS flavors, mostly on opt and a mix of e10s/non-e10s.


here is a clip from a recent linux32 opt log:
[task 2017-03-10T13:05:26.401324Z] 13:05:26     INFO - TEST-START | browser/base/content/test/popupNotifications/browser_popupNotification_5.js
[task 2017-03-10T13:05:30.783665Z] 13:05:30     INFO - JavaScript error: resource://gre/modules/commonjs/toolkit/loader.js -> resource://devtools/client/jsonview/converter-sniffer.js, line 68: NS_ERROR_NOT_AVAILABLE: Component returned failure code: 0x80040111 (NS_ERROR_NOT_AVAILABLE) [nsIChannel.contentType]
[task 2017-03-10T13:06:11.497812Z] 13:06:11     INFO - TEST-INFO | started process screentopng
[task 2017-03-10T13:06:12.924129Z] 13:06:12     INFO - TEST-INFO | screentopng: exit 0
[task 2017-03-10T13:06:12.928667Z] 13:06:12     INFO - <snipped 26 output lines - if you need more context, please use SimpleTest.requestCompleteLog() in your test>
[task 2017-03-10T13:06:12.932023Z] 13:06:12     INFO - Buffered messages logged at 13:05:27
[task 2017-03-10T13:06:12.934004Z] 13:06:12     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | secondary action label matches - 
[task 2017-03-10T13:06:12.936061Z] 13:06:12     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | secondary action accesskey matches - 
[task 2017-03-10T13:06:12.940200Z] 13:06:12     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | number of extra secondary actions matches - 
[task 2017-03-10T13:06:12.942027Z] 13:06:12     INFO - [Test#1] popup hidden
[task 2017-03-10T13:06:12.944349Z] 13:06:12     INFO - [Test#2] added listeners; panel is open: false
[task 2017-03-10T13:06:12.946346Z] 13:06:12     INFO - [Test#2] running test
[task 2017-03-10T13:06:12.948633Z] 13:06:12     INFO - Showing notification test-notification-Test#2_1
[task 2017-03-10T13:06:12.950635Z] 13:06:12     INFO - Showing notification test-notification-Test#2_2
[task 2017-03-10T13:06:12.953670Z] 13:06:12     INFO - [Test#2] popup showing
[task 2017-03-10T13:06:12.957284Z] 13:06:12     INFO - [Test#2] popup shown
[task 2017-03-10T13:06:12.959470Z] 13:06:12     INFO - Checking notification test-notification-Test#2_2
[task 2017-03-10T13:06:12.961944Z] 13:06:12     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | showing callback was triggered - 
[task 2017-03-10T13:06:12.968642Z] 13:06:12     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | shown callback was triggered - 
[task 2017-03-10T13:06:12.971038Z] 13:06:12     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | one notification displayed - 
[task 2017-03-10T13:06:12.973596Z] 13:06:12     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | message matches - 
[task 2017-03-10T13:06:12.975812Z] 13:06:12     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | id matches - 
[task 2017-03-10T13:06:12.978362Z] 13:06:12     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | main action label matches - 
[task 2017-03-10T13:06:12.980771Z] 13:06:12     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | main action accesskey matches - 
[task 2017-03-10T13:06:12.983031Z] 13:06:12     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | secondary action label matches - 
[task 2017-03-10T13:06:12.985282Z] 13:06:12     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | secondary action accesskey matches - 
[task 2017-03-10T13:06:12.987511Z] 13:06:12     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | number of extra secondary actions matches - 
[task 2017-03-10T13:06:12.989628Z] 13:06:12     INFO - [Test#2] popup hidden
[task 2017-03-10T13:06:12.992970Z] 13:06:12     INFO - [Test#3] running test
[task 2017-03-10T13:06:12.995159Z] 13:06:12     INFO - Showing notification test-notification-Test#3
[task 2017-03-10T13:06:13.004589Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | the anchor is shown - 
[task 2017-03-10T13:06:13.006617Z] 13:06:13     INFO - Buffered messages logged at 13:05:28
[task 2017-03-10T13:06:13.008460Z] 13:06:13     INFO - [Test#4] added listeners; panel is open: false
[task 2017-03-10T13:06:13.010274Z] 13:06:13     INFO - [Test#4] running test
[task 2017-03-10T13:06:13.012099Z] 13:06:13     INFO - Buffered messages logged at 13:05:29
[task 2017-03-10T13:06:13.015259Z] 13:06:13     INFO - Showing notification test-notification-Test#4
[task 2017-03-10T13:06:13.017046Z] 13:06:13     INFO - [Test#4] popup showing
[task 2017-03-10T13:06:13.020985Z] 13:06:13     INFO - [Test#4] popup shown
[task 2017-03-10T13:06:13.022773Z] 13:06:13     INFO - [Test#4] popup hidden
[task 2017-03-10T13:06:13.025479Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | Should have hidden the notification after navigation - 
[task 2017-03-10T13:06:13.031225Z] 13:06:13     INFO - [Test#5] added listeners; panel is open: false
[task 2017-03-10T13:06:13.033130Z] 13:06:13     INFO - [Test#5] running test
[task 2017-03-10T13:06:13.036090Z] 13:06:13     INFO - Buffered messages logged at 13:05:30
[task 2017-03-10T13:06:13.037918Z] 13:06:13     INFO - Showing notification test-notification-Test#5
[task 2017-03-10T13:06:13.040257Z] 13:06:13     INFO - [Test#5] popup showing
[task 2017-03-10T13:06:13.043338Z] 13:06:13     INFO - [Test#5] popup shown
[task 2017-03-10T13:06:13.045286Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | at least one notification displayed - 
[task 2017-03-10T13:06:13.047310Z] 13:06:13     INFO - Triggering secondary command for notification test-notification-Test#5-notification
[task 2017-03-10T13:06:13.052080Z] 13:06:13     INFO - [Test#5] popup hidden
[task 2017-03-10T13:06:13.054696Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | Should have hidden the notification after clicking Not Now - 
[task 2017-03-10T13:06:13.060299Z] 13:06:13     INFO - [Test#6a] added listeners; panel is open: false
[task 2017-03-10T13:06:13.062121Z] 13:06:13     INFO - [Test#6a] running test
[task 2017-03-10T13:06:13.064043Z] 13:06:13     INFO - Showing notification test-notification-Test#6a
[task 2017-03-10T13:06:13.065805Z] 13:06:13     INFO - [Test#6a] popup showing
[task 2017-03-10T13:06:13.068922Z] 13:06:13     INFO - [Test#6a] popup shown
[task 2017-03-10T13:06:13.070687Z] 13:06:13     INFO - [Test#6a] popup hidden
[task 2017-03-10T13:06:13.072783Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | Should have hidden the notification after tab switch - 
[task 2017-03-10T13:06:13.080317Z] 13:06:13     INFO - Console message: [JavaScript Error: "NS_ERROR_NOT_AVAILABLE: Component returned failure code: 0x80040111 (NS_ERROR_NOT_AVAILABLE) [nsIChannel.contentType]" {file: "resource://gre/modules/commonjs/toolkit/loader.js -> resource://devtools/client/jsonview/converter-sniffer.js" line: 68}]
[task 2017-03-10T13:06:13.082381Z] 13:06:13     INFO - [Test#6b] running test
[task 2017-03-10T13:06:13.085176Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | Should have found the notification from Test6a - 
[task 2017-03-10T13:06:13.090725Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | Should have shown the popup again after getting back to the tab - 
[task 2017-03-10T13:06:13.094166Z] 13:06:13     INFO - [Test#7] running test
[task 2017-03-10T13:06:13.096043Z] 13:06:13     INFO - Buffered messages logged at 13:05:31
[task 2017-03-10T13:06:13.097873Z] 13:06:13     INFO - Showing notification test-notification-Test#7
[task 2017-03-10T13:06:13.100001Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | Should have triggered the shown event - 
[task 2017-03-10T13:06:13.102432Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | Should have triggered the showing event - 
[task 2017-03-10T13:06:13.106675Z] 13:06:13     INFO - Buffered messages logged at 13:05:32
[task 2017-03-10T13:06:13.108753Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | no notification displayed in new window - 
[task 2017-03-10T13:06:13.111098Z] 13:06:13     INFO - Buffered messages logged at 13:05:33
[task 2017-03-10T13:06:13.120318Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | Should have found the notification from Test7 - 
[task 2017-03-10T13:06:13.122688Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | Should have kept the popup on the first window - 
[task 2017-03-10T13:06:13.124968Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | Should not have triggered a dismissed event - 
[task 2017-03-10T13:06:13.127042Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | Should not have triggered a second shown event - 
[task 2017-03-10T13:06:13.129068Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | Should not have triggered a second showing event - 
[task 2017-03-10T13:06:13.131342Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | should have updated timeShown to restart the security delay - 
[task 2017-03-10T13:06:13.138445Z] 13:06:13     INFO - [Test#8] added listeners; panel is open: false
[task 2017-03-10T13:06:13.142103Z] 13:06:13     INFO - [Test#8] running test
[task 2017-03-10T13:06:13.149296Z] 13:06:13     INFO - Showing notification test-notification-Test#8_1
[task 2017-03-10T13:06:13.151446Z] 13:06:13     INFO - Showing notification test-notification-Test#8_2
[task 2017-03-10T13:06:13.155125Z] 13:06:13     INFO - [Test#8] popup showing
[task 2017-03-10T13:06:13.157617Z] 13:06:13     INFO - [Test#8] popup shown
[task 2017-03-10T13:06:13.160593Z] 13:06:13     INFO - Checking notification test-notification-Test#8_1
[task 2017-03-10T13:06:13.162891Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | showing callback was triggered - 
[task 2017-03-10T13:06:13.170533Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | shown callback was triggered - 
[task 2017-03-10T13:06:13.172989Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | one notification displayed - 
[task 2017-03-10T13:06:13.178319Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | message matches - 
[task 2017-03-10T13:06:13.180395Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | id matches - 
[task 2017-03-10T13:06:13.182725Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | main action label matches - 
[task 2017-03-10T13:06:13.185168Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | main action accesskey matches - 
[task 2017-03-10T13:06:13.188798Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | secondary action label matches - 
[task 2017-03-10T13:06:13.192475Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | secondary action accesskey matches - 
[task 2017-03-10T13:06:13.194475Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | number of extra secondary actions matches - 
[task 2017-03-10T13:06:13.196377Z] 13:06:13     INFO - [Test#8] popup hidden
[task 2017-03-10T13:06:13.198593Z] 13:06:13     INFO - [Test#9] added listeners; panel is open: false
[task 2017-03-10T13:06:13.202204Z] 13:06:13     INFO - [Test#9] running test
[task 2017-03-10T13:06:13.204070Z] 13:06:13     INFO - Showing notification test-notification-Test#9_1
[task 2017-03-10T13:06:13.205930Z] 13:06:13     INFO - Showing notification test-notification-Test#9_2
[task 2017-03-10T13:06:13.207977Z] 13:06:13     INFO - Showing notification test-notification-Test#9_3
[task 2017-03-10T13:06:13.210665Z] 13:06:13     INFO - [Test#9] popup showing
[task 2017-03-10T13:06:13.212833Z] 13:06:13     INFO - [Test#9] popup shown
[task 2017-03-10T13:06:13.214709Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | two notifications displayed - 
[task 2017-03-10T13:06:13.218520Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | id 1 matches - 
[task 2017-03-10T13:06:13.222151Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | id 2 matches - 
[task 2017-03-10T13:06:13.224212Z] 13:06:13     INFO - Buffered messages logged at 13:05:34
[task 2017-03-10T13:06:13.226042Z] 13:06:13     INFO - [Test#9] popup hidden
[task 2017-03-10T13:06:13.228005Z] 13:06:13     INFO - [Test#10] added listeners; panel is open: false
[task 2017-03-10T13:06:13.230822Z] 13:06:13     INFO - [Test#10] running test
[task 2017-03-10T13:06:13.232694Z] 13:06:13     INFO - Showing notification test-notification-Test#10_1
[task 2017-03-10T13:06:13.235258Z] 13:06:13     INFO - Showing notification test-notification-Test#10_2
[task 2017-03-10T13:06:13.237136Z] 13:06:13     INFO - Showing notification test-notification-Test#10_3
[task 2017-03-10T13:06:13.239117Z] 13:06:13     INFO - [Test#10] popup shown
[task 2017-03-10T13:06:13.241394Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | three notifications displayed - 
[task 2017-03-10T13:06:13.244069Z] 13:06:13     INFO - [Test#10] popup showing
[task 2017-03-10T13:06:13.246315Z] 13:06:13     INFO - Buffered messages finished
[task 2017-03-10T13:06:13.248531Z] 13:06:13     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | Test timed out - 
[task 2017-03-10T13:06:13.251962Z] 13:06:13     INFO - [Test#10] popup hidden
[task 2017-03-10T13:06:13.253818Z] 13:06:13     INFO - Not taking screenshot here: see the one that was previously logged
[task 2017-03-10T13:06:13.256464Z] 13:06:13     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | two notifications displayed - Got 0, expected 2
[task 2017-03-10T13:06:13.259043Z] 13:06:13     INFO - Stack trace:
[task 2017-03-10T13:06:13.260865Z] 13:06:13     INFO - chrome://mochikit/content/browser-test.js:test_is:911
[task 2017-03-10T13:06:13.262914Z] 13:06:13     INFO - chrome://mochitests/content/browser/browser/base/content/test/popupNotifications/browser_popupNotification_5.js:onHidden:326
[task 2017-03-10T13:06:13.265242Z] 13:06:13     INFO - chrome://mochitests/content/browser/browser/base/content/test/popupNotifications/head.js:runNextTest/</<:104
[task 2017-03-10T13:06:13.268298Z] 13:06:13     INFO - resource://gre/modules/Task.jsm:asyncFunction:241
[task 2017-03-10T13:06:13.270046Z] 13:06:13     INFO - resource://gre/modules/Task.jsm:Task_spawn:166
[task 2017-03-10T13:06:13.271936Z] 13:06:13     INFO - chrome://mochitests/content/browser/browser/base/content/test/popupNotifications/head.js:runNextTest/<:104
[task 2017-03-10T13:06:13.274662Z] 13:06:13     INFO - chrome://mochitests/content/browser/browser/base/content/test/popupNotifications/head.js:onPopupEvent/listener/<:253
[task 2017-03-10T13:06:13.276507Z] 13:06:13     INFO - chrome://mochikit/content/browser-test.js:run:937
[task 2017-03-10T13:06:13.280400Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | notification 1 is persistent - 
[task 2017-03-10T13:06:13.282266Z] 13:06:13     INFO - Not taking screenshot here: see the one that was previously logged
[task 2017-03-10T13:06:13.284488Z] 13:06:13     INFO - TEST-UNEXPECTED-FAIL | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | notification 2 is not persistent - 
[task 2017-03-10T13:06:13.286101Z] 13:06:13     INFO - Stack trace:
[task 2017-03-10T13:06:13.288022Z] 13:06:13     INFO - chrome://mochitests/content/browser/browser/base/content/test/popupNotifications/browser_popupNotification_5.js:onHidden:329
[task 2017-03-10T13:06:13.291185Z] 13:06:13     INFO - chrome://mochitests/content/browser/browser/base/content/test/popupNotifications/head.js:runNextTest/</<:104
[task 2017-03-10T13:06:13.293213Z] 13:06:13     INFO - resource://gre/modules/Task.jsm:asyncFunction:241
[task 2017-03-10T13:06:13.295918Z] 13:06:13     INFO - resource://gre/modules/Task.jsm:Task_spawn:166
[task 2017-03-10T13:06:13.297853Z] 13:06:13     INFO - chrome://mochitests/content/browser/browser/base/content/test/popupNotifications/head.js:runNextTest/<:104
[task 2017-03-10T13:06:13.299788Z] 13:06:13     INFO - chrome://mochitests/content/browser/browser/base/content/test/popupNotifications/head.js:onPopupEvent/listener/<:253
[task 2017-03-10T13:06:13.304498Z] 13:06:13     INFO - chrome://mochikit/content/browser-test.js:run:937
[task 2017-03-10T13:06:13.306516Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | notification 3 is persistent - 
[task 2017-03-10T13:06:13.308482Z] 13:06:13     INFO - MEMORY STAT | vsize 739MB | residentFast 189MB | heapAllocated 79MB
[task 2017-03-10T13:06:13.312138Z] 13:06:13     INFO - TEST-OK | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | took 45420ms
[task 2017-03-10T13:06:13.316528Z] 13:06:13     INFO - checking window state
[task 2017-03-10T13:06:13.318711Z] 13:06:13     INFO - TEST-UNEXPECTED-FAIL | unknown test url | uncaught exception - ReferenceError: executeSoon is not defined at goNext/<@chrome://mochitests/content/browser/browser/base/content/test/popupNotifications/head.js:81:21
[task 2017-03-10T13:06:13.320784Z] 13:06:13     INFO - run@chrome://mochikit/content/browser-test.js:937:9
[task 2017-03-10T13:06:13.323134Z] 13:06:13     INFO - JavaScript error: chrome://mochitests/content/browser/browser/base/content/test/popupNotifications/head.js, line 81: ReferenceError: executeSoon is not defined


the log file:
https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&filter-searchStr=linux%20opt%20bc6&tochange=c10963d3a6872149f753738c265ef56b4394dda0&fromchange=ba842dcad0103677568fc81ba92c8f5b3c1e0c5f&selectedJob=83033536

the screenshot:
https://public-artifacts.taskcluster.net/ZjRJMIvSRX2JvJ1TVegliQ/0/public/test_info//mozilla-test-fail-screenshot_YPEmTp.png


:sfink, can you help us figure out why this increased with the js change?
This looks like more fallout from bug 1335751, but this one *won't* be fixed by bug 1346874 (because it is Android-only.)

Would a longer timeout or smaller chunk size be considered here?
Blocks: 1335751
Flags: needinfo?(sphink) → needinfo?(jmaher)
here is what we see on a passing run (osx opt):
03:54:04     INFO - TEST-START | browser/base/content/test/popupNotifications/browser_popupNotification_5.js
03:54:09     INFO - GECKO(2350) | MEMORY STAT | vsize 4487MB | residentFast 467MB | heapAllocated 106MB
03:54:09     INFO - TEST-OK | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | took 5125ms

and a failing run (osx opt- same revision as above) shows the same output as Comment 4.

Given that this runs in 5 seconds normally, I do not think extending the timeout will help here or changing the way this is run.  I assume we are expecting an event to happen that we are not getting (or missing somehow).

this failure rate is pretty consistent, so I want to take action on this sooner rather than later.

:sfink, Let me know if you have more thoughts.
Flags: needinfo?(jmaher) → needinfo?(sphink)
This started failing like crazy on Aurora and Beta as well yesterday, but that doesn't seem to jive with being fallout from bug 1335751?
status-firefox53: --- → affected
status-firefox54: --- → affected
status-firefox55: --- → affected
Bug 1340538 looks highly suspicious to me, FWIW. Sure fits the timing across all branches.
Flags: needinfo?(paolo.mozmail)
This is so frequent I will be disabling it come Monday if we don't have a fix close to landing.
Assignee: nobody → jmaher

        Attachment #8849041 -
        Flags: review?(gbrown)

        Attachment #8849041 -
        Flags: review?(gbrown) → review+
Whiteboard: [stockwell needswork] → [stockwell needswork] [fxprivacy] [triage]
Component: Notifications and Alerts → Site Identity and Permission Panels
Product: Toolkit → Firefox

    
    

    
  
Pushed by jmaher@mozilla.com:
https://hg.mozilla.org/integration/mozilla-inbound/rev/895956e13af4
Intermittent browser/base/content/test/popupNotifications/browser_popupNotification_5.js. disable for now. r=gbrown
Iteration: --- → 55.2 - Apr 3
Priority: -- → P1
Keywords: leave-open
Whiteboard: [stockwell needswork] [fxprivacy] [triage] → [stockwell disabled] [fxprivacy] [triage]

    
    

    
      
  

    
    

    
      
  

    
    

    
      
  

    
    

    
      
  

    
    

    
      
  

    
    

    
  
Going to take a quick look at this, needinfo'ing myself for reference.
Flags: needinfo?(nhnt11)

    
    

    
      
  


  

    
    

    
      
  

    
  
Flags: needinfo?(paolo.mozmail)

    
    

    
  
Here are the results of my investigation:

1. The patch I uploaded to MozReview should fix the failure originally reported in comment 0.
2. Since then, it seems this bug has become about a different failure, which I will exclusively be referring to below.
3. The test stops running in the middle of Test#10, with a notification visible. The test seems to try to click the close button of the notification and wait for it to be dismissed, but the click doesn't appear to work.
4. The last statement executed before the test times out seems to be https://dxr.mozilla.org/mozilla-central/rev/272ce6c2572164f5f6a9fba2a980ba9ccf50770c/browser/base/content/test/popupNotifications/browser_popupNotification_5.js#322.
5. I'm confident that:
  a. This statement is reached (the info() above is visible in the log)
  b. The UI is visible, and notifications[1].closebutton exists and should be fully functional.
     This is because when the test times out, the mouse pointer has moved above the center of the close button.
     This means that the widget is rendered and its bounds can be computed.
     Also, closebutton being a property defined in notification.xml means that the XBL binding has been applied.
6. I don't understand why the click on the closebutton doesn't seem to close the notification. The mouse has moved over the button, which means that a mousedown followed by a mouseup have been sent (https://dxr.mozilla.org/mozilla-central/rev/272ce6c2572164f5f6a9fba2a980ba9ccf50770c/testing/mochitest/tests/SimpleTest/EventUtils.js#392).
7. I could find no evidence that the code in PopupNotifications.jsm that does the actual dismissing of the popup was reached - neither _onButtonEvent nor _dismiss. However, this is the part of my investigation in which I don't have a lot of confidence, because it was in the middle of this that I stopped investigating.
8. Something to note - if you look at these three lines of the log:
> [task 2017-03-10T13:06:13.239117Z] 13:06:13     INFO - [Test#10] popup shown
> [task 2017-03-10T13:06:13.241394Z] 13:06:13     INFO - TEST-PASS | browser/base/content/test/popupNotifications/browser_popupNotification_5.js | three notifications displayed - 
> [task 2017-03-10T13:06:13.244069Z] 13:06:13     INFO - [Test#10] popup showing
You'll observe that for some reason, the popupshowing callback is called *after* the popupshown callback, which seems wrong to me. As far as I could see, the order of these events was correct in the log when the test passed. Fishy! A likely point from which to continue this investigation.

I might take another look at this, but it will not be a priority in the near future. Hopefully the information above is useful if someone else has some time to look at this.
Flags: needinfo?(nhnt11)

    
    

    
      
  
Flags: needinfo?(sphink)

    
    

    
  
Moving to p3 because no activity for at least 24 weeks.
Priority: P1 → P3
Assignee: jmaher → nobody

    
  
Severity: normal → S3

          You need to log in
          before you can comment on or make changes to this bug.
        






  

    
  







  

    

      
Attachment

      

      
      
      
      
    

    

      

        

          

            
General

            

              Creator: 



            

            
Created: 

            
Updated: 

            
Size: