1425323 - Intermittent test_refresh_firefox.py TestFirefoxRefresh.testReset | application crashed [@ mozilla::`anonymous namespace'::RunWatchdog][@ mozilla::dom::quota::QuotaManager::ShutdownObserver::Observe]

Status: RESOLVED FIXED

(Core :: DOM: Workers, defect, P2)

Description

[Treeherder Bug Filer]

Filed by: apavel [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=151662946&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/BTRbegmyRnClp7QB0TU4fg/runs/0/artifacts/public/logs/live_backing.log

16:26:36     INFO -  TEST-START | browser\components\migration\tests\marionette\test_refresh_firefox.py TestFirefoxRefresh.testReset
16:26:36     INFO -  1513268796519	Marionette	DEBUG	Accepted connection 4 from 127.0.0.1:52224
16:26:36     INFO -  1513268796520	Marionette	TRACE	4 -> [0,1,"newSession",{}]
16:26:36     INFO -  1513268796522	Marionette	DEBUG	Register listener.js for window 4294967297
16:26:36     INFO -  1513268796525	Marionette	TRACE	4 <- [1,1,null,{"sessionId":"e5a8e29a-6e37-424c-8e5e-cd915a4b0aa0","capabilities":{"browserName":"firefox","browserVersion":"59.0a ... cessID":6440,"moz:profile":"C:\\Users\\GenericWorker\\AppData\\Local\\Temp\\tmpb1tmhr.mozrunner","moz:webdriverClick":true}}]
16:26:36     INFO -  1513268796526	Marionette	TRACE	4 -> [0,2,"setTimeouts",{"script":30000}]
16:26:36     INFO -  1513268796527	Marionette	TRACE	4 <- [1,2,null,{}]
16:26:36     INFO -  1513268796528	Marionette	TRACE	4 -> [0,3,"setTimeouts",{"pageLoad":300000}]
16:26:36     INFO -  1513268796528	Marionette	TRACE	4 <- [1,3,null,{}]
16:26:36     INFO -  1513268796529	Marionette	TRACE	4 -> [0,4,"setTimeouts",{"implicit":0}]
16:26:36     INFO -  1513268796529	Marionette	TRACE	4 <- [1,4,null,{}]
16:26:36     INFO -  1513268796531	Marionette	TRACE	4 -> [0,5,"setContext",{"value":"chrome"}]
16:26:36     INFO -  1513268796531	Marionette	TRACE	4 <- [1,5,null,{}]
16:26:36     INFO -  1513268796533	Marionette	TRACE	4 -> [0,6,"executeScript",{"scriptTimeout":null,"newSandbox":false,"args":[],"filename":"test_refresh_firefox.py","script":"\n     ...  = Cu.import(\"resource://gre/modules/FormHistory.jsm\", {}).FormHistory;\n        ","sandbox":"firefox-refresh","line":441}]
16:26:36     INFO -  1513268796537	Marionette	TRACE	4 <- [1,6,null,{"value":null}]
16:26:36     INFO -  1513268796539	Marionette	TRACE	4 -> [0,7,"executeScript",{"scriptTimeout":null,"newSandbox":false,"args":[],"filename":"test_refresh_firefox.py","script":"\n     ... atch(e) {\n            return false;\n          }\n          return true;\n        ","sandbox":"firefox-refresh","line":441}]
16:26:36     INFO -  1513268796543	Marionette	TRACE	4 <- [1,7,null,{"value":true}]
16:26:36     INFO -  1513268796545	Marionette	TRACE	4 -> [0,8,"executeScript",{"scriptTimeout":null,"newSandbox":false,"args":["marionette-test-login","marionette-test-password"],"fi ...   \"password\"\n          );\n          Services.logins.addLogin(myLogin)\n        ","sandbox":"firefox-refresh","line":441}]
16:26:36     INFO -  1513268796577	Marionette	TRACE	4 <- [1,8,null,{"value":null}]
16:26:36     INFO -  1513268796579	Marionette	TRACE	4 -> [0,9,"executeScript",{"scriptTimeout":null,"newSandbox":true,"args":["about:mozilla","Some bookmark from Marionette"],"filena ... k(PlacesUtils.bookmarks.bookmarksMenuFolder,\n            makeURI(url), 0, title);\n        ","sandbox":"default","line":53}]
16:26:36     INFO -  1513268796582	Marionette	TRACE	4 <- [1,9,null,{"value":null}]
16:26:36     INFO -  1513268796583	Marionette	TRACE	4 -> [0,10,"executeScript",{"scriptTimeout":null,"newSandbox":true,"args":[],"filename":"test_refresh_firefox.py","script":"\n     ... ,\n              makeURI(`about:rights?p=${i}`), 0, `Bookmark ${i}`);\n          }\n        ","sandbox":"default","line":61}]
16:26:36     INFO -  1513268796636	Marionette	TRACE	4 <- [1,10,null,{"value":null}]
16:26:36     INFO -  1513268796638	Marionette	TRACE	4 -> [0,11,"executeAsyncScript",{"scriptTimeout":null,"sandbox":"firefox-refresh","debug_script":false,"script":"\n          // Co ... ["http://firefox-refresh.marionette-test.mozilla.org/","Test visit for Firefox Reset"],"filename":"test_refresh_firefox.py"}]
16:26:36     INFO -  1513268796641	Marionette	TRACE	4 <- [1,11,null,{"value":false}]
16:26:36     INFO -  1513268796643	Marionette	TRACE	4 -> [0,12,"executeAsyncScript",{"scriptTimeout":null,"sandbox":"firefox-refresh","debug_script":false,"script":"\n          let u ... args":["some-very-unique-marionette-only-firefox-reset-field","special-pumpkin-value"],"filename":"test_refresh_firefox.py"}]
16:26:36     INFO -  1513268796709	Marionette	TRACE	4 <- [1,12,null,{"value":false}]
16:26:36     INFO -  1513268796711	Marionette	TRACE	4 -> [0,13,"executeAsyncScript",{"scriptTimeout":null,"sandbox":"firefox-refresh","debug_script":false,"script":"\n          const ...  }).then(marionetteScriptFinished);\n        ","newSandbox":false,"line":448,"args":[],"filename":"test_refresh_firefox.py"}]
16:26:36     INFO -  1513268796727	Marionette	TRACE	4 <- [1,13,null,{"value":"d36c57e8ff9d"}]
16:26:36     INFO -  1513268796729	Marionette	TRACE	4 -> [0,14,"executeScript",{"scriptTimeout":null,"newSandbox":false,"args":["firefox-refresh.marionette-test.mozilla.org","some/co ... ents[3],\n                               true, false, false, expireTime);\n        ","sandbox":"firefox-refresh","line":441}]
16:26:36     INFO -  1513268796731	Marionette	TRACE	4 <- [1,14,null,{"value":null}]
16:26:36     INFO -  1513268796732	Marionette	TRACE	4 -> [0,15,"executeAsyncScript",{"scriptTimeout":null,"sandbox":"firefox-refresh","debug_script":false,"script":"\n          const ...   }\n        ","newSandbox":false,"line":448,"args":[["about:robots","about:mozilla"]],"filename":"test_refresh_firefox.py"}]
16:26:36     INFO -  1513268796754	Marionette	DEBUG	Register listener.js for window 16
16:26:36     INFO -  1513268796786	Marionette	DEBUG	Register listener.js for window 18
16:26:36     INFO -  1513268796991	Marionette	TRACE	4 <- [1,15,null,{"value":null}]
16:26:36     INFO -  Unable to read VR Path Registry from C:\Users\GenericWorker\AppData\Local\openvr\openvrpaths.vrpath
16:26:36     INFO -  [Parent 6440, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:26:36     INFO -  1513268796996	Marionette	DEBUG	Register listener.js for window 2147483652
16:26:37     INFO -  Unable to read VR Path Registry from C:\Users\GenericWorker\AppData\Local\openvr\openvrpaths.vrpath
16:26:37     INFO -  [Child 3384, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:26:37     INFO -  [Child 3384, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:26:37     INFO -  1513268797016	Marionette	TRACE	4 -> [0,16,"executeAsyncScript",{"scriptTimeout":null,"sandbox":"firefox-refresh","debug_script":false,"script":"\n          Cu.im ... e().then(marionetteScriptFinished);\n        ","newSandbox":false,"line":448,"args":[],"filename":"test_refresh_firefox.py"}]
16:26:37     INFO -  1513268797136	Marionette	TRACE	4 <- [1,16,null,{"value":null}]
16:26:37     INFO -  1513268797140	Marionette	TRACE	4 -> [0,17,"executeScript",{"scriptTimeout":null,"newSandbox":true,"args":[],"filename":"test_refresh_firefox.py","script":"\n     ... );\n          return ary.length ? ary : {username: \"null\", password: \"null\"};\n        ","sandbox":"default","line":200}]
16:26:37     INFO -  1513268797144	Marionette	TRACE	4 <- [1,17,null,{"value":[{"init":{},"QueryInterface":{},"guid":"{1f7b6d0d-2c4e-4a33-b67f-6a5b519d34de}","timeCreated":15132687965 ... om/some/form/","httpRealm":null,"usernameField":"username","passwordField":"password","equals":{},"matches":{},"clone":{}}]}]
16:26:37     INFO -  1513268797146	Marionette	TRACE	4 -> [0,18,"executeScript",{"scriptTimeout":null,"newSandbox":true,"args":[],"filename":"test_refresh_firefox.py","script":"\n          return Services.logins.getAllLogins().length;\n        ","sandbox":"default","line":207}]
16:26:37     INFO -  1513268797152	Marionette	TRACE	4 <- [1,18,null,{"value":2}]
16:26:37     INFO -  1513268797154	Marionette	TRACE	4 -> [0,19,"executeScript",{"scriptTimeout":null,"newSandbox":true,"args":["about:mozilla"],"filename":"test_refresh_firefox.py"," ... kmarkIds.length == 1 ? PlacesUtils.bookmarks.getItemTitle(bookmarkIds[0]) : \"\";\n        ","sandbox":"default","line":216}]
16:26:37     INFO -  1513268797156	Marionette	TRACE	4 <- [1,19,null,{"value":"Some bookmark from Marionette"}]
16:26:37     INFO -  1513268797158	Marionette	TRACE	4 -> [0,20,"executeAsyncScript",{"scriptTimeout":null,"sandbox":"firefox-refresh","debug_script":false,"script":"\n          Place ... ndbox":false,"line":448,"args":["http://firefox-refresh.marionette-test.mozilla.org/"],"filename":"test_refresh_firefox.py"}]
16:26:37     INFO -  1513268797163	Marionette	TRACE	4 <- [1,20,null,{"value":{"guid":"boIIG6EOJlmG","url":"http://firefox-refresh.marionette-test.mozilla.org/","frecency":100,"title":"Test visit for Firefox Reset"}}]
16:26:37     INFO -  1513268797165	Marionette	TRACE	4 -> [0,21,"executeAsyncScript",{"scriptTimeout":null,"sandbox":"firefox-refresh","debug_script":false,"script":"\n          let r ... dbox":false,"line":448,"args":["some-very-unique-marionette-only-firefox-reset-field"],"filename":"test_refresh_firefox.py"}]
16:26:37     INFO -  1513268797172	Marionette	TRACE	4 <- [1,21,null,{"value":[{"value":"special-pumpkin-value"}]}]
16:26:37     INFO -  1513268797178	Marionette	TRACE	4 -> [0,22,"executeAsyncScript",{"scriptTimeout":null,"sandbox":"firefox-refresh","debug_script":false,"script":"\n          let c ... l.FormHistory.count({}, callbacks);\n        ","newSandbox":false,"line":448,"args":[],"filename":"test_refresh_firefox.py"}]
16:26:37     INFO -  1513268797182	Marionette	TRACE	4 <- [1,22,null,{"value":1}]
16:26:37     INFO -  1513268797187	Marionette	TRACE	4 -> [0,23,"executeAsyncScript",{"scriptTimeout":null,"sandbox":"firefox-refresh","debug_script":false,"script":"\n          retur ...  }).then(marionetteScriptFinished);\n        ","newSandbox":false,"line":448,"args":[],"filename":"test_refresh_firefox.py"}]
16:26:37     INFO -  1513268797188	Marionette	TRACE	4 <- [1,23,null,{"value":[{"given-name":"John","additional-name":"R.","family-name":"Smith","organization":"World Wide Web Consort ... tel-national":"5195555555","tel-area-code":"519","tel-local":"5555555","tel-local-prefix":"555","tel-local-suffix":"5555"}]}]
16:26:37     INFO -  1513268797190	Marionette	TRACE	4 -> [0,24,"executeScript",{"scriptTimeout":null,"newSandbox":false,"args":["firefox-refresh.marionette-test.mozilla.org"],"filena ...      return \"got exception trying to fetch cookie: \" + ex;\n          }\n        ","sandbox":"firefox-refresh","line":441}]
16:26:37     INFO -  1513268797191	Marionette	TRACE	4 <- [1,24,null,{"value":{"path":"some/cookie/path","name":"somecookie","value":"some cookie value"}}]
16:26:37     INFO -  1513268797192	Marionette	TRACE	4 -> [0,25,"executeAsyncScript",{"scriptTimeout":null,"sandbox":"firefox-refresh","debug_script":false,"script":"\n          Cu.im ... hed(err.toString());\n          });\n        ","newSandbox":false,"line":448,"args":[],"filename":"test_refresh_firefox.py"}]
16:26:37     INFO -  1513268797198	Marionette	TRACE	4 <- [1,25,null,{"value":{"accountData":{"email":"[e-mail]","uid":"uid","keyFetchToken":"top-secret"},"prefUsername":null}}]
16:26:37     INFO -  1513268797199	Marionette	TRACE	4 -> [0,26,"executeScript",{"scriptTimeout":null,"newSandbox":false,"args":["c:\\users\\genericworker\\appdata\\local\\temp\\tmpb1 ... \", arguments[0]);\n          env.set(\"XRE_PROFILE_NAME\", profileName);\n        ","sandbox":"firefox-refresh","line":441}]
16:26:37     INFO -  1513268797235	Marionette	TRACE	4 <- [1,26,null,{"value":null}]
16:26:37     INFO -  1513268797237	Marionette	TRACE	4 -> [0,27,"getContext",{}]
16:26:37     INFO -  1513268797237	Marionette	TRACE	4 <- [1,27,null,{"value":"chrome"}]
16:26:37     INFO -  1513268797238	Marionette	TRACE	4 -> [0,28,"getContext",{}]
16:26:37     INFO -  1513268797238	Marionette	TRACE	4 <- [1,28,null,{"value":"chrome"}]
16:26:37     INFO -  1513268797239	Marionette	TRACE	4 -> [0,29,"setContext",{"value":"chrome"}]
16:26:37     INFO -  1513268797239	Marionette	TRACE	4 <- [1,29,null,{}]
16:26:37     INFO -  1513268797242	Marionette	TRACE	4 -> [0,30,"executeScript",{"scriptTimeout":null,"newSandbox":true,"args":[],"filename":"marionette.py","script":"\n               ... application-requested\", null);\n                return cancelQuit.data;\n                ","sandbox":"default","line":1046}]
16:26:37     INFO -  1513268797248	Marionette	TRACE	4 <- [1,30,null,{"value":false}]
16:26:37     INFO -  1513268797249	Marionette	TRACE	4 -> [0,31,"setContext",{"value":"chrome"}]
16:26:37     INFO -  1513268797249	Marionette	TRACE	4 <- [1,31,null,{}]
16:26:37     INFO -  1513268797250	Marionette	TRACE	4 -> [0,32,"quitApplication",{"flags":["eRestart","eAttemptQuit"]}]
16:26:37     INFO -  1513268797251	Marionette	DEBUG	New connections will no longer be accepted
16:26:37     INFO -  [Parent 6440, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:26:37     INFO -  1513268797319	Marionette	TRACE	4 <- [1,32,null,{"cause":"restart"}]
16:26:37     INFO -  Unable to read VR Path Registry from C:\Users\GenericWorker\AppData\Local\openvr\openvrpaths.vrpath
16:26:37     INFO -  [Child 468, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:26:37     INFO -  [Child 468, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:26:37     INFO -  1513268797334	Marionette	DEBUG	Closed connection 4
16:26:37     INFO -  [Parent 6440, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:26:37     INFO -  Unable to read VR Path Registry from C:\Users\GenericWorker\AppData\Local\openvr\openvrpaths.vrpath
16:26:37     INFO -  [Child 9128, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:26:37     INFO -  [Parent 6440, Gecko_IOThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:26:37     INFO -  Unable to read VR Path Registry from C:\Users\GenericWorker\AppData\Local\openvr\openvrpaths.vrpath
16:26:37     INFO -  [Child 7456, Chrome_ChildThread] WARNING: pipe error: 109: file z:/build/build/src/ipc/chromium/src/chrome/common/ipc_channel_win.cc, line 346
16:27:31     INFO -  *** UTM:SVC TimerManager:registerTimer called after profile-before-change notification. Ignoring timer registration for id: telemetry_modules_ping
16:30:38     INFO -  mozcrash Downloading symbols from: https://queue.taskcluster.net/v1/task/e4lGqbPRRy2rBOzGqm72Jg/artifacts/public/build/target.crashreporter-symbols.zip
16:30:42     INFO -  mozcrash Copy/paste: Z:\task_1513268053\build\win32-minidump_stackwalk.exe c:\users\genericworker\appdata\local\temp\tmpb1tmhr.mozrunner\minidumps\912fd60b-92b1-4e84-9f07-39468d5af90d.dmp c:\users\genericworker\appdata\local\temp\tmpdyvrqe
16:30:48     INFO -  mozcrash Saved minidump as Z:\task_1513268053\build\blobber_upload_dir\912fd60b-92b1-4e84-9f07-39468d5af90d.dmp
16:30:48     INFO -  mozcrash Saved app info as Z:\task_1513268053\build\blobber_upload_dir\912fd60b-92b1-4e84-9f07-39468d5af90d.extra
16:30:48    ERROR -  PROCESS-CRASH | browser\components\migration\tests\marionette\test_refresh_firefox.py TestFirefoxRefresh.testReset | application crashed [@ MOZ_CrashOOL]
16:30:48     INFO -  Crash dump filename: c:\users\genericworker\appdata\local\temp\tmpb1tmhr.mozrunner\minidumps\912fd60b-92b1-4e84-9f07-39468d5af90d.dmp
16:30:48     INFO -  Operating system: Windows NT
16:30:48     INFO -                    10.0.15063
16:30:48     INFO -  CPU: amd64
16:30:48     INFO -       family 6 model 63 stepping 2
16:30:48     INFO -       8 CPUs
16:30:48     INFO -  GPU: UNKNOWN
16:30:48     INFO -  Crash reason:  EXCEPTION_BREAKPOINT
16:30:48     INFO -  Crash address: 0x7ffcd0ce8a87

Comment 1

[Intermittent Failures Robot]

1 failures in 423 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2017-12-11&endday=2017-12-17&tree=all

Comment 2

[Intermittent Failures Robot]

6 failures in 590 pushes (0.01 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 3
* try: 1
* mozilla-inbound: 1
* autoland: 1

Platform breakdown:
* linux32: 2
* windows7-32: 1
* windows10-64-ccov: 1
* windows10-64: 1
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2017-12-18&endday=2017-12-24&tree=all

Comment 3

[Intermittent Failures Robot]

1 failures in 147 pushes (0.007 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 1

Platform breakdown:
* windows10-64-ccov: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2017-12-25&endday=2017-12-31&tree=all

Comment 4

[Intermittent Failures Robot]

20 failures in 462 pushes (0.043 failures/push) were associated with this bug in the last 7 days. 

This is the #48 most frequent failure this week.   

Repository breakdown:
* mozilla-inbound: 10
* mozilla-central: 4
* try: 3
* autoland: 3

Platform breakdown:
* linux32: 16
* linux64: 2
* windows7-32: 1
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-01-01&endday=2018-01-07&tree=all

Comment 5

[Henrik Skupin [:whimboo][⌚️UTC+2]]

This is a shutdown hang + crash for DOM workers:

[task 2018-01-10T20:44:27.452Z] 20:44:27     INFO -  Hit MOZ_CRASH(Workers Hanging - A:1|S:0|Q:0-BC:2|FetchBodyWorkerHolder) at /builds/worker/workspace/build/src/dom/workers/RuntimeService.cpp:2187
[task 2018-01-10T20:44:27.455Z] 20:44:27     INFO -  ExceptionHandler::GenerateDump cloned child 5499
[task 2018-01-10T20:44:27.456Z] 20:44:27     INFO -  ExceptionHandler::SendContinueSignalToChild sent continue signal to child
[task 2018-01-10T20:44:27.459Z] 20:44:27     INFO -  ExceptionHandler::WaitForContinueSignal waiting for continue signal...
[task 2018-01-10T20:47:21.503Z] 20:47:21     INFO - mozcrash Copy/paste: /usr/local/bin/linux64-minidump_stackwalk /tmp/tmpfDJrhz.mozrunner/minidumps/4d696389-6918-3dd4-d54b-b13289d68904.dmp /builds/worker/workspace/build/symbols
[task 2018-01-10T20:47:31.215Z] 20:47:31     INFO - mozcrash Saved minidump as /builds/worker/workspace/build/blobber_upload_dir/4d696389-6918-3dd4-d54b-b13289d68904.dmp
[task 2018-01-10T20:47:31.215Z] 20:47:31     INFO - mozcrash Saved app info as /builds/worker/workspace/build/blobber_upload_dir/4d696389-6918-3dd4-d54b-b13289d68904.extra
[task 2018-01-10T20:47:31.255Z] 20:47:31     INFO - PROCESS-CRASH | browser/components/migration/tests/marionette/test_refresh_firefox.py TestFirefoxRefresh.testReset | application crashed [@ MOZ_CrashOOL]
[task 2018-01-10T20:47:31.256Z] 20:47:31     INFO - Crash dump filename: /tmp/tmpfDJrhz.mozrunner/minidumps/4d696389-6918-3dd4-d54b-b13289d68904.dmp
[task 2018-01-10T20:47:31.257Z] 20:47:31     INFO - Operating system: Linux
[task 2018-01-10T20:47:31.258Z] 20:47:31     INFO -                   0.0.0 Linux 4.4.0-98-generic #121~14.04.1-Ubuntu SMP Wed Oct 11 11:54:55 UTC 2017 x86_64
[task 2018-01-10T20:47:31.259Z] 20:47:31     INFO - CPU: x86
[task 2018-01-10T20:47:31.260Z] 20:47:31     INFO -      GenuineIntel family 6 model 62 stepping 4
[task 2018-01-10T20:47:31.261Z] 20:47:31     INFO -      2 CPUs
[task 2018-01-10T20:47:31.262Z] 20:47:31     INFO - 
[task 2018-01-10T20:47:31.263Z] 20:47:31     INFO - GPU: UNKNOWN
[task 2018-01-10T20:47:31.264Z] 20:47:31     INFO - 
[task 2018-01-10T20:47:31.265Z] 20:47:31     INFO - Crash reason:  SIGSEGV
[task 2018-01-10T20:47:31.266Z] 20:47:31     INFO - Crash address: 0x0
[task 2018-01-10T20:47:31.267Z] 20:47:31     INFO - Process uptime: not available
[task 2018-01-10T20:47:31.268Z] 20:47:31     INFO - 
[task 2018-01-10T20:47:31.269Z] 20:47:31     INFO - Thread 28 (crashed)
[task 2018-01-10T20:47:31.270Z] 20:47:31     INFO -  0  firefox!MOZ_CrashOOL [Assertions.cpp:2fb3a7563abc : 33 + 0x0]
[task 2018-01-10T20:47:31.271Z] 20:47:31     INFO -     eip = 0x0804d213   esp = 0xbd057260   ebp = 0xbd057268   ebx = 0xbea87fc0
[task 2018-01-10T20:47:31.272Z] 20:47:31     INFO -     esi = 0x08086000   edi = 0xbebd6220   eax = 0x08086980   ecx = 0xf74a0864
[task 2018-01-10T20:47:31.272Z] 20:47:31     INFO -     edx = 0x00000000   efl = 0x00010286
[task 2018-01-10T20:47:31.273Z] 20:47:31     INFO -     Found by: given as instruction pointer in context
[task 2018-01-10T20:47:31.274Z] 20:47:31     INFO -  1  libxul.so!mozilla::dom::workers::RuntimeService::CrashIfHanging [RuntimeService.cpp:2fb3a7563abc : 2187 + 0x20]
[task 2018-01-10T20:47:31.275Z] 20:47:31     INFO -     eip = 0xf10d6910   esp = 0xbd057270   ebp = 0xbd0572e8   ebx = 0xf53c5000
[task 2018-01-10T20:47:31.276Z] 20:47:31     INFO -     esi = 0xbebd6200   edi = 0xbebd6220
[task 2018-01-10T20:47:31.277Z] 20:47:31     INFO -     Found by: call frame info
[task 2018-01-10T20:47:31.278Z] 20:47:31     INFO -  2  libxul.so!RunWatchdog [nsTerminator.cpp:2fb3a7563abc : 162 + 0x9]
[task 2018-01-10T20:47:31.279Z] 20:47:31     INFO -     eip = 0xf23171ce   esp = 0xbd0572f0   ebp = 0xbd057318   ebx = 0xf53c5000
[task 2018-01-10T20:47:31.280Z] 20:47:31     INFO -     esi = 0x0000003f   edi = 0xde9f47e0
[task 2018-01-10T20:47:31.280Z] 20:47:31     INFO -     Found by: call frame info
[task 2018-01-10T20:47:31.281Z] 20:47:31     INFO -  3  libnspr4.so!_pt_root [ptthread.c:2fb3a7563abc : 201 + 0x7]
[task 2018-01-10T20:47:31.282Z] 20:47:31     INFO -     eip = 0xf72d3fe0   esp = 0xbd057320   ebp = 0xbd057368   ebx = 0xf72e7000
[task 2018-01-10T20:47:31.283Z] 20:47:31     INFO -     esi = 0xdae26dc0   edi = 0xbd057b40
[task 2018-01-10T20:47:31.284Z] 20:47:31     INFO -     Found by: call frame info
[task 2018-01-10T20:47:31.285Z] 20:47:31     INFO -  4  libpthread-2.23.so + 0x6295
[task 2018-01-10T20:47:31.286Z] 20:47:31     INFO -     eip = 0xf76a0295   esp = 0xbd057370   ebp = 0xbd057428   ebx = 0x00000000
[task 2018-01-10T20:47:31.286Z] 20:47:31     INFO -     esi = 0x00000000   edi = 0x003d0f00
[task 2018-01-10T20:47:31.288Z] 20:47:31     INFO -     Found by: call frame info
[task 2018-01-10T20:47:31.289Z] 20:47:31     INFO -  5  libc-2.23.so + 0xe705e
[task 2018-01-10T20:47:31.289Z] 20:47:31     INFO -     eip = 0xf73d405e   esp = 0xbd057430   ebp = 0x00000000
[task 2018-01-10T20:47:31.290Z] 20:47:31     INFO -     Found by: previous frame's frame pointer
[task 2018-01-10T20:47:31.291Z] 20:47:31     INFO -

Comment 6

[Intermittent Failures Robot]

18 failures in 788 pushes (0.023 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 6
* mozilla-inbound: 5
* mozilla-central: 5
* try: 2

Platform breakdown:
* linux32: 9
* windows10-64: 4
* linux64: 3
* windows10-64-ccov: 1
* linux64-ccov: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-01-08&endday=2018-01-14&tree=all

Comment 7

[Intermittent Failures Robot]

6 failures in 657 pushes (0.009 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 6

Platform breakdown:
* windows10-64-ccov: 4
* windows10-64: 1
* linux64-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-01-15&endday=2018-01-21&tree=all

Comment 8

[Intermittent Failures Robot]

5 failures in 701 pushes (0.007 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 3
* try: 1
* mozilla-inbound: 1

Platform breakdown:
* windows10-64-ccov: 2
* linux64: 2
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-01-22&endday=2018-01-28&tree=all

Comment 9

[Intermittent Failures Robot]

9 failures in 735 pushes (0.012 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 5
* mozilla-central: 2
* mozilla-inbound: 1
* mozilla-beta: 1

Platform breakdown:
* linux32: 4
* windows7-32: 2
* windows7-32-devedition: 1
* windows10-64: 1
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-01-29&endday=2018-02-04&tree=all

Comment 10

[Henrik Skupin [:whimboo][⌚️UTC+2]]

This is actually a crash caused by the hang monitor due to a long shutdown. As the crash stack for most crashes looks like this is just bug 1411908, which is a subset of issues as blocking bug 1435343. But there are also other hangs reported, which we will file as deps for bug 1435343. So marking this bug as dependency to get this test failure fixed.

Comment 11

[Intermittent Failures Robot]

54 failures in 51 pushes (1.059 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-central: 20
* autoland: 19
* mozilla-inbound: 15

Platform breakdown:
* windows7-32: 36
* windows10-64: 13
* windows7-32-nightly: 3
* windows10-64-nightly: 1
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-02-10&endday=2018-02-10&tree=all

Comment 12

[Intermittent Failures Robot]

127 failures in 702 pushes (0.181 failures/push) were associated with this bug in the last 7 days. 

This is the #3 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **   

Repository breakdown:
* autoland: 57
* mozilla-central: 30
* mozilla-inbound: 28
* pine: 10
* try: 2

Platform breakdown:
* windows7-32: 82
* windows10-64: 32
* windows7-32-nightly: 6
* windows10-64-nightly: 2
* linux64: 2
* windows10-64-ccov: 1
* osx-10-10: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-02-05&endday=2018-02-11&tree=all

Comment 13

[Henrik Skupin [:whimboo][⌚️UTC+2]]

In a huge number of cases it is really the mozilla::dom::quota::QuotaManager::ShutdownObserver::Observe frame which shows up in the stack traces. So it needs bug 1435958 to get fixed.

Also there was a huge spike on Feb 9th which continues to raise. This bug covers one of the most failing tests now.

Comment 14

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Also the crash seem to have started between the Nightly builds from Dec 27th and 28th:

https://crash-stats.mozilla.com/search/?signature=~MOZ_CrashOOL&signature=~mozilla%3A%3Adom%3A%3Aworkerinternals%3A%3ARuntimeService%3A%3ACrashIfHanging%28%29&signature=~mozilla%3A%3Adom%3A%3Aquota%3A%3AQuotaManager%3A%3AShutdownObserver%3A%3AObserve&date=%3E%3D2017-12-27T02%3A00%3A00.000Z&date=%3C2017-12-28T02%3A00%3A00.000Z&_sort=-date&_facets=signature&_columns=date&_columns=signature&_columns=product&_columns=version&_columns=build_id&_columns=platform#facet-signature

Comment 15

[Marion Daly [:mdaly]]

:janv, want to give this a quick look?

Comment 16

[Intermittent Failures Robot]

107 failures in 120 pushes (0.892 failures/push) were associated with this bug yesterday.    

** This test has failed more than 150 times in the last 21 days. It should be disabled until it can be fixed. ** 

Repository breakdown:
* autoland: 45
* mozilla-inbound: 33
* mozilla-central: 29

Platform breakdown:
* windows7-32: 74
* windows10-64: 31
* windows10-64-nightly: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-02-12&endday=2018-02-12&tree=all

Comment 18

[Henrik Skupin [:whimboo][⌚️UTC+2]]

(In reply to Henrik Skupin (:whimboo) from comment #14)
> Also the crash seem to have started between the Nightly builds from Dec 27th
> and 28th:

The reason for that is that the reporting stack for hung / crashed threads during shutdown has been changed. Formerly the nowish duped bug 1399601 was showing the exact same problem, and it was filed mid September last year.

Comment 19

[Intermittent Failures Robot]

67 failures in 89 pushes (0.753 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 30
* autoland: 26
* mozilla-central: 11

Platform breakdown:
* windows7-32: 36
* windows10-64: 29
* windows7-32-nightly: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-02-13&endday=2018-02-13&tree=all

Comment 20

[Intermittent Failures Robot]

60 failures in 139 pushes (0.432 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 38
* mozilla-inbound: 11
* mozilla-central: 10
* try: 1

Platform breakdown:
* windows7-32: 33
* windows10-64: 25
* windows7-32-nightly: 1
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-02-14&endday=2018-02-14&tree=all

Comment 21

[Henrik Skupin [:whimboo][⌚️UTC+2]]

As expected the signature has changed again. Now it is:

https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-central&job_id=162297467&lineNumber=48753

> Thread 48 (crashed)
> 0  xul.dll!mozilla::`anonymous namespace'::RunWatchdog [nsTerminator.cpp:27fd083ed7ee5782e52a5eaf0286c5ffa8b35a9e : 206 + 0x11]

Comment 23

[Andrei Ciure[:aciure]]

Attachment: bug1425323 disable test_refresh_firefox.py for Windows pgo and opt

Comment 24

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/b73e82f1a589
disable test_refresh_firefox.py on Windows pgo and opt r=jmaher

Comment 25

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Lets not forget to set the test-disabled keyword. I hope that we could get this test enabled soon given that it covers an important use case.

Comment 26

[Intermittent Failures Robot]

76 failures in 149 pushes (0.51 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 35
* mozilla-inbound: 23
* mozilla-central: 16
* try: 2

Platform breakdown:
* windows7-32: 44
* windows10-64: 28
* windows7-32-nightly: 3
* windows10-64-nightly: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-02-15&endday=2018-02-15&tree=all

Comment 27

[Narcis Beleuzu [:NarcisB]]

https://hg.mozilla.org/mozilla-central/rev/b73e82f1a589

Comment 28

[Intermittent Failures Robot]

325 failures in 685 pushes (0.474 failures/push) were associated with this bug in the last 7 days. 

This is the #1 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **   

Repository breakdown:
* autoland: 150
* mozilla-inbound: 95
* mozilla-central: 72
* try: 8

Platform breakdown:
* windows7-32: 194
* windows10-64: 119
* windows7-32-nightly: 6
* windows10-64-nightly: 4
* osx-10-10: 1
* linux64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-02-12&endday=2018-02-18&tree=all

Comment 29

[Intermittent Failures Robot]

1 failures in 831 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 1

Platform breakdown:
* windows10-64: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-02-26&endday=2018-03-04&tree=all

Comment 30

[Intermittent Failures Robot]

2 failures in 747 pushes (0.003 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 2

Platform breakdown:
* linux64-nightly: 2

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-03-05&endday=2018-03-11&tree=all

Comment 31

[Intermittent Failures Robot]

2 failures in 814 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 2

Platform breakdown:
* linux64-qr: 1
* linux32: 1

For more details, see:
https://brasstacks.mozilla.com/orangefactor/?display=Bug&bugid=1425323&startday=2018-03-12&endday=2018-03-18&tree=all

Comment 32

[Intermittent Failures Robot]

1 failures in 765 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 1

Platform breakdown:
* macosx64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1425323&startday=2018-04-02&endday=2018-04-08&tree=trunk

Comment 34

[Intermittent Failures Robot]

1 failures in 782 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-inbound: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1425323&startday=2018-04-16&endday=2018-04-22&tree=trunk

Comment 35

[Intermittent Failures Robot]

1 failures in 780 pushes (0.001 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* try: 1

Platform breakdown:
* macosx64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1425323&startday=2018-04-23&endday=2018-04-29&tree=trunk

Comment 37

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Given that bug 1411908 has been fixed now, we should try to re-enable this test on Windows. I will trigger a try build later today.

Comment 38

[Henrik Skupin [:whimboo][⌚️UTC+2]]

The try build can be found at:
https://treeherder.mozilla.org/#/jobs?repo=try&revision=66149d888738968d6c621b2621fc43ad697698a2

Comment 39

[Henrik Skupin [:whimboo][⌚️UTC+2]]

(In reply to Narcis Beleuzu [:NarcisB] from comment #27)
> https://hg.mozilla.org/mozilla-central/rev/b73e82f1a589

Try looks green. Sheriffs can you please backout the above skip patch? Thanks.

Comment 40

[Narcis Beleuzu [:NarcisB]]

Sure :whimboo !
Backed out changeset b73e82f1a589 to re-enable test on Windows pgo/opt.

Backout link = https://hg.mozilla.org/mozilla-central/rev/0e52749acd376489bb551928d2012dde10bfc41b

Comment 41

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Marking as fixed by bug 1411908.

Please note to not remove the disable flag from older branches given that you only landed it for 61, but not 60 nor 59. Also wouldn't it have been better to backout on an integration branch instead of mozilla-central?