1636567 - Intermittent Windows 10 fission browser-chrome PROCESS-CRASH | Main app process exited normally | application crashed [None] after run of toolkit/components/reader/test/

Status: RESOLVED INCOMPLETE

(Toolkit :: Reader Mode, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: archaeopteryx [at] coole-files.de
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=301427362&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/fDQCQk1qRfCXRkvf7SB2eg/runs/0/artifacts/public/logs/live_backing.log

---

This runs on central and fails permanently as Windows 10 x64 opt fission.

[task 2020-05-08T16:39:39.231Z] 16:39:39 INFO - GECKO(2944) | 1588955979226 Marionette DEBUG Closed connection 1
[task 2020-05-08T16:39:39.350Z] 16:39:39 INFO - *** Start BrowserChrome Test Results ***
[task 2020-05-08T16:39:39.369Z] 16:39:39 INFO - checking window state
[task 2020-05-08T16:39:39.388Z] 16:39:39 INFO - TEST-START | toolkit/components/reader/test/browser_bug1124271_readerModePinnedTab.js
[task 2020-05-08T16:39:40.390Z] 16:39:40 INFO - GECKO(2944) | MEMORY STAT | vsize 2104214MB | vsizeMaxContiguous 65200133MB | residentFast 294MB | heapAllocated 115MB
[task 2020-05-08T16:39:40.390Z] 16:39:40 INFO - TEST-OK | toolkit/components/reader/test/browser_bug1124271_readerModePinnedTab.js | took 1005ms
[task 2020-05-08T16:39:40.411Z] 16:39:40 INFO - checking window state
[task 2020-05-08T16:39:40.430Z] 16:39:40 INFO - TEST-START | toolkit/components/reader/test/browser_bug1453818_samesite_cookie.js
[task 2020-05-08T16:39:44.547Z] 16:39:44 INFO - GECKO(2944) | MEMORY STAT | vsize 2104214MB | vsizeMaxContiguous 65200133MB | residentFast 289MB | heapAllocated 112MB
[task 2020-05-08T16:39:44.547Z] 16:39:44 INFO - TEST-OK | toolkit/components/reader/test/browser_bug1453818_samesite_cookie.js | took 4122ms
[task 2020-05-08T16:39:44.565Z] 16:39:44 INFO - checking window state
[task 2020-05-08T16:39:44.575Z] 16:39:44 INFO - TEST-START | toolkit/components/reader/test/browser_readerMode.js
[task 2020-05-08T16:39:44.615Z] 16:39:44 INFO - GECKO(2944) | [Parent 8488, Gecko_IOThread] WARNING: file /builds/worker/checkouts/gecko/ipc/chromium/src/base/process_util_win.cc, line 166
[task 2020-05-08T16:39:47.084Z] 16:39:47 INFO - GECKO(2944) | MEMORY STAT | vsize 2104216MB | vsizeMaxContiguous 65200133MB | residentFast 295MB | heapAllocated 116MB
[task 2020-05-08T16:39:47.084Z] 16:39:47 INFO - TEST-OK | toolkit/components/reader/test/browser_readerMode.js | took 2509ms
[task 2020-05-08T16:39:47.094Z] 16:39:47 INFO - checking window state
[task 2020-05-08T16:39:47.112Z] 16:39:47 INFO - TEST-START | toolkit/components/reader/test/browser_readerMode_hidden_nodes.js
[task 2020-05-08T16:39:47.142Z] 16:39:47 INFO - GECKO(2944) | [Parent 8488, Gecko_IOThread] WARNING: file /builds/worker/checkouts/gecko/ipc/chromium/src/base/process_util_win.cc, line 166
[task 2020-05-08T16:39:47.430Z] 16:39:47 INFO - GECKO(2944) | MEMORY STAT | vsize 2104216MB | vsizeMaxContiguous 65200133MB | residentFast 291MB | heapAllocated 112MB
[task 2020-05-08T16:39:47.430Z] 16:39:47 INFO - TEST-OK | toolkit/components/reader/test/browser_readerMode_hidden_nodes.js | took 325ms
[task 2020-05-08T16:39:47.448Z] 16:39:47 INFO - checking window state
[task 2020-05-08T16:39:47.467Z] 16:39:47 INFO - TEST-START | toolkit/components/reader/test/browser_readerMode_readingTime.js
[task 2020-05-08T16:39:47.507Z] 16:39:47 INFO - GECKO(2944) | [Parent 8488, Gecko_IOThread] WARNING: file /builds/worker/checkouts/gecko/ipc/chromium/src/base/process_util_win.cc, line 166
[task 2020-05-08T16:39:48.816Z] 16:39:48 INFO - GECKO(2944) | MEMORY STAT | vsize 2104221MB | vsizeMaxContiguous 65200133MB | residentFast 290MB | heapAllocated 110MB
[task 2020-05-08T16:39:48.816Z] 16:39:48 INFO - TEST-OK | toolkit/components/reader/test/browser_readerMode_readingTime.js | took 1357ms
[task 2020-05-08T16:39:48.826Z] 16:39:48 INFO - checking window state
[task 2020-05-08T16:39:48.846Z] 16:39:48 INFO - GECKO(2944) | Completed ShutdownLeaks collections in process 8488
[task 2020-05-08T16:39:48.846Z] 16:39:48 INFO - TEST-START | Shutdown
[task 2020-05-08T16:39:48.846Z] 16:39:48 INFO - Browser Chrome Test Summary
[task 2020-05-08T16:39:48.847Z] 16:39:48 INFO - Passed: 68
[task 2020-05-08T16:39:48.847Z] 16:39:48 INFO - Failed: 0
[task 2020-05-08T16:39:48.847Z] 16:39:48 INFO - Todo: 0
[task 2020-05-08T16:39:48.847Z] 16:39:48 INFO - Mode: e10s
[task 2020-05-08T16:39:48.847Z] 16:39:48 INFO - *** End BrowserChrome Test Results ***
[task 2020-05-08T16:39:48.866Z] 16:39:48 INFO - GECKO(2944) | Exiting due to channel error.
[task 2020-05-08T16:39:48.866Z] 16:39:48 INFO - GECKO(2944) | Exiting due to channel error.
[task 2020-05-08T16:39:48.866Z] 16:39:48 INFO - GECKO(2944) | Exiting due to channel error.
[task 2020-05-08T16:39:48.867Z] 16:39:48 INFO - GECKO(2944) | Exiting due to channel error.
[task 2020-05-08T16:39:48.966Z] 16:39:48 INFO - TEST-INFO | Main app process: exit 0
[task 2020-05-08T16:39:48.966Z] 16:39:48 INFO - runtests.py | Application ran for: 0:00:12.905000
[task 2020-05-08T16:39:48.966Z] 16:39:48 INFO - zombiecheck | Reading PID log: c:\users\task_1588953758\appdata\local\temp\tmpo0ca3tpidlog
[task 2020-05-08T16:39:48.966Z] 16:39:48 INFO - ==> process 8488 launched child process 7452 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.0.1660430893\244130389" -parentBuildID 20200508155804 -prefsHandle 2172 -prefMapHandle 2164 -prefsLen 1 -prefMapSize 232891 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 2244 gpu)
[task 2020-05-08T16:39:48.966Z] 16:39:48 INFO - ==> process 8488 launched child process 7200 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.6.1969929631\1802056411" -childID 1 -isForBrowser -prefsHandle 2884 -prefMapHandle 2880 -prefsLen 1779 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 2892 tab)
[task 2020-05-08T16:39:48.966Z] 16:39:48 INFO - ==> process 8488 launched child process 9924 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.13.2060337067\1662313084" -childID 2 -isForBrowser -prefsHandle 6024 -prefMapHandle 6020 -prefsLen 2192 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 6048 tab)
[task 2020-05-08T16:39:48.967Z] 16:39:48 INFO - ==> process 8488 launched child process 3772 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.20.338073098\1303249360" -childID 3 -isForBrowser -prefsHandle 6180 -prefMapHandle 6184 -prefsLen 2232 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 6240 tab)
[task 2020-05-08T16:39:48.967Z] 16:39:48 INFO - ==> process 8488 launched child process 732 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.27.1180519580\1544953692" -childID 4 -isForBrowser -prefsHandle 3952 -prefMapHandle 3948 -prefsLen 11623 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 5016 tab)
[task 2020-05-08T16:39:48.967Z] 16:39:48 INFO - ==> process 8488 launched child process 8380 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.34.2051562889\653319820" -childID 5 -isForBrowser -prefsHandle 5552 -prefMapHandle 1960 -prefsLen 11875 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 5572 tab)
[task 2020-05-08T16:39:48.967Z] 16:39:48 INFO - ==> process 8488 launched child process 8968 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.41.1965964073\1996374755" -childID 6 -isForBrowser -prefsHandle 5208 -prefMapHandle 5204 -prefsLen 11955 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 3324 tab)
[task 2020-05-08T16:39:48.967Z] 16:39:48 INFO - ==> process 8488 launched child process 9180 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.48.1682424245\364538823" -childID 7 -isForBrowser -prefsHandle 3404 -prefMapHandle 3400 -prefsLen 11955 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 3356 tab)
[task 2020-05-08T16:39:48.967Z] 16:39:48 INFO - ==> process 8488 launched child process 6164 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.55.283602825\308765579" -childID 8 -isForBrowser -prefsHandle 4736 -prefMapHandle 3256 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 3836 tab)
[task 2020-05-08T16:39:48.967Z] 16:39:48 INFO - ==> process 8488 launched child process 8824 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.62.1992326837\1456783388" -childID 9 -isForBrowser -prefsHandle 4740 -prefMapHandle 5744 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 5668 tab)
[task 2020-05-08T16:39:48.967Z] 16:39:48 INFO - ==> process 8488 launched child process 5088 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.69.1789177308\1538237746" -childID 10 -isForBrowser -prefsHandle 5476 -prefMapHandle 3344 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 4432 tab)
[task 2020-05-08T16:39:48.968Z] 16:39:48 INFO - ==> process 8488 launched child process 428 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.76.1292128398\714370375" -childID 11 -isForBrowser -prefsHandle 3400 -prefMapHandle 3588 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 4492 tab)
[task 2020-05-08T16:39:48.968Z] 16:39:48 INFO - ==> process 8488 launched child process 6824 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.83.1867425550\651036628" -childID 12 -isForBrowser -prefsHandle 4156 -prefMapHandle 4152 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 5816 tab)
[task 2020-05-08T16:39:48.968Z] 16:39:48 INFO - ==> process 8488 launched child process 4512 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.90.1458121832\937180239" -childID 13 -isForBrowser -prefsHandle 3876 -prefMapHandle 3836 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 3800 tab)
[task 2020-05-08T16:39:48.968Z] 16:39:48 INFO - ==> process 8488 launched child process 5816 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.97.1763160670\380718984" -childID 14 -isForBrowser -prefsHandle 3536 -prefMapHandle 4004 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 4188 tab)
[task 2020-05-08T16:39:48.968Z] 16:39:48 INFO - ==> process 8488 launched child process 7296 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.104.239771926\1123588118" -childID 15 -isForBrowser -prefsHandle 4892 -prefMapHandle 4380 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 3652 tab)
[task 2020-05-08T16:39:48.968Z] 16:39:48 INFO - ==> process 8488 launched child process 7084 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.111.1592028934\947692096" -childID 16 -isForBrowser -prefsHandle 3228 -prefMapHandle 4372 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 4260 tab)
[task 2020-05-08T16:39:48.968Z] 16:39:48 INFO - ==> process 8488 launched child process 11184 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.118.1585602225\1223173537" -childID 17 -isForBrowser -prefsHandle 5916 -prefMapHandle 3792 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 3780 tab)
[task 2020-05-08T16:39:48.968Z] 16:39:48 INFO - ==> process 8488 launched child process 6212 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.125.1136867779\1528509764" -childID 18 -isForBrowser -prefsHandle 3228 -prefMapHandle 5144 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 3792 tab)
[task 2020-05-08T16:39:48.968Z] 16:39:48 INFO - ==> process 8488 launched child process 5248 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.132.1511840008\1335914285" -childID 19 -isForBrowser -prefsHandle 6056 -prefMapHandle 4704 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 3836 tab)
[task 2020-05-08T16:39:48.969Z] 16:39:48 INFO - ==> process 8488 launched child process 7356 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.139.1551847758\670993650" -childID 20 -isForBrowser -prefsHandle 6440 -prefMapHandle 4740 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 3804 tab)
[task 2020-05-08T16:39:48.969Z] 16:39:48 INFO - ==> process 8488 launched child process 5156 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.146.2098313422\1663521287" -childID 21 -isForBrowser -prefsHandle 3824 -prefMapHandle 3820 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 6452 tab)
[task 2020-05-08T16:39:48.969Z] 16:39:48 INFO - ==> process 8488 launched child process 10936 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.153.62977183\1949136526" -childID 22 -isForBrowser -prefsHandle 5944 -prefMapHandle 3460 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 4104 tab)
[task 2020-05-08T16:39:48.969Z] 16:39:48 INFO - ==> process 8488 launched child process 9376 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.160.1928156567\664682498" -childID 23 -isForBrowser -prefsHandle 1976 -prefMapHandle 3580 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 4868 tab)
[task 2020-05-08T16:39:48.969Z] 16:39:48 INFO - ==> process 8488 launched child process 6892 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.167.1568479420\48235818" -childID 24 -isForBrowser -prefsHandle 3416 -prefMapHandle 5188 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 6400 tab)
[task 2020-05-08T16:39:48.969Z] 16:39:48 INFO - ==> process 8488 launched child process 10184 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.174.1656539468\1807716071" -childID 25 -isForBrowser -prefsHandle 3460 -prefMapHandle 4868 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 5960 tab)
[task 2020-05-08T16:39:48.969Z] 16:39:48 INFO - ==> process 8488 launched child process 9220 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.181.1622239838\19145" -childID 26 -isForBrowser -prefsHandle 6568 -prefMapHandle 6564 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 6576 tab)
[task 2020-05-08T16:39:48.969Z] 16:39:48 INFO - ==> process 8488 launched child process 9160 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.188.1357140366\985883413" -childID 27 -isForBrowser -prefsHandle 6676 -prefMapHandle 6468 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 6436 tab)
[task 2020-05-08T16:39:48.970Z] 16:39:48 INFO - ==> process 8488 launched child process 8740 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.195.679894315\835325551" -childID 28 -isForBrowser -prefsHandle 3632 -prefMapHandle 6740 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 5188 tab)
[task 2020-05-08T16:39:48.970Z] 16:39:48 INFO - ==> process 8488 launched child process 6756 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.202.1221172916\1536730339" -childID 29 -isForBrowser -prefsHandle 6668 -prefMapHandle 4324 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 4112 tab)
[task 2020-05-08T16:39:48.970Z] 16:39:48 INFO - ==> process 8488 launched child process 11028 ("Z:\task_1588953758\build\application\firefox\firefox.exe" -contentproc --channel="8488.209.2043344142\94079297" -childID 30 -isForBrowser -prefsHandle 6872 -prefMapHandle 3804 -prefsLen 12112 -prefMapSize 232891 -parentBuildID 20200508155804 -appdir "Z:\task_1588953758\build\application\firefox\browser" - 8488 "\.\pipe\gecko-crash-server-pipe.8488" 4876 tab)
[task 2020-05-08T16:39:48.970Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 5248
[task 2020-05-08T16:39:48.970Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 7296
[task 2020-05-08T16:39:48.970Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 3772
[task 2020-05-08T16:39:48.970Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 9220
[task 2020-05-08T16:39:48.970Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 8968
[task 2020-05-08T16:39:48.970Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 7084
[task 2020-05-08T16:39:48.971Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 6164
[task 2020-05-08T16:39:48.971Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 6212
[task 2020-05-08T16:39:48.971Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 7452
[task 2020-05-08T16:39:48.971Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 7200
[task 2020-05-08T16:39:48.971Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 5156
[task 2020-05-08T16:39:48.971Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 6824
[task 2020-05-08T16:39:48.971Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 732
[task 2020-05-08T16:39:48.971Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 428
[task 2020-05-08T16:39:48.971Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 11184
[task 2020-05-08T16:39:48.971Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 9160
[task 2020-05-08T16:39:48.971Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 5816
[task 2020-05-08T16:39:48.972Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 7356
[task 2020-05-08T16:39:48.972Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 4512
[task 2020-05-08T16:39:48.972Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 9924
[task 2020-05-08T16:39:48.972Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 10184
[task 2020-05-08T16:39:48.972Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 10936
[task 2020-05-08T16:39:48.972Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 8740
[task 2020-05-08T16:39:48.972Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 9180
[task 2020-05-08T16:39:48.972Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 5088
[task 2020-05-08T16:39:48.972Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 6756
[task 2020-05-08T16:39:48.972Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 8380
[task 2020-05-08T16:39:48.973Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 9376
[task 2020-05-08T16:39:48.973Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 6892
[task 2020-05-08T16:39:48.973Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 8824
[task 2020-05-08T16:39:48.973Z] 16:39:48 INFO - zombiecheck | Checking for orphan process with PID: 11028
[task 2020-05-08T16:39:48.973Z] 16:39:48 INFO - mozcrash Downloading symbols from: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/D6qLS7vqS4G6P1g-FZ5aGA/artifacts/public/build/target.crashreporter-symbols.zip
[task 2020-05-08T16:39:52.413Z] 16:39:52 INFO - mozcrash Copy/paste: Z:/task_1588953758/fetches\minidump_stackwalk\minidump_stackwalk.exe c:\users\task_1588953758\appdata\local\temp\tmpiil1ax.mozrunner\minidumps\c50a288b-7e2b-4a02-ad0a-54a449247d3a.dmp c:\users\task_1588953758\appdata\local\temp\tmp2fmj4k
[task 2020-05-08T16:39:52.452Z] 16:39:52 INFO - mozcrash Saved minidump as Z:\task_1588953758\build\blobber_upload_dir\c50a288b-7e2b-4a02-ad0a-54a449247d3a.dmp
[task 2020-05-08T16:39:52.452Z] 16:39:52 INFO - PROCESS-CRASH | Main app process exited normally | application crashed [None]
[task 2020-05-08T16:39:52.452Z] 16:39:52 INFO - Crash dump filename: c:\users\task_1588953758\appdata\local\temp\tmpiil1ax.mozrunner\minidumps\c50a288b-7e2b-4a02-ad0a-54a449247d3a.dmp
[task 2020-05-08T16:39:52.452Z] 16:39:52 INFO - stderr from minidump_stackwalk:
[task 2020-05-08T16:39:52.452Z] 16:39:52 INFO - 2020-05-08 16:39:52: minidump_stackwalk.cc:141: ERROR: MinidumpProcessor::Process failed
[task 2020-05-08T16:39:52.452Z] 16:39:52 INFO - mozcrash Copy/paste: Z:/task_1588953758/fetches\minidump_stackwalk\minidump_stackwalk.exe c:\users\task_1588953758\appdata\local\temp\tmpiil1ax.mozrunner\minidumps\b5a22b87-49c9-4571-a4d1-247088dbf5e2.dmp c:\users\task_1588953758\appdata\local\temp\tmp2fmj4k
[task 2020-05-08T16:39:52.471Z] 16:39:52 INFO - mozcrash Saved minidump as Z:\task_1588953758\build\blobber_upload_dir\b5a22b87-49c9-4571-a4d1-247088dbf5e2.dmp
[task 2020-05-08T16:39:52.471Z] 16:39:52 INFO - PROCESS-CRASH | Main app process exited normally | application crashed [None]
[task 2020-05-08T16:39:52.471Z] 16:39:52 INFO - Crash dump filename: c:\users\task_1588953758\appdata\local\temp\tmpiil1ax.mozrunner\minidumps\b5a22b87-49c9-4571-a4d1-247088dbf5e2.dmp
[task 2020-05-08T16:39:52.471Z] 16:39:52 INFO - stderr from minidump_stackwalk:
[task 2020-05-08T16:39:52.471Z] 16:39:52 INFO - 2020-05-08 16:39:52: minidump_stackwalk.cc:141: ERROR: MinidumpProcessor::Process failed
[task 2020-05-08T16:39:52.471Z] 16:39:52 INFO - mozcrash Copy/paste: Z:/task_1588953758/fetches\minidump_stackwalk\minidump_stackwalk.exe c:\users\task_1588953758\appdata\local\temp\tmpiil1ax.mozrunner\minidumps\98c0c60f-157d-4529-89ce-4945ac2b5842.dmp c:\users\task_1588953758\appdata\local\temp\tmp2fmj4k
[task 2020-05-08T16:39:52.489Z] 16:39:52 INFO - mozcrash Saved minidump as Z:\task_1588953758\build\blobber_upload_dir\98c0c60f-157d-4529-89ce-4945ac2b5842.dmp
[task 2020-05-08T16:39:52.489Z] 16:39:52 INFO - PROCESS-CRASH | Main app process exited normally | application crashed [None]
[task 2020-05-08T16:39:52.489Z] 16:39:52 INFO - Crash dump filename: c:\users\task_1588953758\appdata\local\temp\tmpiil1ax.mozrunner\minidumps\98c0c60f-157d-4529-89ce-4945ac2b5842.dmp
[task 2020-05-08T16:39:52.489Z] 16:39:52 INFO - stderr from minidump_stackwalk:
[task 2020-05-08T16:39:52.489Z] 16:39:52 INFO - 2020-05-08 16:39:52: minidump_stackwalk.cc:141: ERROR: MinidumpProcessor::Process failed
[task 2020-05-08T16:39:52.489Z] 16:39:52 INFO - mozcrash Copy/paste: Z:/task_1588953758/fetches\minidump_stackwalk\minidump_stackwalk.exe c:\users\task_1588953758\appdata\local\temp\tmpiil1ax.mozrunner\minidumps\044ea549-be43-49de-87da-15dcec96731e.dmp c:\users\task_1588953758\appdata\local\temp\tmp2fmj4k
[task 2020-05-08T16:39:52.510Z] 16:39:52 INFO - mozcrash Saved minidump as Z:\task_1588953758\build\blobber_upload_dir\044ea549-be43-49de-87da-15dcec96731e.dmp
[task 2020-05-08T16:39:52.510Z] 16:39:52 INFO - PROCESS-CRASH | Main app process exited normally | application crashed [None]
[task 2020-05-08T16:39:52.510Z] 16:39:52 INFO - Crash dump filename: c:\users\task_1588953758\appdata\local\temp\tmpiil1ax.mozrunner\minidumps\044ea549-be43-49de-87da-15dcec96731e.dmp
[task 2020-05-08T16:39:52.510Z] 16:39:52 INFO - stderr from minidump_stackwalk:
[task 2020-05-08T16:39:52.510Z] 16:39:52 INFO - 2020-05-08 16:39:52: minidump_stackwalk.cc:141: ERROR: MinidumpProcessor::Process failed
[task 2020-05-08T16:39:52.661Z] 16:39:52 INFO - Stopping web server
[task 2020-05-08T16:39:52.661Z] 16:39:52 INFO - Stopping web socket server
[task 2020-05-08T16:39:52.686Z] 16:39:52 INFO - Stopping ssltunnel
[task 2020-05-08T16:39:52.704Z] 16:39:52 WARNING - leakcheck | refcount logging is off, so leaks can't be detected!

Comment 1

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

Gijs, are you the person to look into this or should a person from Fission get needinfoed?

Comment 2

[:Gijs (he/him)]

This is pretty confusing, because all the tests complete and the process shuts down, logs:

[task 2020-05-08T16:39:48.966Z] 16:39:48     INFO - TEST-INFO | Main app process: exit 0

and then we find that some processes have crashed, and we think they are main processes:

[task 2020-05-08T16:39:52.452Z] 16:39:52 INFO - PROCESS-CRASH | Main app process exited normally | application crashed [None]
[task 2020-05-08T16:39:52.471Z] 16:39:52 INFO - PROCESS-CRASH | Main app process exited normally | application crashed [None]
[task 2020-05-08T16:39:52.489Z] 16:39:52 INFO - PROCESS-CRASH | Main app process exited normally | application crashed [None]
[task 2020-05-08T16:39:52.510Z] 16:39:52 INFO - PROCESS-CRASH | Main app process exited normally | application crashed [None]

But parsing the minidump fails, so there is no more information. It also doesn't make much sense that it thinks 4 main processes have crashed, while it also thinks the main process exited successfully. But I don't know how to read the minidump files.

Without stack information, I don't know how to investigate here or who would be the best person. :njn, do you know how I'd get stacks out of these minidumps, and/or why there are no stacks on infra?

Comment 3

[Nicholas Nethercote [inactive]]

gsvelto is the expert on minidump stacks, let's ask him!

Comment 4

[Gabriele Svelto [:gsvelto]]

From the looks of it four child processes got stuck and were found orphaned at the end of the run. I'll inspect the minidumps next week to figure out why. Leaving the NI? for now.

Comment 5

[Intermittent Failures Robot]

1 failures in 5276 pushes (0.0 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 1

Platform breakdown:

• windows10-64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1636567&startday=2020-05-04&endday=2020-05-10&tree=all

Comment 6

[Jean-Yves Avenard [:jya]]

Attachment: image.png

Comment 7

[Jean-Yves Avenard [:jya]]

I can reproduce a crash, no stack trace running the following command on my local win64 debug build:
./mach test --enable-fission browser/components/extensions/test/browser/browser_ext_tabs_saveAsPDF.js

Comment 8

[:Gijs (he/him)]

(In reply to Jean-Yves Avenard [:jya] from comment #7)

I can reproduce a crash, no stack trace running the following command on my local win64 debug build:
./mach test --enable-fission browser/components/extensions/test/browser/browser_ext_tabs_saveAsPDF.js

This is a different test, right? And if it's a debug build, can you run it with --debugger=devenv and get msvs to break instead of show the dialog, and get a stacktrace? The file listed in the dialog is non-mozilla code. Also, out of interest, why do you think this is the same problem?

Comment 9

[Jean-Yves Avenard [:jya]]

(In reply to :Gijs (he/him) from comment #8)

(In reply to Jean-Yves Avenard [:jya] from comment #7)

I can reproduce a crash, no stack trace running the following command on my local win64 debug build:
./mach test --enable-fission browser/components/extensions/test/browser/browser_ext_tabs_saveAsPDF.js

This is a different test, right? And if it's a debug build, can you run it with --debugger=devenv and get msvs to break instead of show the dialog, and get a stacktrace? The file listed in the dialog is non-mozilla code. Also, out of interest, why do you think this is the same problem?

It is a different test yes, but this bug is the suggestion provided when the crash occurs like here:
https://treeherder.mozilla.org/logviewer.html#?job_id=301864880&repo=try

Crash is always happening with the bc1 test; and doesn't point to any particular test, just a folder to which the test in this bug can be found.

When I attempted to reproduce; I got a crash with just browser_ext_tabs_saveAsPDF.js ; so I thought that was help narrow down what the issue could be,

Comment 10

[Jean-Yves Avenard [:jya]]

(In reply to :Gijs (he/him) from comment #8)

(In reply to Jean-Yves Avenard [:jya] from comment #7)

I can reproduce a crash, no stack trace running the following command on my local win64 debug build:
./mach test --enable-fission browser/components/extensions/test/browser/browser_ext_tabs_saveAsPDF.js

This is a different test, right? And if it's a debug build, can you run it with --debugger=devenv and get msvs to break instead of show the dialog, and get a stacktrace? The file listed in the dialog is non-mozilla code. Also, out of interest, why do you think this is the same problem?

oh, and no, I can't get msvs to break on that code; I get the window instead.

Comment 11

[Intermittent Failures Robot]

3 failures in 5488 pushes (0.001 failures/push) were associated with this bug in the last 7 days.

Repository breakdown:

• mozilla-central: 3

Platform breakdown:

• windows10-64: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1636567&startday=2020-05-11&endday=2020-05-17&tree=all

Comment 12

[Gabriele Svelto [:gsvelto]]

This looks like a nasty issue: the crashes are not only orphaned - i.e. they miss the .extra file - they're usually malformed too. Either the minidump contains only the first few headers (worth a few KiBs) but they're empty, or it's almost entirely empty having only the 64 bytes header. Since minidumps are generated in the main process I suspect they're generated at a stage where the main process is too far along shutdown to produce something meaningful. Or it could be a result of some of the issues I've been addressing recently in Breakpad. I'm fixing a really nasty race that affects Windows in bug 1628399; I'll wait for that too land before having a second look, hoping that maybe this is a side-effect from the race.

Comment 13

[BugBot [:suhaib / :marco/ :calixte]]

https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
For more information, please visit auto_nag documentation.