Open Bug 1635776 Opened 5 years ago Updated 2 months ago

Intermittent OSError: IO Completion Port failed to signal process shutdown

Categories

(Testing :: Mozbase, defect, P5)

Version 3
All
Windows
defect

Tracking

(Not tracked)

REOPENED

People

(Reporter: intermittent-bug-filer, Unassigned)

References

(Depends on 1 open bug, Blocks 1 open bug, Regression)

Details

(Keywords: intermittent-failure, regression, Whiteboard: [stockwell unknown])

Filed by: rgurzau [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=301014112&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/X-DK4v-VS3CdlLwl5Zq1eA/runs/0/artifacts/public/logs/live_backing.log


[task 2020-05-06T13:02:15.380Z] 13:02:15 ERROR - Traceback (most recent call last):
[task 2020-05-06T13:02:15.380Z] 13:02:15 INFO - File "C:\Users\task_1588767109\build\tests\raptor\raptor\raptor.py", line 201, in <module>
[task 2020-05-06T13:02:15.380Z] 13:02:15 INFO - main()
[task 2020-05-06T13:02:15.380Z] 13:02:15 INFO - File "C:\Users\task_1588767109\build\tests\raptor\raptor\raptor.py", line 148, in main
[task 2020-05-06T13:02:15.380Z] 13:02:15 INFO - success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2020-05-06T13:02:15.381Z] 13:02:15 INFO - File "C:\Users\task_1588767109\build\tests\raptor\raptor\perftest.py", line 373, in run_tests
[task 2020-05-06T13:02:15.381Z] 13:02:15 INFO - self.run_test(test, timeout=int(test.get("page_timeout")))
[task 2020-05-06T13:02:15.381Z] 13:02:15 INFO - File "C:\Users\task_1588767109\build\tests\raptor\raptor\webextension\desktop.py", line 99, in run_test
[task 2020-05-06T13:02:15.381Z] 13:02:15 INFO - self.__run_test_cold(test, timeout)
[task 2020-05-06T13:02:15.381Z] 13:02:15 INFO - File "C:\Users\task_1588767109\build\tests\raptor\raptor\webextension\desktop.py", line 175, in __run_test_cold
[task 2020-05-06T13:02:15.381Z] 13:02:15 INFO - self.wait_for_test_finish(test, timeout, self.process_exists)
[task 2020-05-06T13:02:15.381Z] 13:02:15 INFO - File "C:\Users\task_1588767109\build\tests\raptor\raptor\webextension\base.py", line 128, in wait_for_test_finish
[task 2020-05-06T13:02:15.382Z] 13:02:15 INFO - self.control_server.wait_for_quit()
[task 2020-05-06T13:02:15.382Z] 13:02:15 INFO - File "C:\Users\task_1588767109\build\tests\raptor\raptor\control_server.py", line 425, in wait_for_quit
[task 2020-05-06T13:02:15.382Z] 13:02:15 INFO - self.browser_proc.wait(timeout)
[task 2020-05-06T13:02:15.382Z] 13:02:15 INFO - File "C:\Users\task_1588767109\build\venv\lib\site-packages\mozprocess\processhandler.py", line 948, in wait
[task 2020-05-06T13:02:15.382Z] 13:02:15 INFO - self.returncode = self.proc.wait()
[task 2020-05-06T13:02:15.382Z] 13:02:15 INFO - File "C:\Users\task_1588767109\build\venv\lib\site-packages\mozprocess\processhandler.py", line 260, in wait
[task 2020-05-06T13:02:15.382Z] 13:02:15 INFO - self.returncode = self._custom_wait(timeout=timeout)
[task 2020-05-06T13:02:15.382Z] 13:02:15 INFO - File "C:\Users\task_1588767109\build\venv\lib\site-packages\mozprocess\processhandler.py", line 587, in _custom_wait
[task 2020-05-06T13:02:15.383Z] 13:02:15 INFO - raise OSError("IO Completion Port failed to signal process shutdown")
[task 2020-05-06T13:02:15.383Z] 13:02:15 INFO - OSError: IO Completion Port failed to signal process shutdown
[task 2020-05-06T13:02:15.464Z] 13:02:15 ERROR - Return code: 1
[task 2020-05-06T13:02:15.464Z] 13:02:15 WARNING - setting return code to 1
[task 2020-05-06T13:02:15.464Z] 13:02:15 INFO - Copying Raptor results to upload dir:
[task 2020-05-06T13:02:15.465Z] 13:02:15 INFO - C:\Users\task_1588767109\build\blobber_upload_dir\perfherder-data.json
[task 2020-05-06T13:02:15.473Z] 13:02:15 INFO - Copying raptor results from C:\Users\task_1588767109\build\raptor.json to C:\Users\task_1588767109\build\blobber_upload_dir\perfherder-data.json
[task 2020-05-06T13:02:15.473Z] 13:02:15 CRITICAL - Error copying results C:\Users\task_1588767109\build\raptor.json to upload dir C:\Users\task_1588767109\build\blobber_upload_dir\perfherder-data.json
[task 2020-05-06T13:02:15.474Z] 13:02:15 INFO - [Errno 2] No such file or directory: u'C:\Users\task_1588767109\build\raptor.json'

Looks like this is a problem that's exclusive to windows (reference hardware).

Moving to mozbase since this looks like a mozprocess failure on windows 10-64 ref 2017

Component: Raptor → Mozbase
Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---

Recent failures here are browsertime, should we open a separate bug or is this one fine?

[task 2021-02-24T03:10:23.280Z] 03:10:23 INFO - raptor-mitmproxy Info: Verified mitmproxy CA certificate is installed in Firefox
[task 2021-02-24T03:10:23.280Z] 03:10:23 INFO - raptor-perftest Info: Playback recording information not available
[task 2021-02-24T03:10:23.281Z] 03:10:23 INFO - raptor-browsertime Info: test: {'expected_browser_cycles': 25, u'alert_threshold': u'2.0', u'playback_pageset_manifest': u'mitm5-linux-firefox-paypal.manifest', u'browser_cycles': u'25', 'here': u'C:\Users\task_1613996340\build\tests\raptor\raptor\tests\tp6\desktop', u'measure': [u'fnbpaint', u'fcp', u'dcf', u'loadtime'], 'path': u'C:\Users\task_1613996340\build\tests\raptor\raptor\tests\tp6\desktop\paypal', 'manifest_relpath': u'tests\tp6\desktop\browsertime-tp6.ini', 'cold': True, u'unit': u'ms', u'use_live_sites': u'false', u'alert_on': [u'fcp', u'loadtime'], u'type': u'pageload', 'name': u'paypal', u'playback_recordings': u'mitm5-linux-firefox-paypal.mp', u'page_cycles': 2, u'apps': u'firefox, chrome, chromium', u'test_url': u'https://www.paypal.com/myaccount/summary/', 'manifest': u'C:\Users\task_1613996340\build\tests\raptor\raptor\tests\tp6\desktop\browsertime-tp6.ini', 'ancestor_manifest': 'raptor.ini', u'page_timeout': u'60000', u'playback_version': u'5.1.1', u'playback': u'mitmproxy', 'browser_cycle': 1, 'expected': 'pass', u'lower_is_better': True, 'relpath': u'tests\tp6\desktop\paypal'}
[task 2021-02-24T03:10:23.281Z] 03:10:23 INFO - raptor-browsertime-desktop Info: binary_path: C:\Users\task_1613996340\build\application\firefox\firefox.exe
[task 2021-02-24T03:10:23.281Z] 03:10:23 INFO - raptor-browsertime Info: Using Firefox Window Recorder for videos
[task 2021-02-24T03:10:23.281Z] 03:10:23 INFO - raptor-browsertime Info: timeout (s): 60000
[task 2021-02-24T03:10:23.281Z] 03:10:23 INFO - raptor-browsertime Info: browsertime cwd: C:\Users\task_1613996340\build
[task 2021-02-24T03:10:23.281Z] 03:10:23 INFO - raptor-browsertime Info: browsertime cmd: C:/Users/task_1613996340/fetches/node/node.exe C:/Users/task_1613996340/fetches/browsertime/node_modules/browsertime/bin/browsertime.js --firefox.geckodriverPath C:/Users/task_1613996340/fetches/geckodriver.exe C:\Users\task_1613996340\build\tests\raptor\raptor\browsertime....\browsertime\browsertime_pageload.js --viewPort 1024x768 --browser firefox --firefox.binaryPath C:\Users\task_1613996340\build\application\firefox\firefox.exe --browsertime.page_cycles 2 --browsertime.url https://www.paypal.com/myaccount/summary/ --browsertime.page_cycle_delay 1000 --browsertime.post_startup_delay 30000 --firefox.profileTemplate c:\users\task_1613996340\appdata\local\temp\tmpti6_pi.mozrunner --skipHar --pageLoadStrategy none --webdriverPageload true --firefox.disableBrowsertimeExtension true --pageCompleteCheckStartWait 5000 --pageCompleteCheckPollTimeout 1000 --timeouts.pageLoad 60000 --timeouts.script 120000 --resultDir C:\Users\task_1613996340\build\blobber_upload_dir\browsertime-results\paypal --firefox.env MOZ_WEBRENDER=1 --firefox.env MOZ_ACCELERATED=1 --video true --visualMetrics false --firefox.windowRecorder true -n 25
[task 2021-02-24T03:10:23.282Z] 03:10:23 INFO - raptor-browsertime Info: browsertime_ffmpeg: C:/Users/task_1613996340/fetches/ffmpeg-4.1.1-win64-static/bin/ffmpeg.exe
[task 2021-02-24T03:10:23.282Z] 03:10:23 INFO - raptor-browsertime Info: PATH: C:\Users\task_1613996340\fetches\ffmpeg-4.1.1-win64-static\bin;C:\Users\task_1613996340\build\venv\Scripts;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0;C:\windows\System32\OpenSSH;C:\Program Files\Puppet Labs\Puppet\bin;C:\Program Files\Mellanox\MLNX_VPI\IB\Tools;C:\Program Files\Mellanox\MLNX_CIMProvider\lib\mft;C:\Program Files\Git\cmd;C:\Program Files (x86)\GNU\GnuPG\pub;C:\Program Files\Mercurial;C:\Program Files\Mercurial;C:\mozilla-build\bin;C:\mozilla-build\kdiff;C:\mozilla-build\moztools-x64\bin;C:\mozilla-build\mozmake;C:\mozilla-build\nsis-3.01;C:\mozilla-build\python;C:\mozilla-build\python\Scripts;C:\mozilla-build\python3;C:\mozilla-build\msys\bin;C:\mozilla-build\msys\local\bin;C:\Program Files (x86)\Windows Kits\10\Windows Performance Toolkit;C:\Users\task_1613996340\AppData\Local\Microsoft\WindowsApps
[task 2021-02-24T03:10:24.065Z] 03:10:24 INFO - raptor-browsertime Info: Running tests using Firefox - 25 iteration(s)
[task 2021-02-24T03:11:24.069Z] 03:11:24 INFO - raptor-browsertime Info: firefox failed to start, trying 2 more time(s): Failed to start firefox in 60 seconds.
[task 2021-02-24T03:12:24.070Z] 03:12:24 INFO - raptor-browsertime Info: firefox failed to start, trying 1 more time(s): Failed to start firefox in 60 seconds.
[task 2021-02-24T03:13:24.079Z] 03:13:24 INFO - raptor-browsertime Info: firefox failed to start, trying 0 more time(s): Failed to start firefox in 60 seconds.
[task 2021-02-24T03:16:54.098Z] 03:16:54 CRITICAL - raptor-browsertime Critical: IO Completion Port failed to signal process shutdown
[task 2021-02-24T03:16:54.098Z] 03:16:54 INFO - raptor-mitmproxy Info: MitmproxyDesktop stop!!
[task 2021-02-24T03:16:54.098Z] 03:16:54 INFO - raptor-mitmproxy Info: Mitmproxy stop!!
[task 2021-02-24T03:16:54.098Z] 03:16:54 INFO - raptor-mitmproxy Info: Stopping mitmproxy playback, killing process 1216
[task 2021-02-24T03:16:54.098Z] 03:16:54 INFO - raptor-mitmproxy Info: Sending CTRL_BREAK_EVENT to mitmproxy
[task 2021-02-24T03:16:56.109Z] 03:16:56 INFO - raptor-mitmproxy Info: Successfully killed the mitmproxy playback process
[task 2021-02-24T03:16:56.109Z] 03:16:56 INFO - raptor-mitmproxy Info: Turning off the browser proxy
[task 2021-02-24T03:16:56.109Z] 03:16:56 INFO - raptor-mitmproxy Info: writing: C:\Users\task_1613996340\build\application\firefox\distribution\policies.json
[task 2021-02-24T03:16:56.114Z] 03:16:56 INFO - Exception in thread ProcessReader:
[task 2021-02-24T03:16:56.114Z] 03:16:56 ERROR - Traceback (most recent call last):
[task 2021-02-24T03:16:56.114Z] 03:16:56 INFO - File "c:\mozilla-build\python\lib\threading.py", line 801, in __bootstrap_inner
[task 2021-02-24T03:16:56.114Z] 03:16:56 INFO - self.run()
[task 2021-02-24T03:16:56.114Z] 03:16:56 INFO - File "c:\mozilla-build\python\lib\threading.py", line 754, in run
[task 2021-02-24T03:16:56.114Z] 03:16:56 INFO - self.__target(*self.__args, **self.__kwargs)
[task 2021-02-24T03:16:56.114Z] 03:16:56 INFO - File "C:\Users\task_1613996340\build\venv\lib\site-packages\mozprocess\processhandler.py", line 1265, in _read
[task 2021-02-24T03:16:56.115Z] 03:16:56 INFO - callback(line.rstrip())
[task 2021-02-24T03:16:56.115Z] 03:16:56 INFO - File "C:\Users\task_1613996340\build\venv\lib\site-packages\mozprocess\processhandler.py", line 1171, in call
[task 2021-02-24T03:16:56.115Z] 03:16:56 INFO - e(*args, **kwargs)
[task 2021-02-24T03:16:56.115Z] 03:16:56 INFO - File "C:\Users\task_1613996340\build\tests\raptor\raptor\browsertime\base.py", line 419, in _line_handler
[task 2021-02-24T03:16:56.115Z] 03:16:56 INFO - raise Exception("Browsertime failed to run")
[task 2021-02-24T03:16:56.115Z] 03:16:56 INFO - Exception: Browsertime failed to run
[task 2021-02-24T03:16:56.116Z] 03:16:56 ERROR - Traceback (most recent call last):
[task 2021-02-24T03:16:56.116Z] 03:16:56 INFO - File "C:\Users\task_1613996340\build\venv\lib\site-packages\mozprocess\processhandler.py", line 701, in _custom_wait
[task 2021-02-24T03:16:56.116Z] 03:16:56 INFO - item = self._process_events.get(timeout=timeout)
[task 2021-02-24T03:16:56.116Z] 03:16:56 INFO - File "c:\mozilla-build\python\lib\Queue.py", line 176, in get
[task 2021-02-24T03:16:56.116Z] 03:16:56 INFO - raise Empty
[task 2021-02-24T03:16:56.117Z] 03:16:56 INFO - Empty
[task 2021-02-24T03:16:56.117Z] 03:16:56 INFO - IO Completion Port unexpectedly closed

Flags: needinfo?(aryx.bugmail)

Greg, this surfaced after browsertime on Windows got enabled in bug 1667396.

Flags: needinfo?(aryx.bugmail) → needinfo?(gmierz2)
Regressed by: 1667396

There are 46 total failures in the last 7 days on windows10-64-ref-hw-2017 opt
Recent failure log: https://treeherder.mozilla.org/logviewer?job_id=331288016&repo=mozilla-central&lineNumber=1316

[task 2021-02-26T04:20:55.227Z] 04:20:55 INFO - raptor-browsertime Info: Stop firefox window recorder.
[task 2021-02-26T04:20:59.131Z] 04:20:59 INFO - raptor-browsertime Info: Browsertime pageload ended.
[task 2021-02-26T04:22:16.985Z] 04:22:16 INFO - raptor-browsertime Info: https://www.bing.com/search?q=barack+obama TTFB: 13ms DOMContentLoaded: 499ms firstPaint: 294ms FCP: 291ms Load: 501ms
[task 2021-02-26T04:22:16.985Z] 04:22:16 INFO - raptor-browsertime Info: https://www.bing.com/search?q=barack+obama&browsertime_run=2 TTFB: 120ms DOMContentLoaded: 213ms firstPaint: 221ms FCP: 216ms Load: 214ms
[task 2021-02-26T04:23:16.989Z] 04:23:16 INFO - raptor-browsertime Info: firefox failed to start, trying 2 more time(s): Failed to start firefox in 60 seconds.
[task 2021-02-26T04:24:16.978Z] 04:24:16 INFO - raptor-browsertime Info: firefox failed to start, trying 1 more time(s): Failed to start firefox in 60 seconds.
[task 2021-02-26T04:25:16.983Z] 04:25:16 INFO - raptor-browsertime Info: firefox failed to start, trying 0 more time(s): Failed to start firefox in 60 seconds.
[task 2021-02-26T04:28:57.995Z] 04:28:57 CRITICAL - raptor-browsertime Critical: IO Completion Port failed to signal process shutdown
[task 2021-02-26T04:28:57.995Z] 04:28:57 INFO - raptor-mitmproxy Info: MitmproxyDesktop stop!!
[task 2021-02-26T04:28:57.995Z] 04:28:57 INFO - raptor-mitmproxy Info: Mitmproxy stop!!
[task 2021-02-26T04:28:57.996Z] 04:28:57 INFO - raptor-mitmproxy Info: Stopping mitmproxy playback, killing process 5320
[task 2021-02-26T04:28:57.996Z] 04:28:57 INFO - raptor-mitmproxy Info: Sending CTRL_BREAK_EVENT to mitmproxy
[task 2021-02-26T04:29:04.947Z] 04:29:04 INFO - raptor-mitmproxy Info: Successfully killed the mitmproxy playback process with exit code 572
[task 2021-02-26T04:29:04.947Z] 04:29:04 INFO - raptor-mitmproxy Info: Turning off the browser proxy
[task 2021-02-26T04:29:04.947Z] 04:29:04 INFO - raptor-mitmproxy Info: writing: C:\Users\task_1614306667\build\application\firefox\distribution\policies.json
[task 2021-02-26T04:29:05.271Z] 04:29:05 INFO - Exception in thread ProcessReader:
[task 2021-02-26T04:29:05.271Z] 04:29:05 ERROR - Traceback (most recent call last):
[task 2021-02-26T04:29:05.271Z] 04:29:05 INFO - File "c:\mozilla-build\python\lib\threading.py", line 801, in __bootstrap_inner
[task 2021-02-26T04:29:05.271Z] 04:29:05 INFO - self.run()
[task 2021-02-26T04:29:05.271Z] 04:29:05 INFO - File "c:\mozilla-build\python\lib\threading.py", line 754, in run
[task 2021-02-26T04:29:05.272Z] 04:29:05 INFO - self.__target(*self.__args, **self.__kwargs)
[task 2021-02-26T04:29:05.272Z] 04:29:05 INFO - File "C:\Users\task_1614306667\build\venv\lib\site-packages\mozprocess\processhandler.py", line 1272, in _read
[task 2021-02-26T04:29:05.272Z] 04:29:05 INFO - callback(line.rstrip())
[task 2021-02-26T04:29:05.272Z] 04:29:05 INFO - File "C:\Users\task_1614306667\build\venv\lib\site-packages\mozprocess\processhandler.py", line 1178, in call
[task 2021-02-26T04:29:05.272Z] 04:29:05 INFO - e(*args, **kwargs)
[task 2021-02-26T04:29:05.272Z] 04:29:05 INFO - File "C:\Users\task_1614306667\build\tests\raptor\raptor\browsertime\base.py", line 419, in _line_handler
[task 2021-02-26T04:29:05.273Z] 04:29:05 INFO - raise Exception("Browsertime failed to run")
[task 2021-02-26T04:29:05.273Z] 04:29:05 INFO - Exception: Browsertime failed to run
[task 2021-02-26T04:29:05.273Z] 04:29:05 ERROR - Traceback (most recent call last):
[task 2021-02-26T04:29:05.273Z] 04:29:05 INFO - File "C:\Users\task_1614306667\build\venv\lib\site-packages\mozprocess\processhandler.py", line 708, in _custom_wait
[task 2021-02-26T04:29:05.273Z] 04:29:05 INFO - item = self._process_events.get(timeout=timeout)
[task 2021-02-26T04:29:05.273Z] 04:29:05 INFO - File "c:\mozilla-build\python\lib\Queue.py", line 176, in get
[task 2021-02-26T04:29:05.273Z] 04:29:05 INFO - raise Empty
[task 2021-02-26T04:29:05.274Z] 04:29:05 INFO - Empty
[task 2021-02-26T04:29:05.274Z] 04:29:05 INFO - IO Completion Port unexpectedly closed
[task 2021-02-26T04:29:05.274Z] 04:29:05 ERROR - Traceback (most recent call last):
[task 2021-02-26T04:29:05.274Z] 04:29:05 INFO - File "C:\Users\task_1614306667\build\tests\raptor\raptor\raptor.py", line 212, in <module>
[task 2021-02-26T04:29:05.274Z] 04:29:05 INFO - main()
[task 2021-02-26T04:29:05.274Z] 04:29:05 INFO - File "C:\Users\task_1614306667\build\tests\raptor\raptor\raptor.py", line 158, in main
[task 2021-02-26T04:29:05.274Z] 04:29:05 INFO - success = raptor.run_tests(raptor_test_list, raptor_test_names)
[task 2021-02-26T04:29:05.274Z] 04:29:05 INFO - File "C:\Users\task_1614306667\build\tests\raptor\raptor\perftest.py", line 395, in run_tests
[task 2021-02-26T04:29:05.275Z] 04:29:05 INFO - self.run_test(test, timeout=int(test.get("page_timeout")))
[task 2021-02-26T04:29:05.275Z] 04:29:05 INFO - File "C:\Users\task_1614306667\build\tests\raptor\raptor\browsertime\base.py", line 455, in run_test
[task 2021-02-26T04:29:05.275Z] 04:29:05 INFO - proc.wait()
[task 2021-02-26T04:29:05.275Z] 04:29:05 INFO - File "C:\Users\task_1614306667\build\venv\lib\site-packages\mozprocess\processhandler.py", line 1096, in wait
[task 2021-02-26T04:29:05.275Z] 04:29:05 INFO - self.returncode = self.proc.wait()
[task 2021-02-26T04:29:05.275Z] 04:29:05 INFO - File "C:\Users\task_1614306667\build\venv\lib\site-packages\mozprocess\processhandler.py", line 284, in wait
[task 2021-02-26T04:29:05.275Z] 04:29:05 INFO - self.returncode = self._custom_wait(timeout=timeout)
[task 2021-02-26T04:29:05.275Z] 04:29:05 INFO - File "C:\Users\task_1614306667\build\venv\lib\site-packages\mozprocess\processhandler.py", line 715, in _custom_wait
[task 2021-02-26T04:29:05.276Z] 04:29:05 INFO - "IO Completion Port failed to signal process shutdown"
[task 2021-02-26T04:29:05.276Z] 04:29:05 INFO - OSError: IO Completion Port failed to signal process shutdown
[task 2021-02-26T04:29:05.464Z] 04:29:05 ERROR - Return code: 1
[task 2021-02-26T04:29:05.464Z] 04:29:05 WARNING - setting return code to 1

Whiteboard: [stockwell needswork:owner]

I'm not entirely sure why but this issue seems to be resolved. There have been no failures since Feb 25th. I think the patch from bug 1694525 may have fixed it.

Flags: needinfo?(gmierz2)
See Also: → 1694525

Related traceback here:

https://treeherder.mozilla.org/logviewer?job_id=332084116&repo=mozilla-beta&lineNumber=48610-48615

[task 2021-03-04T18:42:38.476Z] 18:42:38     INFO -  Traceback (most recent call last):
[task 2021-03-04T18:42:38.476Z] 18:42:38     INFO -    File "Z:\task_1614880213\build\venv\lib\site-packages\mozprocess\processhandler.py", line 701, in _custom_wait
[task 2021-03-04T18:42:38.476Z] 18:42:38     INFO -      item = self._process_events.get(timeout=timeout)
[task 2021-03-04T18:42:38.476Z] 18:42:38     INFO -    File "c:\mozilla-build\python\lib\Queue.py", line 176, in get
[task 2021-03-04T18:42:38.476Z] 18:42:38     INFO -      raise Empty
[task 2021-03-04T18:42:38.476Z] 18:42:38     INFO -  Empty
Status: REOPENED → NEW
OS: Unspecified → Windows
Hardware: Unspecified → All
Status: NEW → RESOLVED
Closed: 4 years ago3 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
See Also: → 1736256
Status: REOPENED → RESOLVED
Closed: 3 years ago3 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 3 years ago3 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 3 years ago2 years ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Severity: normal → S3
Duplicate of this bug: 1801001
Duplicate of this bug: 1801749
Duplicate of this bug: 1803084

Hi Geoff, earlier today I have written a Marionette tests to stress-test Firefox restarts. As it looks like with an iteration of 40 we can trigger this failure permanently for CI jobs. Maybe it could help to investigate the problem we are seeing here in case it's the same underlying one? What do you think? I'm happy to trigger another try with mozprocess logging turned on as well if that would help. Just let me know.

https://treeherder.mozilla.org/jobs?repo=try&revision=1e6fd04a1dc3025ac37c69da75cc7d704741c9fb&selectedTaskRun=D32uUCFKRxCDcCU4Zyr5vA.0

Flags: needinfo?(gbrown)

Oh, that's interesting - well done!
Unfortunately, I don't think I have time to look into it - sorry.

Flags: needinfo?(gbrown)
Duplicate of this bug: 1824129

Note that this failure was mainly happen on Windows. Maybe my upcoming patch on bug 1493796 might help for that platform.

Status: REOPENED → NEW
Depends on: 1493796
Duplicate of this bug: 1848250
Status: NEW → RESOLVED
Closed: 2 years ago1 year ago
Resolution: --- → INCOMPLETE
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
See Also: → 1843347
You need to log in before you can comment on or make changes to this bug.