Closed Bug 1689184 Opened 4 years ago Closed 4 years ago

Perma [OSX][esr78] xpcshell selftest OSError: [Errno 24] Too many open files

Categories

(Testing :: XPCShell Harness, defect, P5)

defect

Tracking

(firefox-esr7886+ fixed)

RESOLVED FIXED
Tracking Status
firefox-esr78 86+ fixed

People

(Reporter: intermittent-bug-filer, Assigned: mhentges)

References

(Regression)

Details

(Keywords: intermittent-failure)

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer?job_id=328002336&repo=mozilla-esr78
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/O6zu_YE9T6yssIR3-OmJkQ/runs/0/artifacts/public/logs/live_backing.log


[task 2021-01-27T18:15:15.114Z] 18:15:15     INFO -  '__PYVENV_LAUNCHER__': '/usr/local/bin/python3'}
[task 2021-01-27T18:15:15.115Z] 18:15:15     INFO - Calling ['/Users/cltbld/tasks/task_1611770787/build/venv/bin/python', '-u', '/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py', u'browser/components/about/test/unit/xpcshell.ini', u'browser/components/attribution/test/xpcshell/xpcshell.ini', u'browser/components/extensions/test/xpcshell/xpcshell.ini', u'browser/components/installerprefs/test/unit/xpcshell.ini', u'browser/components/newtab/test/xpcshell/xpcshell.ini', u'browser/components/payments/test/unit/xpcshell.ini', u'browser/components/places/tests/unit/xpcshell.ini', u'browser/components/search/test/unit/xpcshell.ini', u'browser/components/sessionstore/test/unit/xpcshell.ini', u'browser/components/shell/test/unit/xpcshell.ini', u'browser/components/ssb/tests/xpcshell/xpcshell.ini', u'browser/components/tests/unit/xpcshell.ini', u'browser/modules/test/unit/xpcshell.ini', u'browser/tools/mozscreenshots/tests/xpcshell/xpcshell.ini', u'chrome/test/unit_ipc/xpcshell.ini', u'devtools/client/aboutdebugging/test/xpcshell/xpcshell.ini', u'devtools/client/application/test/xpcshell/xpcshell.ini', u'devtools/client/framework/test/xpcshell/xpcshell.ini', u'devtools/client/netmonitor/test/xpcshell/xpcshell.ini', u'devtools/client/responsive/test/xpcshell/xpcshell.ini', u'devtools/client/shared/redux/middleware/xpcshell/xpcshell.ini', u'devtools/client/shared/remote-debugging/test/xpcshell/xpcshell.ini', u'devtools/shared/heapsnapshot/tests/xpcshell/xpcshell.ini', u'devtools/shared/performance/xpcshell/xpcshell.ini', u'devtools/shared/protocol/tests/xpcshell/xpcshell.ini', u'devtools/shared/security/tests/xpcshell/xpcshell.ini', u'devtools/shared/storage/vendor/stringvalidator/tests/xpcshell/xpcshell.ini', u'devtools/shared/transport/tests/xpcshell/xpcshell.ini', u'devtools/startup/tests/xpcshell/xpcshell.ini', u'docshell/test/unit_ipc/xpcshell.ini', u'dom/cache/test/xpcshell/xpcshell.ini', u'dom/console/tests/xpcshell/xpcshell.ini', u'dom/encoding/test/unit/xpcshell.ini', u'dom/file/tests/xpcshell.ini', u'dom/ipc/tests/xpcshell.ini', u'dom/media/webvtt/tests/xpcshell.ini', u'dom/notification/test/unit/xpcshell.ini', u'dom/promise/tests/unit/xpcshell.ini', u'dom/push/test/xpcshell/xpcshell.ini', u'dom/security/test/unit/xpcshell.ini', u'dom/workers/test/xpcshell/xpcshell.ini', u'extensions/permissions/test/unit/xpcshell.ini', u'extensions/pref/autoconfig/test/unit/xpcshell.ini', u'intl/l10n/test/xpcshell.ini', u'intl/strres/tests/unit/xpcshell.ini', u'intl/uconv/tests/unit/xpcshell.ini', u'ipc/testshell/tests/xpcshell.ini', u'js/ductwork/debugger/tests/xpcshell.ini', u'js/xpconnect/tests/unit/xpcshell.ini', u'modules/libjar/zipwriter/test/unit/xpcshell.ini', u'modules/libmar/tests/unit/xpcshell.ini', u'modules/libpref/test/unit_ipc/xpcshell.ini', u'netwerk/test/httpserver/test/xpcshell.ini', u'netwerk/test/unit/xpcshell.ini', u'netwerk/test/unit_ipc/xpcshell.ini', u'remote/test/unit/xpcshell.ini', u'security/manager/ssl/tests/unit/xpcshell-smartcards.ini', u'security/manager/ssl/tests/unit/xpcshell.ini', u'services/common/tests/unit/xpcshell.ini', u'services/settings/test/unit/xpcshell.ini', u'services/sync/tests/unit/xpcshell.ini', u'testing/marionette/test/unit/xpcshell.ini', u'toolkit/components/aboutmemory/tests/xpcshell/xpcshell.ini', u'toolkit/components/asyncshutdown/tests/xpcshell/xpcshell.ini', u'toolkit/components/autocomplete/tests/unit/xpcshell.ini', u'toolkit/components/backgroundhangmonitor/tests/xpcshell.ini', u'toolkit/components/captivedetect/test/unit/xpcshell.ini', u'toolkit/components/cascade_bloom_filter/test/xpcshell/xpcshell.ini', u'toolkit/components/cleardata/tests/unit/xpcshell.ini', u'toolkit/components/commandlines/test/unit_unix/xpcshell.ini', u'toolkit/components/contentprefs/tests/unit_cps2/xpcshell.ini', u'toolkit/components/crashmonitor/test/unit/xpcshell.ini', u'toolkit/components/ctypes/tests/unit/xpcshell.ini', u'toolkit/components/extensions/test/xpcshell/native_messaging.ini', u'toolkit/components/extensions/test/xpcshell/xpcshell-e10s.ini', u'toolkit/components/extensions/test/xpcshell/xpcshell-remote.ini', u'toolkit/components/featuregates/test/unit/xpcshell.ini', u'toolkit/components/filewatcher/tests/xpcshell/xpcshell.ini', u'toolkit/components/kvstore/test/xpcshell/xpcshell.ini', u'toolkit/components/messaging-system/test/unit/xpcshell.ini', u'toolkit/components/normandy/test/unit/xpcshell.ini', u'toolkit/components/osfile/tests/xpcshell/xpcshell.ini', u'toolkit/components/passwordmgr/test/unit/xpcshell.ini', u'toolkit/components/places/tests/favicons/xpcshell.ini', u'toolkit/components/places/tests/history/xpcshell.ini', u'toolkit/components/places/tests/unifiedcomplete/xpcshell.ini', u'toolkit/components/promiseworker/tests/xpcshell/xpcshell.ini', u'toolkit/components/reputationservice/test/unit/xpcshell.ini', u'toolkit/components/search/tests/xpcshell/searchconfigs/xpcshell-1.ini', u'toolkit/components/search/tests/xpcshell/searchconfigs/xpcshell-2.ini', u'toolkit/components/search/tests/xpcshell/searchconfigs/xpcshell-3.ini', u'toolkit/components/search/tests/xpcshell/searchconfigs/xpcshell-4.ini', u'toolkit/components/search/tests/xpcshell/xpcshell.ini', u'toolkit/components/terminator/tests/xpcshell/xpcshell.ini', u'toolkit/components/thumbnails/test/xpcshell.ini', u'toolkit/components/timermanager/tests/unit/xpcshell.ini', u'toolkit/components/urlformatter/tests/unit/xpcshell.ini', u'toolkit/components/windowcreator/tests/unit/xpcshell.ini', u'toolkit/components/xulstore/tests/xpcshell/xpcshell.ini', u'toolkit/crashreporter/test/unit/xpcshell-phc.ini', u'toolkit/crashreporter/test/unit/xpcshell.ini', u'toolkit/crashreporter/test/unit_ipc/xpcshell-phc.ini', u'toolkit/modules/tests/xpcshell/xpcshell.ini', u'toolkit/mozapps/downloads/tests/unit/xpcshell.ini', u'toolkit/mozapps/extensions/test/xpcshell/xpcshell.ini', u'toolkit/mozapps/update/tests/unit_aus_update/xpcshell.ini', u'toolkit/mozapps/update/tests/unit_service_updater/xpcshell.ini', u'toolkit/profile/xpcshell/xpcshell.ini', u'toolkit/xre/test/xpcshell.ini', u'widget/headless/tests/xpcshell.ini', '--setpref=media.peerconnection.mtransport_process=false', '--setpref=network.process.enabled=false', '--self-test', '--symbols-path=/Users/cltbld/tasks/task_1611770787/build/symbols', '--test-plugin-path=/Users/cltbld/tasks/task_1611770787/build/application/Firefox NightlyDebug.app/Contents/Resources/plugins', '--log-raw=/Users/cltbld/tasks/task_1611770787/build/blobber_upload_dir/xpcshell_raw.log', '--log-errorsummary=/Users/cltbld/tasks/task_1611770787/build/blobber_upload_dir/xpcshell_errorsummary.log', '--utility-path=tests/bin', '--xpcshell=/Users/cltbld/tasks/task_1611770787/build/application/Firefox NightlyDebug.app/Contents/MacOS/xpcshell', '--manifest=tests/xpcshell/tests/xpcshell.ini'] with output_timeout 1000
[task 2021-01-27T18:15:16.450Z] 18:15:16     INFO -  testAddTaskRunNextTest (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:17.185Z] 18:15:17     INFO -  testAddTaskSkip (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:17.917Z] 18:15:17     INFO -  testAddTaskSkipAll (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:18.630Z] 18:15:18     INFO -  testAddTaskStackTrace (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:19.352Z] 18:15:19     INFO -  testAddTaskTestFailureInside (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:20.076Z] 18:15:20     INFO -  testAddTaskTestMultiple (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:20.837Z] 18:15:20     INFO -  testAddTaskTestRejected (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:21.542Z] 18:15:21     INFO -  testAddTaskTestSingle (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:22.323Z] 18:15:22     INFO -  testAddTestFailing (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:23.028Z] 18:15:23     INFO -  testAddTestSimple (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:23.759Z] 18:15:23     INFO -  testAddTestUncaughtRejection (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:24.500Z] 18:15:24     INFO -  testAddTestUncaughtRejectionJSM (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:33.866Z] 18:15:33     INFO -  testAssertStack (__main__.XPCShellTestsTests) ... FAIL
[task 2021-01-27T18:15:34.586Z] 18:15:34     INFO -  testAsyncCleanup (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:35.916Z] 18:15:35     INFO -  testChild (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:36.940Z] 18:15:36     INFO -  testChildFail (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:38.085Z] 18:15:38     INFO -  testChildHang (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:39.274Z] 18:15:39     INFO -  testChildMozinfo (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:40.617Z] 18:15:40     INFO -  testChildPass (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:48.523Z] 18:15:48     INFO -  testCrashLogging (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:49.224Z] 18:15:49     INFO -  testDoPrintWhenVerboseExplicit (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:49.966Z] 18:15:49     INFO -  testDoPrintWhenVerboseInManifest (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:50.673Z] 18:15:50     INFO -  testDoPrintWhenVerboseNotExplicit (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:51.246Z] 18:15:51     INFO -  testDoReportForeignObject (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:51.989Z] 18:15:51     INFO -  testDoReportNonSyntaxError (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:52.730Z] 18:15:52     INFO -  testDoReportRefError (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:53.478Z] 18:15:53     INFO -  testDoReportSyntaxError (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:54.233Z] 18:15:54     INFO -  testDoThrowForeignObject (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:54.985Z] 18:15:54     INFO -  testDoThrowString (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:55.728Z] 18:15:55     INFO -  testFail (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:55.728Z] 18:15:55     INFO -  testHangingTimeout (__main__.XPCShellTestsTests) ... skipped 'Timeout code path occasionally times out (bug 1098121)'
[task 2021-01-27T18:15:56.496Z] 18:15:56     INFO -  testHeadlessWhenHeadlessExplicit (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:57.247Z] 18:15:57     INFO -  testHeadlessWhenHeadlessTrueInManifest (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:57.972Z] 18:15:57     INFO -  testKnownFail (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:58.725Z] 18:15:58     INFO -  testLogCorrectFileName (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:58.920Z] 18:15:58     INFO -  testMissingHeadFile (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:15:59.724Z] 18:15:59     INFO -  testMozinfo (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:16:00.472Z] 18:16:00     INFO -  testNoRunTestAddTask (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:16:01.253Z] 18:16:01     INFO -  testNoRunTestAddTaskFail (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:16:01.973Z] 18:16:01     INFO -  testNoRunTestAddTaskMultiple (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:16:02.745Z] 18:16:02     INFO -  testNoRunTestAddTest (__main__.XPCShellTestsTests) ... ok
[task 2021-01-27T18:16:02.745Z] 18:16:02     INFO -  testNoRunTestAddTestAddTask (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.745Z] 18:16:02     INFO -  testNoRunTestAddTestFail (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.757Z] 18:16:02     INFO -  testNoRunTestEmptyTest (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.757Z] 18:16:02     INFO -  testNotHeadlessByDefault (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.757Z] 18:16:02     INFO -  testNotHeadlessWhenHeadlessFalseInManifest (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.757Z] 18:16:02     INFO -  testNotSkipForAddTask (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.765Z] 18:16:02     INFO -  testNotSkipForAddTest (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.765Z] 18:16:02     INFO -  testPass (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.768Z] 18:16:02     INFO -  testPassFail (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.770Z] 18:16:02     INFO -  testPrefsInManifest (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.775Z] 18:16:02     INFO -  testRandomExecution (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.783Z] 18:16:02     INFO -  testReturnNonzero (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.783Z] 18:16:02     INFO -  testSkip (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.783Z] 18:16:02     INFO -  testSkipForAddTask (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.789Z] 18:16:02     INFO -  testSkipForAddTest (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.789Z] 18:16:02     INFO -  testSyntaxError (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.795Z] 18:16:02     INFO -  testUncaughtRejection (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.795Z] 18:16:02     INFO -  testUncaughtRejectionJSM (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.801Z] 18:16:02     INFO -  testUnexpectedPass (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.801Z] 18:16:02     INFO -  testUnicodeInAssertMethods (__main__.XPCShellTestsTests) ... ERROR
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -  ======================================================================
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -  ERROR: testNoRunTestAddTestAddTask (__main__.XPCShellTestsTests)
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -  ----------------------------------------------------------------------
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -  Traceback (most recent call last):
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/selftest.py", line 1358, in testNoRunTestAddTestAddTask
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -      self.assertTestResult(True)
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/selftest.py", line 567, in assertTestResult
[task 2021-01-27T18:16:02.803Z] 18:16:02     INFO -      self.x.runTests(kwargs),
[task 2021-01-27T18:16:02.804Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1516, in runTests
[task 2021-01-27T18:16:02.804Z] 18:16:02     INFO -      self.trySetupNode()
[task 2021-01-27T18:16:02.804Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1212, in trySetupNode
[task 2021-01-27T18:16:02.804Z] 18:16:02     INFO -      startServer('moz-http2', os.path.join(myDir, 'moz-http2', 'moz-http2.js'))
[task 2021-01-27T18:16:02.804Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1194, in startServer
[task 2021-01-27T18:16:02.805Z] 18:16:02     INFO -      stderr=PIPE, env=self.env, cwd=os.getcwd())
[task 2021-01-27T18:16:02.805Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 394, in __init__
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -      errread, errwrite)
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 928, in _execute_child
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -      errpipe_read, errpipe_write = self.pipe_cloexec()
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 865, in pipe_cloexec
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -      r, w = os.pipe()
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -  OSError: [Errno 24] Too many open files
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -  ======================================================================
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -  ERROR: testNoRunTestAddTestFail (__main__.XPCShellTestsTests)
[task 2021-01-27T18:16:02.806Z] 18:16:02     INFO -  ----------------------------------------------------------------------
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -  Traceback (most recent call last):
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/selftest.py", line 1387, in testNoRunTestAddTestFail
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -      self.assertTestResult(False)
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/selftest.py", line 567, in assertTestResult
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -      self.x.runTests(kwargs),
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1516, in runTests
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -      self.trySetupNode()
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1212, in trySetupNode
[task 2021-01-27T18:16:02.807Z] 18:16:02     INFO -      startServer('moz-http2', os.path.join(myDir, 'moz-http2', 'moz-http2.js'))
[task 2021-01-27T18:16:02.808Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1194, in startServer
[task 2021-01-27T18:16:02.808Z] 18:16:02     INFO -      stderr=PIPE, env=self.env, cwd=os.getcwd())
[task 2021-01-27T18:16:02.808Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 394, in __init__
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -      errread, errwrite)
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 928, in _execute_child
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -      errpipe_read, errpipe_write = self.pipe_cloexec()
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 865, in pipe_cloexec
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -      r, w = os.pipe()
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -  OSError: [Errno 24] Too many open files
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -  ======================================================================
[task 2021-01-27T18:16:02.816Z] 18:16:02     INFO -  ERROR: testNoRunTestEmptyTest (__main__.XPCShellTestsTests)
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -  ----------------------------------------------------------------------
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -  Traceback (most recent call last):
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/selftest.py", line 1373, in testNoRunTestEmptyTest
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -      self.assertTestResult(True)
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/selftest.py", line 567, in assertTestResult
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -      self.x.runTests(kwargs),
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1516, in runTests
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -      self.trySetupNode()
[task 2021-01-27T18:16:02.817Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1212, in trySetupNode
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -      startServer('moz-http2', os.path.join(myDir, 'moz-http2', 'moz-http2.js'))
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -    File "/Users/cltbld/tasks/task_1611770787/build/tests/xpcshell/runxpcshelltests.py", line 1194, in startServer
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -      stderr=PIPE, env=self.env, cwd=os.getcwd())
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 394, in __init__
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -      errread, errwrite)
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 928, in _execute_child
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -      errpipe_read, errpipe_write = self.pipe_cloexec()
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -    File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 865, in pipe_cloexec
[task 2021-01-27T18:16:02.818Z] 18:16:02     INFO -      r, w = os.pipe()
[task 2021-01-27T18:16:02.819Z] 18:16:02     INFO -  OSError: [Errno 24] Too many open files
[task 2021-01-27T18:16:02.819Z] 18:16:02     INFO -  ======================================================================
[task 2021-01-27T18:16:02.819Z] 18:16:02     INFO -  ERROR: testNotHeadlessByDefault (__main__.XPCShellTestsTests)```

More fallout from the virtualenv uplifts. This is macOS-only.

Flags: needinfo?(mhentges)
Summary: Perma [OSX][esr78] OSError: [Errno 24] Too many open files → Perma [OSX][esr78] xpcshell selftest OSError: [Errno 24] Too many open files
Assignee: nobody → mhentges
Status: NEW → ASSIGNED
Flags: needinfo?(mhentges)

Though I'm unable to trigger this problem locally, :dhouse has been a champ and quarantined me a CI worker that reproduces the issue.
I'm digging into the cause shortly here.

Progress update: I've got an interactive reproduce on the quarantined worker 👍.

Regressed by: 1654457
See Also: → 1654479

When I requested XPCShell test changes for uplift (because it blocked running test in general with py3), I missed its dependents, including one involving leaked file descriptors (sound familiar?).

Adding those two dependents and pushing to try.

Hmm, when I originally set up the uplift for that virtualenv bug, I tried to move the minimal amount of patches so that at least the build would still work and hopefully CI would be happy.

However, going through the list of patches again and looking at their associated regressions and dependents (in central), I think that I should broaden my scope a bit. My new criteria for evaluating each patch is "was this it's issue caused by <uplift stack> and is it still relevant on the ESR tree?". (For example, this bug is ignored because python-test with --python is no longer possible on ESR).

The new stack is:

  • 1670788 - Remove virtualenv from third_party/python/requirements.in r=firefox-build-system-reviewers,glandium
    -> Resolves issue where mach vendor python makes too many changes
  • 1670784 - Upgrade vendored pip-tools r=firefox-build-system-reviewers,glandium
    -> Fixes mach vendor python
  • 1661790 - Allow configuring the name of the virtualenv used for builds r=nalexander
    -> Isn't related to failures, but based on Ricky's comments, this avoids an unnecessary virtualenv creation. This
    should've been part of the initial virtualenv uplift stack 😅
  • 1654483 - Enable the CFI directives for NS_InvokeByIndex on macOS. r=froydnj
    -> Needed for xpcshell tests to pass
  • 1654479 - Clear up processes after shutting them down in XPCShellTests. r=gbrown
    -> Needed for this bug!
  • 1654457 - Use pip list --format freeze instead of pip freeze. r=ahal
    -> Needed because mozharness' version of virtualenv was really old, and the one under /third_party/python/ has a new pip.
  • 1408051 - Remove mozharness' copy of virtualenv and use the one under /third_party/python instead r=ahal,rail
    -> Resolves the pyvenv.cfg intermittent.

Ran into an issue caused by a bad merge conflict resolution from before, but that's resolved in this little patch.

Try job is here.
@RelMan: two things are needed to resolve this bug:

Thanks!

Fixed by the latest round of uplifts. ESR78 is open again.

Status: ASSIGNED → RESOLVED
Closed: 4 years ago
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.