Closed Bug 1218305 Opened 10 years ago Closed 9 years ago

Can't allocate memory in MTBF Host machine

Categories

(Remote Protocol :: Marionette, defect)

Product:
Remote Protocol
Component:
Marionette
Platform:
ARM
Gonk (Firefox OS)
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED WONTFIX

People

(Reporter: sho, Unassigned)

References

Details

After 75 hrs MTBF running on aries, it will show "can't allocate memory" in console log. This happens before, could be the memory leak issue of MTBF or related lib. The exception log as below: 13:25:50 SUITE-START | Running 5 tests 13:25:51 ['adb', 'shell', 'id'] 13:25:52 Traceback (most recent call last): 13:25:52 File "mtbf_job_runner.py", line 407, in <module> 13:25:52 mjr.run() 13:25:52 File "mtbf_job_runner.py", line 400, in run 13:25:52 self.execute() 13:25:52 File "mtbf_job_runner.py", line 359, in execute 13:25:52 self.run_mtbf() 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/combo_runner-0.1.0-py2.7.egg/combo_runner/action_decorator.py", line 17, in func_wrapper 13:25:52 return func(self, **kwargs) 13:25:52 File "mtbf_job_runner.py", line 345, in run_mtbf 13:25:52 mtbf.main(testvars=self.options.testvars, **self.kwargs) 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/mtbf_driver-0.2.0-py2.7.egg/mtbf_driver/mtbf.py", line 379, in main 13:25:52 mtbf.start_gaiatest() 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/mtbf_driver-0.2.0-py2.7.egg/mtbf_driver/mtbf.py", line 209, in start_gaiatest 13:25:52 self.runner.run_tests(file_path) 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/marionette_client-1.0.0-py2.7.egg/marionette/runner/base.py", line 795, in run_tests 13:25:52 self.run_test_sets() 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/marionette_client-1.0.0-py2.7.egg/marionette/runner/base.py", line 1024, in run_test_sets 13:25:52 self.run_test_set(self.tests) 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/marionette_client-1.0.0-py2.7.egg/marionette/runner/base.py", line 1003, in run_test_set 13:25:52 self.run_test(test['filepath'], test['expected'], test['test_container']) 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/marionette_client-1.0.0-py2.7.egg/marionette/runner/base.py", line 975, in run_test 13:25:52 results = runner.run(suite) 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/marionette_client-1.0.0-py2.7.egg/marionette/runner/base.py", line 240, in run 13:25:52 pre_run_func() 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/marionette_client-1.0.0-py2.7.egg/marionette/runner/base.py", line 221, in b2g_pre_run 13:25:52 self.b2g_pid = get_b2g_pid(get_dm(self.marionette)) 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/marionette_client-1.0.0-py2.7.egg/marionette/runner/mixins/b2g.py", line 19, in get_dm 13:25:52 **kwargs) 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/mozdevice-0.46-py2.7.egg/mozdevice/devicemanagerADB.py", line 71, in __init__ 13:25:52 self.connect() 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/mozdevice-0.46-py2.7.egg/mozdevice/devicemanagerADB.py", line 86, in connect 13:25:52 self._checkForRoot() 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/mozdevice-0.46-py2.7.egg/mozdevice/devicemanagerADB.py", line 668, in _checkForRoot 13:25:52 proc = self._runCmd(["shell", "id"], timeout=self.short_timeout) 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/mozdevice-0.46-py2.7.egg/mozdevice/devicemanagerADB.py", line 568, in _runCmd 13:25:52 proc.run(timeout=timeout) 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/mozprocess-0.22-py2.7.egg/mozprocess/processhandler.py", line 700, in run 13:25:52 self.proc = self.Process([self.cmd] + self.args, **args) 13:25:52 File "/var/jenkins/workspace/aries-kk.vmaster.mtbf-3@2/label/mtbf-3/mtbf-env/local/lib/python2.7/site-packages/mozprocess-0.22-py2.7.egg/mozprocess/processhandler.py", line 103, in __init__ 13:25:52 universal_newlines, startupinfo, creationflags) 13:25:52 File "/usr/lib/python2.7/subprocess.py", line 679, in __init__ 13:25:53 errread, errwrite) 13:25:53 File "/usr/lib/python2.7/subprocess.py", line 1143, in _execute_child 13:25:53 self.pid = os.fork() 13:25:53 OSError: [Errno 12] Cannot allocate memory 13:25:55 Build step 'Execute shell' marked build as failure 13:25:55 Archiving artifacts 13:25:55 Started calculate disk usage of build 13:25:55 Finished Calculation of disk usage of build in 0 seconds 13:25:55 Started calculate disk usage of workspace 13:25:58 Finished Calculation of disk usage of workspace in 3 second 13:25:59 Finished: FAILURE
Blocks: mtbf-2015q3
No longer blocks: MTBF-2014Q4
trigger runner for several times, here is diff by types: types | # objects | total size ====================================================== | =========== | ============ str | 4607 | 370.81 KB dict | 109 | 124.30 KB list | 99 | 47.60 KB code | 192 | 24.00 KB type | 18 | 15.89 KB tuple | 92 | 7.09 KB set | 24 | 5.44 KB <class 'marionette.marionette_test.MetaParameterized | 6 | 5.30 KB <class 'random.Random | 1 | 4.95 KB property | 44 | 3.78 KB weakref | 43 | 3.70 KB <class 'abc.ABCMeta | 4 | 3.53 KB unicode | 41 | 2.94 KB builtin_function_or_method | 37 | 2.60 KB function (_remove) | 12 | 1.41 KB ----- types | # objects | total size ====================================================== | =========== | ============ type | 104 | 91.81 KB dict | 58 | 62.73 KB str | 214 | 19.42 KB tuple | 224 | 16.83 KB weakref | 111 | 9.54 KB list | 50 | 6.02 KB <class 'marionette.marionette_test.MetaParameterized | 5 | 4.41 KB code | 22 | 2.75 KB unicode | 39 | 2.73 KB getset_descriptor | 28 | 1.97 KB instancemethod | 12 | 960 B builtin_function_or_method | 13 | 936 B <class 'gaiatest.GaiaTestResult | 5 | 520 B function (setUp) | 4 | 480 B float | 19 | 456 B marionette.marionette_test.MetaParameterized is pretty suspicious since it continuously increases proportional to test case run.
Component: MTBF → Marionette
Product: Firefox OS → Testing
Closing as wont fix as the Marionette team will not be working on B2G
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → WONTFIX
Product: Testing → Remote Protocol
You need to log in before you can comment on or make changes to this bug.