Closed Bug 1399895 Opened 8 years ago Closed 7 years ago

Intermittent ../python/mozbuild/mozbuild/test/backend/test_build.py::TestBuild::test_faster_make TEST-UNEXPECTED-FAIL IOError: [Errno 2] No such file or directory: u'/tmp/tmpxtYlHQ/faster/.deps/dist_bin_baz.ini'

Categories

(Firefox Build System :: General, defect, P5)

Product:
Firefox Build System
Component:
General
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

References

Details

(Keywords: intermittent-failure)

Filed by: archaeopteryx [at] coole-files.de https://treeherder.mozilla.org/logviewer.html#?job_id=130979497&repo=mozilla-inbound https://queue.taskcluster.net/v1/task/Hw4P4b0sR-q_v8eZK9VJhA/runs/0/artifacts/public/logs/live_backing.log [task 2017-09-14T09:18:59.305683Z] 09:18:59 INFO - ============================= test session starts ============================== [task 2017-09-14T09:18:59.315536Z] 09:18:59 INFO - platform linux2 -- Python 2.7.10, pytest-3.1.3, py-1.4.34, pluggy-0.4.0 -- /builds/worker/workspace/build/src/obj-firefox/_virtualenv/bin/python [task 2017-09-14T09:18:59.315590Z] 09:18:59 INFO - cachedir: ../python/mozbuild/.cache [task 2017-09-14T09:18:59.315620Z] 09:18:59 INFO - rootdir: /builds/worker/workspace/build/src/python/mozbuild, inifile: [task 2017-09-14T09:18:59.315642Z] 09:18:59 INFO - collecting ... collected 3 items [task 2017-09-14T09:18:59.315676Z] 09:18:59 WARNING - ../python/mozbuild/mozbuild/test/backend/test_build.py::TestBuild::test_faster_make TEST-UNEXPECTED-FAIL [task 2017-09-14T09:18:59.315710Z] 09:18:59 INFO - ../python/mozbuild/mozbuild/test/backend/test_build.py::TestBuild::test_faster_recursive_make PASSED [task 2017-09-14T09:18:59.315740Z] 09:18:59 INFO - ../python/mozbuild/mozbuild/test/backend/test_build.py::TestBuild::test_recursive_make PASSED [task 2017-09-14T09:18:59.315769Z] 09:18:59 INFO - =================================== FAILURES =================================== [task 2017-09-14T09:18:59.315798Z] 09:18:59 INFO - __________________________ TestBuild.test_faster_make __________________________ [task 2017-09-14T09:18:59.315825Z] 09:18:59 INFO - self = <mozbuild.test.backend.test_build.TestBuild testMethod=test_faster_make> [task 2017-09-14T09:18:59.316448Z] 09:18:59 INFO - def test_faster_make(self): [task 2017-09-14T09:18:59.316669Z] 09:18:59 INFO - substs = list(BASE_SUBSTS) + [ [task 2017-09-14T09:18:59.316953Z] 09:18:59 INFO - ('MOZ_BUILD_APP', 'dummy_app'), [task 2017-09-14T09:18:59.317317Z] 09:18:59 INFO - ('MOZ_WIDGET_TOOLKIT', 'dummy_widget'), [task 2017-09-14T09:18:59.317478Z] 09:18:59 INFO - ] [task 2017-09-14T09:18:59.317779Z] 09:18:59 INFO - with self.do_test_backend(RecursiveMakeBackend, FasterMakeBackend, [task 2017-09-14T09:18:59.317951Z] 09:18:59 INFO - substs=substs) as config: [task 2017-09-14T09:18:59.318220Z] 09:18:59 INFO - buildid = mozpath.join(config.topobjdir, 'config', 'buildid') [task 2017-09-14T09:18:59.318417Z] 09:18:59 INFO - ensureParentDir(buildid) [task 2017-09-14T09:18:59.318644Z] 09:18:59 INFO - with open(buildid, 'w') as fh: [task 2017-09-14T09:18:59.318862Z] 09:18:59 INFO - fh.write('20100101012345\n') [task 2017-09-14T09:18:59.319052Z] 09:18:59 INFO - build = MozbuildObject(config.topsrcdir, None, None, [task 2017-09-14T09:18:59.319303Z] 09:18:59 INFO - config.topobjdir) [task 2017-09-14T09:18:59.319499Z] 09:18:59 INFO - overrides = [ [task 2017-09-14T09:18:59.319671Z] 09:18:59 INFO - 'TEST_MOZBUILD=1', [task 2017-09-14T09:18:59.319871Z] 09:18:59 INFO - ] [task 2017-09-14T09:18:59.320110Z] 09:18:59 INFO - with self.line_handler() as handle_make_line: [task 2017-09-14T09:18:59.320322Z] 09:18:59 INFO - build._run_make(directory=mozpath.join(config.topobjdir, [task 2017-09-14T09:18:59.320533Z] 09:18:59 INFO - 'faster'), [task 2017-09-14T09:18:59.320738Z] 09:18:59 INFO - target=overrides, silent=False, [task 2017-09-14T09:18:59.320923Z] 09:18:59 INFO - > line_handler=handle_make_line) [task 2017-09-14T09:18:59.321100Z] 09:18:59 INFO - ../python/mozbuild/mozbuild/test/backend/test_build.py:141: [task 2017-09-14T09:18:59.321345Z] 09:18:59 INFO - _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [task 2017-09-14T09:18:59.321509Z] 09:18:59 INFO - ../python/mozbuild/mozbuild/base.py:670: in _run_make [task 2017-09-14T09:18:59.321696Z] 09:18:59 INFO - return fn(**params) [task 2017-09-14T09:18:59.321929Z] 09:18:59 INFO - ../python/mozbuild/mozbuild/base.py:725: in _run_command_in_objdir [task 2017-09-14T09:18:59.322165Z] 09:18:59 INFO - return self.run_process(cwd=self.topobjdir, **args) [task 2017-09-14T09:18:59.322408Z] 09:18:59 INFO - _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ [task 2017-09-14T09:18:59.322614Z] 09:18:59 INFO - self = <mozbuild.base.MozbuildObject object at 0x7f1e256f9b50> [task 2017-09-14T09:18:59.322814Z] 09:18:59 INFO - args = ['/usr/local/bin/gmake', '-C', '/tmp/tmpxtYlHQ/faster', '-j16', '-w', 'TEST_MOZBUILD=1'] [task 2017-09-14T09:18:59.323050Z] 09:18:59 INFO - cwd = '/tmp/tmpxtYlHQ', append_env = {'MACH': '1'}, explicit_env = None [task 2017-09-14T09:18:59.323187Z] 09:18:59 INFO - log_name = 'make', log_level = 20 [task 2017-09-14T09:18:59.323399Z] 09:18:59 INFO - line_handler = <function handle_make_line at 0x7f1e25e318c0> [task 2017-09-14T09:18:59.323614Z] 09:18:59 INFO - require_unix_environment = False, ensure_exit_code = 0, ignore_children = True [task 2017-09-14T09:18:59.323816Z] 09:18:59 INFO - pass_thru = False [task 2017-09-14T09:18:59.324032Z] 09:18:59 INFO - def run_process(self, args=None, cwd=None, append_env=None, [task 2017-09-14T09:18:59.324219Z] 09:18:59 INFO - explicit_env=None, log_name=None, log_level=logging.INFO, [task 2017-09-14T09:18:59.324368Z] 09:18:59 INFO - line_handler=None, require_unix_environment=False, [task 2017-09-14T09:18:59.324537Z] 09:18:59 INFO - ensure_exit_code=0, ignore_children=False, pass_thru=False): [task 2017-09-14T09:18:59.324691Z] 09:18:59 INFO - """Runs a single process to completion. [task 2017-09-14T09:18:59.324879Z] 09:18:59 INFO - Takes a list of arguments to run where the first item is the [task 2017-09-14T09:18:59.325076Z] 09:18:59 INFO - executable. Runs the command in the specified directory and [task 2017-09-14T09:18:59.325263Z] 09:18:59 INFO - with optional environment variables. [task 2017-09-14T09:18:59.325465Z] 09:18:59 INFO - append_env -- Dict of environment variables to append to the current [task 2017-09-14T09:18:59.325652Z] 09:18:59 INFO - set of environment variables. [task 2017-09-14T09:18:59.325854Z] 09:18:59 INFO - explicit_env -- Dict of environment variables to set for the new [task 2017-09-14T09:18:59.326075Z] 09:18:59 INFO - process. Any existing environment variables will be ignored. [task 2017-09-14T09:18:59.326276Z] 09:18:59 INFO - require_unix_environment if True will ensure the command is executed [task 2017-09-14T09:18:59.326472Z] 09:18:59 INFO - within a UNIX environment. Basically, if we are on Windows, it will [task 2017-09-14T09:18:59.326660Z] 09:18:59 INFO - execute the command via an appropriate UNIX-like shell. [task 2017-09-14T09:18:59.326859Z] 09:18:59 INFO - ignore_children is proxied to mozprocess's ignore_children. [task 2017-09-14T09:18:59.327062Z] 09:18:59 INFO - ensure_exit_code is used to ensure the exit code of a process matches [task 2017-09-14T09:18:59.327260Z] 09:18:59 INFO - what is expected. If it is an integer, we raise an Exception if the [task 2017-09-14T09:18:59.327461Z] 09:18:59 INFO - exit code does not match this value. If it is True, we ensure the exit [task 2017-09-14T09:18:59.327670Z] 09:18:59 INFO - code is 0. If it is False, we don't perform any exit code validation. [task 2017-09-14T09:18:59.327877Z] 09:18:59 INFO - pass_thru is a special execution mode where the child process inherits [task 2017-09-14T09:18:59.328074Z] 09:18:59 INFO - this process's standard file handles (stdin, stdout, stderr) as well as [task 2017-09-14T09:18:59.328277Z] 09:18:59 INFO - additional file descriptors. It should be used for interactive processes [task 2017-09-14T09:18:59.328473Z] 09:18:59 INFO - where buffering from mozprocess could be an issue. pass_thru does not [task 2017-09-14T09:18:59.328668Z] 09:18:59 INFO - use mozprocess. Therefore, arguments like log_name, line_handler, [task 2017-09-14T09:18:59.328846Z] 09:18:59 INFO - and ignore_children have no effect. [task 2017-09-14T09:18:59.329071Z] 09:18:59 INFO - """ [task 2017-09-14T09:18:59.329279Z] 09:18:59 INFO - args = self._normalize_command(args, require_unix_environment) [task 2017-09-14T09:18:59.329482Z] 09:18:59 INFO - self.log(logging.INFO, 'new_process', {'args': ' '.join(args)}, '{args}') [task 2017-09-14T09:18:59.329656Z] 09:18:59 INFO - def handleLine(line): [task 2017-09-14T09:18:59.329863Z] 09:18:59 INFO - # Converts str to unicode on Python 2 and bytes to str on Python 3. [task 2017-09-14T09:18:59.330053Z] 09:18:59 INFO - if isinstance(line, bytes): [task 2017-09-14T09:18:59.330301Z] 09:18:59 INFO - line = line.decode(sys.stdout.encoding or 'utf-8', 'replace') [task 2017-09-14T09:18:59.330476Z] 09:18:59 INFO - if line_handler: [task 2017-09-14T09:18:59.330662Z] 09:18:59 INFO - line_handler(line) [task 2017-09-14T09:18:59.330845Z] 09:18:59 INFO - if not log_name: [task 2017-09-14T09:18:59.331020Z] 09:18:59 INFO - return [task 2017-09-14T09:18:59.331225Z] 09:18:59 INFO - self.log(log_level, log_name, {'line': line.rstrip()}, '{line}') [task 2017-09-14T09:18:59.331395Z] 09:18:59 INFO - use_env = {} [task 2017-09-14T09:18:59.331572Z] 09:18:59 INFO - if explicit_env: [task 2017-09-14T09:18:59.331754Z] 09:18:59 INFO - use_env = explicit_env [task 2017-09-14T09:18:59.331924Z] 09:18:59 INFO - else: [task 2017-09-14T09:18:59.332113Z] 09:18:59 INFO - use_env.update(os.environ) [task 2017-09-14T09:18:59.332293Z] 09:18:59 INFO - if append_env: [task 2017-09-14T09:18:59.332475Z] 09:18:59 INFO - use_env.update(append_env) [task 2017-09-14T09:18:59.332680Z] 09:18:59 INFO - self.log(logging.DEBUG, 'process', {'env': use_env}, 'Environment: {env}') [task 2017-09-14T09:18:59.332875Z] 09:18:59 INFO - # There is a bug in subprocess where it doesn't like unicode types in [task 2017-09-14T09:18:59.333068Z] 09:18:59 INFO - # environment variables. Here, ensure all unicode are converted to [task 2017-09-14T09:18:59.333265Z] 09:18:59 INFO - # binary. utf-8 is our globally assumed default. If the caller doesn't [task 2017-09-14T09:18:59.333452Z] 09:18:59 INFO - # want UTF-8, they shouldn't pass in a unicode instance. [task 2017-09-14T09:18:59.333625Z] 09:18:59 INFO - normalized_env = {} [task 2017-09-14T09:18:59.333809Z] 09:18:59 INFO - for k, v in use_env.items(): [task 2017-09-14T09:18:59.334014Z] 09:18:59 INFO - if isinstance(k, unicode): [task 2017-09-14T09:18:59.334202Z] 09:18:59 INFO - k = k.encode('utf-8', 'strict') [task 2017-09-14T09:18:59.334384Z] 09:18:59 INFO - if isinstance(v, unicode): [task 2017-09-14T09:18:59.334569Z] 09:18:59 INFO - v = v.encode('utf-8', 'strict') [task 2017-09-14T09:18:59.334745Z] 09:18:59 INFO - normalized_env[k] = v [task 2017-09-14T09:18:59.334928Z] 09:18:59 INFO - use_env = normalized_env [task 2017-09-14T09:18:59.335104Z] 09:18:59 INFO - if pass_thru: [task 2017-09-14T09:18:59.335303Z] 09:18:59 INFO - proc = subprocess.Popen(args, cwd=cwd, env=use_env) [task 2017-09-14T09:18:59.335474Z] 09:18:59 INFO - status = None [task 2017-09-14T09:18:59.335677Z] 09:18:59 INFO - # Leave it to the subprocess to handle Ctrl+C. If it terminates as [task 2017-09-14T09:18:59.335880Z] 09:18:59 INFO - # a result of Ctrl+C, proc.wait() will return a status code, and, [task 2017-09-14T09:18:59.336085Z] 09:18:59 INFO - # we get out of the loop. If it doesn't, like e.g. gdb, we continue [task 2017-09-14T09:18:59.336261Z] 09:18:59 INFO - # waiting. [task 2017-09-14T09:18:59.336461Z] 09:18:59 INFO - while status is None: [task 2017-09-14T09:18:59.336638Z] 09:18:59 INFO - try: [task 2017-09-14T09:18:59.336830Z] 09:18:59 INFO - status = proc.wait() [task 2017-09-14T09:18:59.337018Z] 09:18:59 INFO - except KeyboardInterrupt: [task 2017-09-14T09:18:59.337198Z] 09:18:59 INFO - pass [task 2017-09-14T09:18:59.337377Z] 09:18:59 INFO - else: [task 2017-09-14T09:18:59.337581Z] 09:18:59 INFO - p = ProcessHandlerMixin(args, cwd=cwd, env=use_env, [task 2017-09-14T09:18:59.337777Z] 09:18:59 INFO - processOutputLine=[handleLine], universal_newlines=True, [task 2017-09-14T09:18:59.337960Z] 09:18:59 INFO - ignore_children=ignore_children) [task 2017-09-14T09:18:59.338155Z] 09:18:59 INFO - p.run() [task 2017-09-14T09:18:59.338338Z] 09:18:59 INFO - p.processOutput() [task 2017-09-14T09:18:59.338515Z] 09:18:59 INFO - status = p.wait() [task 2017-09-14T09:18:59.338699Z] 09:18:59 INFO - if ensure_exit_code is False: [task 2017-09-14T09:18:59.338883Z] 09:18:59 INFO - return status [task 2017-09-14T09:18:59.339070Z] 09:18:59 INFO - if ensure_exit_code is True: [task 2017-09-14T09:18:59.339248Z] 09:18:59 INFO - ensure_exit_code = 0 [task 2017-09-14T09:18:59.339433Z] 09:18:59 INFO - if status != ensure_exit_code: [task 2017-09-14T09:18:59.339643Z] 09:18:59 INFO - > raise Exception('Process executed with non-0 exit code %d: %s' % (status, args)) [task 2017-09-14T09:18:59.339883Z] 09:18:59 INFO - E Exception: Process executed with non-0 exit code 2: [u'/usr/local/bin/gmake', u'-C', u'/tmp/tmpxtYlHQ/faster', u'-j16', u'-w', u'TEST_MOZBUILD=1'] [task 2017-09-14T09:18:59.340065Z] 09:18:59 INFO - ../python/mach/mach/mixin/process.py:147: Exception [task 2017-09-14T09:18:59.340270Z] 09:18:59 INFO - ----------------------------- Captured stdout call ----------------------------- [task 2017-09-14T09:18:59.340452Z] 09:18:59 INFO - gmake[1]: Entering directory '/tmp/tmpxtYlHQ' [task 2017-09-14T09:18:59.340647Z] 09:18:59 INFO - gmake[1]: warning: -jN forced in submake: disabling jobserver mode. [task 2017-09-14T09:18:59.340829Z] 09:18:59 INFO - /usr/local/bin/gmake -C /tmp/tmpxtYlHQ/ buildid.h [task 2017-09-14T09:18:59.341014Z] 09:18:59 INFO - /usr/local/bin/gmake -C /tmp/tmpxtYlHQ/ source-repo.h [task 2017-09-14T09:18:59.341195Z] 09:18:59 INFO - gmake[2]: Entering directory '/tmp/tmpxtYlHQ' [task 2017-09-14T09:18:59.341380Z] 09:18:59 INFO - gmake[2]: Nothing to be done for 'buildid.h'. [task 2017-09-14T09:18:59.341563Z] 09:18:59 INFO - gmake[2]: Leaving directory '/tmp/tmpxtYlHQ' [task 2017-09-14T09:18:59.341784Z] 09:18:59 INFO - gmake[2]: Entering directory '/tmp/tmpxtYlHQ' [task 2017-09-14T09:18:59.341972Z] 09:18:59 INFO - gmake[2]: Nothing to be done for 'source-repo.h'. [task 2017-09-14T09:18:59.342206Z] 09:18:59 INFO - gmake[2]: Leaving directory '/tmp/tmpxtYlHQ' [task 2017-09-14T09:18:59.342428Z] 09:18:59 INFO - /builds/worker/workspace/build/src/obj-firefox/_virtualenv/bin/python -m mozbuild.action.process_install_manifest \ [task 2017-09-14T09:18:59.342598Z] 09:18:59 INFO - --track install_dist_bin.track \ [task 2017-09-14T09:18:59.342780Z] 09:18:59 INFO - /tmp/tmpxtYlHQ/dist/bin \ [task 2017-09-14T09:18:59.342961Z] 09:18:59 INFO - -DAB_CD=en-US \ [task 2017-09-14T09:18:59.343179Z] 09:18:59 INFO - -DBOOKMARKS_INCLUDE_DIR=/builds/worker/workspace/build/src/browser/locales/en-US/profile \ [task 2017-09-14T09:18:59.343347Z] 09:18:59 INFO - -DBUILD_FASTER \ [task 2017-09-14T09:18:59.343530Z] 09:18:59 INFO - install_dist_bin [task 2017-09-14T09:18:59.343758Z] 09:18:59 INFO - /builds/worker/workspace/build/src/obj-firefox/_virtualenv/bin/python -m mozbuild.action.process_install_manifest \ [task 2017-09-14T09:18:59.343928Z] 09:18:59 INFO - --track install_dist_bin_app.track \ [task 2017-09-14T09:18:59.344109Z] 09:18:59 INFO - /tmp/tmpxtYlHQ/dist/bin/app \ [task 2017-09-14T09:18:59.344278Z] 09:18:59 INFO - -DAB_CD=en-US \ [task 2017-09-14T09:18:59.344492Z] 09:18:59 INFO - -DBOOKMARKS_INCLUDE_DIR=/builds/worker/workspace/build/src/browser/locales/en-US/profile \ [task 2017-09-14T09:18:59.344655Z] 09:18:59 INFO - -DBUILD_FASTER \ [task 2017-09-14T09:18:59.344835Z] 09:18:59 INFO - install_dist_bin_app [task 2017-09-14T09:18:59.345021Z] 09:18:59 INFO - Traceback (most recent call last): [task 2017-09-14T09:18:59.345218Z] 09:18:59 INFO - File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main [task 2017-09-14T09:18:59.345396Z] 09:18:59 INFO - "__main__", fname, loader, pkg_name) [task 2017-09-14T09:18:59.345585Z] 09:18:59 INFO - File "/usr/lib/python2.7/runpy.py", line 72, in _run_code [task 2017-09-14T09:18:59.345757Z] 09:18:59 INFO - exec code in run_globals [task 2017-09-14T09:18:59.345990Z] 09:18:59 INFO - File "/builds/worker/workspace/build/src/python/mozbuild/mozbuild/action/process_install_manifest.py", line 111, in <module> [task 2017-09-14T09:18:59.346166Z] 09:18:59 INFO - main(sys.argv[1:]) [task 2017-09-14T09:18:59.346390Z] 09:18:59 INFO - File "/builds/worker/workspace/build/src/python/mozbuild/mozbuild/action/process_install_manifest.py", line 98, in main [task 2017-09-14T09:18:59.346553Z] 09:18:59 INFO - defines=args.defines) [task 2017-09-14T09:18:59.346784Z] 09:18:59 INFO - File "/builds/worker/workspace/build/src/python/mozbuild/mozbuild/action/process_install_manifest.py", line 69, in process_manifest [task 2017-09-14T09:18:59.346964Z] 09:18:59 INFO - remove_empty_directories=remove_empty_directories) [task 2017-09-14T09:18:59.347171Z] 09:18:59 INFO - File "/builds/worker/workspace/build/src/python/mozbuild/mozpack/copier.py", line 431, in copy [task 2017-09-14T09:18:59.347364Z] 09:18:59 INFO - copy_results.append((destfile, f.copy(destfile, skip_if_older))) [task 2017-09-14T09:18:59.347573Z] 09:18:59 INFO - File "/builds/worker/workspace/build/src/python/mozbuild/mozpack/files.py", line 570, in copy [task 2017-09-14T09:18:59.347741Z] 09:18:59 INFO - deps_out.close() [task 2017-09-14T09:18:59.347961Z] 09:18:59 INFO - File "/builds/worker/workspace/build/src/python/mozbuild/mozbuild/util.py", line 269, in close [task 2017-09-14T09:18:59.348144Z] 09:18:59 INFO - with open(self.name, writemode) as file: [task 2017-09-14T09:18:59.348354Z] 09:18:59 INFO - IOError: [Errno 2] No such file or directory: u'/tmp/tmpxtYlHQ/faster/.deps/dist_bin_baz.ini' [task 2017-09-14T09:18:59.348562Z] 09:18:59 INFO - /builds/worker/workspace/build/src/config/faster/rules.mk:84: recipe for target 'install-dist/bin' failed [task 2017-09-14T09:18:59.348736Z] 09:18:59 INFO - gmake[1]: *** [install-dist/bin] Error 1 [task 2017-09-14T09:18:59.348972Z] 09:18:59 INFO - Elapsed: 0.20s; From /tmp/tmpxtYlHQ/dist/bin/app: Kept 0 existing; Added/updated 21; Removed 0 files and 0 directories. [task 2017-09-14T09:18:59.349148Z] 09:18:59 INFO - gmake[1]: Target 'default' not remade because of errors. [task 2017-09-14T09:18:59.349337Z] 09:18:59 INFO - gmake[1]: Leaving directory '/tmp/tmpxtYlHQ/faster'
My money is on this being AUFS badness. /tmp inside Docker isn't mounted. So it is likely an AUFS filesystem. We've seen problems with random ENOENT (no such file) errors on AUFS filesystems with things like Mercurial clones and checkouts. I wouldn't at all be surprised if the test harness could trigger similar race conditions leading to intermittent failures like this one.
Depends on: 1291940
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
https://wiki.mozilla.org/Bug_Triage#Intermittent_Test_Failure_Cleanup
Status: REOPENED → RESOLVED
Closed: 8 years ago → 7 years ago
Resolution: --- → INCOMPLETE
Product: Core → Firefox Build System
You need to log in before you can comment on or make changes to this bug.