Closed Bug 1246700 Opened 10 years ago Closed 10 years ago

Segfault during indexing

Categories

(Webtools Graveyard :: DXR, defect)

Product:
Webtools Graveyard
Component:
DXR
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(firefox47 affected)

Status:
RESOLVED FIXED
Tracking Flags:
Tracking Status
firefox47 --- affected

People

(Reporter: erik, Unassigned)

Details

moz-central and comm-central builds are about a week behind due to segfaults during indexing. Trying to reproduce it locally, I could get only futures hangs (filed at https://github.com/agronholm/pythonfutures/issues/52). Then, when I disabled concurrency (with workers=0 in the DXR config file), the segfault showed itself. It crashes during malloc(), which made me think the next-block ptr (which lives in the heap) was getting corrupted. Running with MALLOC_CHECK_=2 had no effect. Then I noticed that the stack is enormous (but finite, so not corrupted); we're probably overflowing it.
(gdb) py-bt #10 Frame 0x1247f20, for file /home/dxr/dxr/dxr/plugins/clang/needles.py, line 146, in _nonunique_needles_from_graph (graph={'nsCycleCollectionNoteRootCallback': [('CCGraphBuilder', 'CCGraphBuilder')], 'nsIObserver': [('mozilla::net::SchedulingContextService', 'SchedulingContextService'), ('nsSHistoryObserver', 'nsSHistoryObserver'), ('nsWifiMonitor', 'nsWifiMonitor'), ('mozilla::dom::VolumeStateObserver', 'VolumeStateObserver'), ('FontPrefsObserver', 'FontPrefsObserver'), ('nsProfiler', 'nsProfiler'), ('nsHtml5ParserThreadTerminator', 'nsHtml5ParserThreadTerminator'), ('mozilla::FinalizationWitnessService', 'FinalizationWitnessService'), ('WaitForTopicSpinner', 'WaitForTopicSpinner'), ('nsHTMLDNSPrefetch::nsDeferrals', 'nsDeferrals'), ('mozilla::LogModulePrefWatcher', 'LogModulePrefWatcher'), ('mozilla::dom::MediaKeySystemAccessManager', 'MediaKeySystemAccessManager'), ('FullscreenTransitionTask::Observer', 'Observer'), ('mozilla::dom::nsFakeSynthServices', 'nsFakeSynthServices'), ('nsWindowMemoryReporter', 'nsW...(truncated) for dest_qualname, dest_name in direct_dests)) #14 Frame 0x234e2f0, for file /home/dxr/dxr/dxr/plugins/clang/needles.py, line 146, in <genexpr> (.0=<listiterator at remote 0x7fffe776b6f0>, dest_qualname='IPC::ParamTraits', dest_name='ParamTraits') for dest_qualname, dest_name in direct_dests)) #130685 Frame 0x1248160, for file /home/dxr/dxr/dxr/plugins/clang/needles.py, line 164, in needles_from_graph (graph={'nsCycleCollectionNoteRootCallback': [('CCGraphBuilder', 'CCGraphBuilder')], 'nsIObserver': [('mozilla::net::SchedulingContextService', 'SchedulingContextService'), ('nsSHistoryObserver', 'nsSHistoryObserver'), ('nsWifiMonitor', 'nsWifiMonitor'), ('mozilla::dom::VolumeStateObserver', 'VolumeStateObserver'), ('FontPrefsObserver', 'FontPrefsObserver'), ('nsProfiler', 'nsProfiler'), ('nsHtml5ParserThreadTerminator', 'nsHtml5ParserThreadTerminator'), ('mozilla::FinalizationWitnessService', 'FinalizationWitnessService'), ('WaitForTopicSpinner', 'WaitForTopicSpinner'), ('nsHTMLDNSPrefetch::nsDeferrals', 'nsDeferrals'), ('mozilla::LogModulePrefWatcher', 'LogModulePrefWatcher'), ('mozilla::dom::MediaKeySystemAccessManager', 'MediaKeySystemAccessManager'), ('FullscreenTransitionTask::Observer', 'Observer'), ('mozilla::dom::nsFakeSynthServices', 'nsFakeSynthServices'), ('nsWindowMemoryReporter', 'nsWindowMemory...(truncated) uniques = set(_nonunique_needles_from_graph(graph, root_qualname)) #130689 Frame 0xfc69c0, for file /home/dxr/dxr/dxr/plugins/clang/needles.py, line 244, in inheritance_needles (condensed={'function': set([]), 'typedef': set([<...>, <...>, <...>]), 'ref': set([<...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>]), 'macro': set([<...>]), 'namespace_alias': set([]), 'func_override': set([]), 'namespace': set([<...>, <...>,...(truncated) children, type['qualname'], type['span'], 'c_bases'): #130700 Frame 0xfc6c00, for file /home/dxr/dxr/dxr/indexers.py, line 552, in with_start_and_end (triples=<itertools.chain at remote 0x7fffe89d6840>, key='c_member', mapping={'start': 2, 'end': 25, 'qualname': 'mozilla::hal::FMRadioOperation', 'name': 'FMRadioOperation'}, extent=<Extent at remote 0x7fffe8b2c8e0>) for key, mapping, extent in triples: #130703 Frame 0xfc7070, for file /code/dbg-venv/local/lib/python2.7/site-packages/funcy/seqs.py, line 244, in group_by (f=<function at remote 0x7fffe899e108>, seq=<generator at remote 0x7fffe5e5bf60>, result={7: [('c_macro', {'start': 8, 'end': 27, 'name': 'mozilla_hal_Types_h'}, <Extent at remote 0x7fffe9637160>)], 12: [('c_namespace', {'start': 10, 'end': 17, 'qualname': 'mozilla', 'name': 'mozilla'}, <Extent at remote 0x7fffe96374e0>)], 13: [('c_namespace', {'start': 10, 'end': 13, 'qualname': 'mozilla::hal', 'name': 'hal'}, <Extent at remote 0x7ffff58e78e0>)], 20: [('c_var', {'start': 15, 'end': 41, 'qualname': 'mozilla::hal::CONTENT_PROCESS_ID_UNKNOWN', 'name': 'CONTENT_PROCESS_ID_UNKNOWN'}, <Extent at remote 0x7fffe8c3e6e0>)], 21: [('c_var', {'start': 15, 'end': 38, 'qualname': 'mozilla::hal::CONTENT_PROCESS_ID_MAIN', 'name': 'CONTENT_PROCESS_ID_MAIN'}, <Extent at remote 0x7fffe8c3e860>)], 28: [('c_type', {'start': 5, 'end': 17, 'qualname': 'mozilla::hal::ShutdownMode', 'name': 'ShutdownMode'}, <Extent at remot...(truncated) for item in seq: #130708 Frame 0x12469a0, for file /code/dbg-venv/local/lib/python2.7/site-packages/funcy/funcmakers.py, line 41, in <lambda> (f=<function at remote 0x7fffe899e108>, seqs=(<generator at remote 0x7fffe5e5bf60>,)) return wraps(func)(lambda f, *seqs: func(make_func(f, builtin=builtin, test=test), *seqs)) #130712 Frame 0xfc6e20, for file /home/dxr/dxr/dxr/indexers.py, line 561, in iterable_per_line (triples=<generator at remote 0x7fffe5e5bf60>) line_map = group_by(lambda (k, v, extent): extent.start.row, triples) # {line: triples} #130715 Frame 0xf67e90, for file /home/dxr/dxr/dxr/plugins/clang/needles.py, line 292, in all_needles (condensed={'function': set([]), 'typedef': set([<...>, <...>, <...>]), 'ref': set([<...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>]), 'macro': set([<...>]), 'namespace_alias': set([]), 'func_override': set([]), 'namespace': set([<...>, <...>, <...>])...(truncated) inheritance_needles(condensed, parents, children), #130718 Frame 0xf54fb0, for file /home/dxr/dxr/dxr/plugins/clang/indexers.py, line 75, in needles_by_line (self=<FileToIndex(condensed={'function': set([]), 'typedef': set([<...>, <...>, <...>]), 'ref': set([<...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>]), 'macro': set([<...>]), 'namespace_alias': set([]), 'func_override': set([]), 'namespace': set(...(truncated) ---Type <return> to continue, or q <return> to quit--- self.children) #130721 Frame 0x11267a0, for file /home/dxr/dxr/dxr/build.py, line 484, in index_file (tree=<TreeConfig(_section={'ignore_filenames': ['.hg', '.git', 'CVS', '.svn', '.bzr', '.deps', '.libs', '.DS_Store', '.nfs*', '*~', '._*'], 'build_command': 'cd $source_folder && ./mach clobber && make -f client.mk build MOZ_OBJDIR=$object_folder MOZ_MAKE_FLAGS="-s -j$jobs"', 'description': '', 'core': {}, 'enabled_plugins': [<Plugin(tree_to_index=<type at remote 0xfb3310>, file_to_skim=None, filters=[<type at remote 0xfc9b10>, <type at remote 0xfb2350>, <type at remote 0xfb1f60>, <type at remote 0xfb2f20>, <type at remote 0xfb1b70>, <type at remote 0xfb2b30>], analyzers={'tokenizer': {'trigram_tokenizer': {'max_gram': 3, 'type': 'nGram', 'min_gram': 3}}, 'analyzer': {'trigramalyzer': {'type': 'custom', 'tokenizer': 'trigram_tokenizer'}, 'lowercase': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'keyword'}, 'trigramalyzer_lower': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'trigram_tokenizer'}}}, refs={}, na...(truncated) file_to_index.needles_by_line()) #130725 Frame 0xf53fc0, for file /home/dxr/dxr/dxr/build.py, line 580, in index_chunk (tree=<TreeConfig(_section={'ignore_filenames': ['.hg', '.git', 'CVS', '.svn', '.bzr', '.deps', '.libs', '.DS_Store', '.nfs*', '*~', '._*'], 'build_command': 'cd $source_folder && ./mach clobber && make -f client.mk build MOZ_OBJDIR=$object_folder MOZ_MAKE_FLAGS="-s -j$jobs"', 'description': '', 'core': {}, 'enabled_plugins': [<Plugin(tree_to_index=<type at remote 0xfb3310>, file_to_skim=None, filters=[<type at remote 0xfc9b10>, <type at remote 0xfb2350>, <type at remote 0xfb1f60>, <type at remote 0xfb2f20>, <type at remote 0xfb1b70>, <type at remote 0xfb2b30>], analyzers={'tokenizer': {'trigram_tokenizer': {'max_gram': 3, 'type': 'nGram', 'min_gram': 3}}, 'analyzer': {'trigramalyzer': {'type': 'custom', 'tokenizer': 'trigram_tokenizer'}, 'lowercase': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'keyword'}, 'trigramalyzer_lower': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'trigram_tokenizer'}}}, refs={}, na...(truncated) index_file(tree, tree_indexers, path, es, index) #130729 Frame 0xf6f100, for file /home/dxr/dxr/dxr/build.py, line 627, in index_files (tree=<TreeConfig(_section={'ignore_filenames': ['.hg', '.git', 'CVS', '.svn', '.bzr', '.deps', '.libs', '.DS_Store', '.nfs*', '*~', '._*'], 'build_command': 'cd $source_folder && ./mach clobber && make -f client.mk build MOZ_OBJDIR=$object_folder MOZ_MAKE_FLAGS="-s -j$jobs"', 'description': '', 'core': {}, 'enabled_plugins': [<Plugin(tree_to_index=<type at remote 0xfb3310>, file_to_skim=None, filters=[<type at remote 0xfc9b10>, <type at remote 0xfb2350>, <type at remote 0xfb1f60>, <type at remote 0xfb2f20>, <type at remote 0xfb1b70>, <type at remote 0xfb2b30>], analyzers={'tokenizer': {'trigram_tokenizer': {'max_gram': 3, 'type': 'nGram', 'min_gram': 3}}, 'analyzer': {'trigramalyzer': {'type': 'custom', 'tokenizer': 'trigram_tokenizer'}, 'lowercase': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'keyword'}, 'trigramalyzer_lower': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'trigram_tokenizer'}}}, refs={}, na...(truncated) swallow_exc=False) #130732 Frame 0xb0acb0, for file /home/dxr/dxr/dxr/build.py, line 274, in index_tree (tree=<TreeConfig(_section={'ignore_filenames': ['.hg', '.git', 'CVS', '.svn', '.bzr', '.deps', '.libs', '.DS_Store', '.nfs*', '*~', '._*'], 'build_command': 'cd $source_folder && ./mach clobber && make -f client.mk build MOZ_OBJDIR=$object_folder MOZ_MAKE_FLAGS="-s -j$jobs"', 'description': '', 'core': {}, 'enabled_plugins': [<Plugin(tree_to_index=<type at remote 0xfb3310>, file_to_skim=None, filters=[<type at remote 0xfc9b10>, <type at remote 0xfb2350>, <type at remote 0xfb1f60>, <type at remote 0xfb2f20>, <type at remote 0xfb1b70>, <type at remote 0xfb2b30>], analyzers={'tokenizer': {'trigram_tokenizer': {'max_gram': 3, 'type': 'nGram', 'min_gram': 3}}, 'analyzer': {'trigramalyzer': {'type': 'custom', 'tokenizer': 'trigram_tokenizer'}, 'lowercase': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'keyword'}, 'trigramalyzer_lower': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'trigram_tokenizer'}}}, refs={}, nam...(truncated) index_files(tree, tree_indexers, index, pool, es) #130736 Frame 0x1076dc0, for file /home/dxr/dxr/dxr/build.py, line 63, in index_and_deploy_tree (tree=<TreeConfig(_section={'ignore_filenames': ['.hg', '.git', 'CVS', '.svn', '.bzr', '.deps', '.libs', '.DS_Store', '.nfs*', '*~', '._*'], 'build_command': 'cd $source_folder && ./mach clobber && make -f client.mk build MOZ_OBJDIR=$object_folder MOZ_MAKE_FLAGS="-s -j$jobs"', 'description': '', 'core': {}, 'enabled_plugins': [<Plugin(tree_to_index=<type at remote 0xfb3310>, file_to_skim=None, filters=[<type at remote 0xfc9b10>, <type at remote 0xfb2350>, <type at remote 0xfb1f60>, <type at remote 0xfb2f20>, <type at remote 0xfb1b70>, <type at remote 0xfb2b30>], analyzers={'tokenizer': {'trigram_tokenizer': {'max_gram': 3, 'type': 'nGram', 'min_gram': 3}}, 'analyzer': {'trigramalyzer': {'type': 'custom', 'tokenizer': 'trigram_tokenizer'}, 'lowercase': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'keyword'}, 'trigramalyzer_lower': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'trigram_tokenizer'}}}, r...(truncated) index_name = index_tree(tree, es, verbose=verbose) #130740 Frame 0xe09920, for file /home/dxr/dxr/dxr/cli/index.py, line 26, in index (config=<Config(_section={'es_hosts': 'http://127.0.0.1:9200/', 'default_tree': 'mozilla-central', 'log_folder': '/code/dxr-logs-{tree}', 'es_alias': 'dxr_{format}_{tree}', 'es_catalog_index': 'dxr_catalog', 'workers': 0, 'max_thumbnail_size': 20000, 'es_indexing_timeout': 60, 'google_analytics_key': '', 'es_refresh_interval': 60, 'es_catalog_replicas': 1, 'generated_date': 'Mon, 08 Feb 2016 17:30:15 +0000', 'skip_stages': ['build'], 'www_root': '', 'temp_folder': '/code/dxr-temp-{tree}', 'es_index': 'dxr_{format}_{tree}_{unique}'}, trees=<OrderedDict(_OrderedDict__map={'mozilla-central': ['mozilla-central', [None, [...], [...]], [...]]}, _OrderedDict__end=[...]) at remote 0x7ffff3f145c0>) at remote 0x7ffff4387140>, verbose=False, tree_names=(), tree=<TreeConfig(_section={'ignore_filenames': ['.hg', '.git', 'CVS', '.svn', '.bzr', '.deps', '.libs', '.DS_Store', '.nfs*', '*~', '._*'], 'build_command': 'cd $source_folder && ./mach clobber...(truncated) index_and_deploy_tree(tree, verbose=verbose) #130745 Frame 0xa31170, for file /code/dbg-venv/local/lib/python2.7/site-packages/click/core.py, line 464, in invoke (args=(), kwargs={'config': <Config(_section={'es_hosts': 'http://127.0.0.1:9200/', 'default_tree': 'mozilla-central', 'log_folder': '/code/dxr-logs-{tree}', 'es_alias': 'dxr_{format}_{tree}', 'es_catalog_index': 'dxr_catalog', 'workers': 0, 'max_thumbnail_size': 20000, 'es_indexing_timeout': 60, 'google_analytics_key': '', 'es_refresh_interval': 60, 'es_catalog_replicas': 1, 'generated_date': 'Mon, 08 Feb 2016 17:30:15 +0000', 'skip_stages': ['build'], 'www_root': '', 'temp_folder': '/code/dxr-temp-{tree}', 'es_index': 'dxr_{format}_{tree}_{unique}'}, trees=<OrderedDict(_OrderedDict__map={'mozilla-central': ['mozilla-central', [None, [...], [...]], [...]]}, _OrderedDict__end=[...]) at remote 0x7ffff3f145c0>) at remote 0x7ffff4387140>, 'verbose': False, 'tree_names': ()}, self=<Context(_depth=2, token_normalize_func=None, default_map=None, obj=None, parent=<Context(_depth=2, token_normalize_func=None, ...(truncated) return callback(*args, **kwargs) #130750 Frame 0x7ffff438a450, for file /code/dbg-venv/local/lib/python2.7/site-packages/click/core.py, line 837, in invoke (self---Type <return> to continue, or q <return> to quit--- =<Command(add_help_option=True, name='index', options_metavar='[OPTIONS]', callback=<function at remote 0x7ffff42654f8>, context_settings={}, params=[<Option(prompt=None, help='The configuration file', secondary_opts=[], hide_input=False, flag_value=False, confirmation_prompt=False, multiple=False, is_flag=False, metavar=None, allow_from_autoenv=True, type=<ConfigObject(writable=False, name='path', exists=True, resolve_path=False, readable=True, dir_okay=False, path_type='Path', file_okay=True) at remote 0x7ffff4924fb0>, is_bool_flag=False, expose_value=True, nargs=1, is_eager=False, count=False, name='config', default='dxr.config', required=False, callback=None, show_default=True, envvar=None, opts=['--config', '-c']) at remote 0x7ffff4260920>, <Option(prompt=None, help='Display the build logs during the build instead of only on error.', secondary_opts=[], hide_input=False, flag_value=True,...(truncated) return ctx.invoke(self.callback, **ctx.params) #130753 Frame 0xc76760, for file /code/dbg-venv/local/lib/python2.7/site-packages/click/core.py, line 991, in invoke (self=<Group(invoke_without_command=False, commands={'index': <Command(add_help_option=True, name='index', options_metavar='[OPTIONS]', callback=<function at remote 0x7ffff42654f8>, context_settings={}, params=[<Option(prompt=None, help='The configuration file', secondary_opts=[], hide_input=False, flag_value=False, confirmation_prompt=False, multiple=False, is_flag=False, metavar=None, allow_from_autoenv=True, type=<ConfigObject(writable=False, name='path', exists=True, resolve_path=False, readable=True, dir_okay=False, path_type='Path', file_okay=True) at remote 0x7ffff4924fb0>, is_bool_flag=False, expose_value=True, nargs=1, is_eager=False, count=False, name='config', default='dxr.config', required=False, callback=None, show_default=True, envvar=None, opts=['--config', '-c']) at remote 0x7ffff4260920>, <Option(prompt=None, help='Display the build logs during the build instead of only on error.', sec...(truncated) return _process_result(sub_ctx.command.invoke(sub_ctx)) #130757 Frame 0xf536d0, for file /home/dxr/dxr/dxr/cli/__init__.py, line 29, in main (ctx=<Context(_depth=2, token_normalize_func=None, default_map=None, obj=None, parent=None, allow_interspersed_args=False, max_content_width=None, ignore_unknown_options=False, args=['index'], allow_extra_args=True, info_name='dxr', invoked_subcommand=u'index', color=None, params={}, help_option_names=['--help'], command=<Group(invoke_without_command=False, commands={'index': <Command(add_help_option=True, name='index', options_metavar='[OPTIONS]', callback=<function at remote 0x7ffff42654f8>, context_settings={}, params=[<Option(prompt=None, help='The configuration file', secondary_opts=[], hide_input=False, flag_value=False, confirmation_prompt=False, multiple=False, is_flag=False, metavar=None, allow_from_autoenv=True, type=<ConfigObject(writable=False, name='path', exists=True, resolve_path=False, readable=True, dir_okay=False, path_type='Path', file_okay=True) at remote 0x7ffff4924fb0>, is_bool_flag=False, expose_value=True, nar...(truncated) return dxr.invoke(ctx) #130760 Frame 0x7ffff7e8fa38, for file dbg-venv/bin/dxr, line 9, in <module> () load_entry_point('dxr==2.0', 'console_scripts', 'dxr')()
(gdb) bt #0 0x00007ffff6f537ab in __GI___libc_malloc (bytes=528) at malloc.c:2891 #1 0x000000000048ee00 in PyObject_Malloc (nbytes=528) at ../Objects/obmalloc.c:963 #2 0x000000000048f8be in _PyObject_DebugMallocApi (id=111 'o', nbytes=496) at ../Objects/obmalloc.c:1469 #3 0x000000000048f815 in _PyObject_DebugMalloc (nbytes=496) at ../Objects/obmalloc.c:1436 #4 0x000000000057310d in _PyObject_GC_Malloc (basicsize=464) at ../Modules/gcmodule.c:1499 #5 0x0000000000573222 in _PyObject_GC_NewVar (tp=0x89c8e0 <PyFrame_Type>, nitems=8) at ../Modules/gcmodule.c:1531 #6 0x0000000000462663 in PyFrame_New (tstate=0x9ad0a0, code=0x7ffff41f8510, globals={'macro_needles': <function at remote 0x7ffff41f7e28>, 'chain': <type at remote 0x8dd980>, 'decl_needles': <function at remote 0x7ffff41f7c30>, 'needles_from_graph': <function at remote 0x7ffff41f7f78>, '__package__': 'dxr.plugins.clang', 'all_needles': <function at remote 0x7ffff3f763a8>, 'with_start_and_end': <function at remote 0x7ffff4927258>, '__doc__': None, 'overridden_needles': <function at remote 0x7ffff3f76108>, '__builtins__': {'bytearray': <type at remote 0x890d40>, 'IndexError': <type at remote 0x8973e0>, 'all': <built-in function all>, 'help': <_Helper at remote 0x7ffff7e9dca0>, 'vars': <built-in function vars>, 'SyntaxError': <type at remote 0x896d60>, 'unicode': <type at remote 0x8ae520>, 'UnicodeDecodeError': <type at remote 0x897d00>, 'memoryview': <type at remote 0x8a1e00>, 'isinstance': <built-in function isinstance>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2014 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCo...(truncated), locals=0x0) at ../Objects/frameobject.c:682 #7 0x0000000000523b34 in PyEval_EvalCodeEx (co=0x7ffff41f8510, globals={'macro_needles': <function at remote 0x7ffff41f7e28>, 'chain': <type at remote 0x8dd980>, 'decl_needles': <function at remote 0x7ffff41f7c30>, 'needles_from_graph': <function at remote 0x7ffff41f7f78>, '__package__': 'dxr.plugins.clang', 'all_needles': <function at remote 0x7ffff3f763a8>, 'with_start_and_end': <function at remote 0x7ffff4927258>, '__doc__': None, 'overridden_needles': <function at remote 0x7ffff3f76108>, '__builtins__': {'bytearray': <type at remote 0x890d40>, 'IndexError': <type at remote 0x8973e0>, 'all': <built-in function all>, 'help': <_Helper at remote 0x7ffff7e9dca0>, 'vars': <built-in function vars>, 'SyntaxError': <type at remote 0x896d60>, 'unicode': <type at remote 0x8ae520>, 'UnicodeDecodeError': <type at remote 0x897d00>, 'memoryview': <type at remote 0x8a1e00>, 'isinstance': <built-in function isinstance>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2014 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCo...(truncated), locals=0x0, args=0x18fe6c8, argcount=1, kws=0x18fe6d0, kwcount=0, defs=0x0, defcount=0, closure=(<cell at remote 0x7fffe8939610>,)) at ../Python/ceval.c:3033 #8 0x000000000052799e in fast_function (func=<function at remote 0x7fffe9f74ae0>, pp_stack=0x7fffff7ff490, n=1, na=1, nk=0) at ../Python/ceval.c:4116 #9 0x0000000000527588 in call_function (pp_stack=0x7fffff7ff490, oparg=1) at ../Python/ceval.c:4041 #10 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0x18fe500, for file /home/dxr/dxr/dxr/plugins/clang/needles.py, line 146, in _nonunique_needles_from_graph (graph={'nsCycleCollectionNoteRootCallback': [('CCGraphBuilder', 'CCGraphBuilder')], 'nsIObserver': [('mozilla::net::SchedulingContextService', 'SchedulingContextService'), ('nsSHistoryObserver', 'nsSHistoryObserver'), ('nsWifiMonitor', 'nsWifiMonitor'), ('mozilla::dom::VolumeStateObserver', 'VolumeStateObserver'), ('FontPrefsObserver', 'FontPrefsObserver'), ('nsProfiler', 'nsProfiler'), ('nsHtml5ParserThreadTerminator', 'nsHtml5ParserThreadTerminator'), ('mozilla::FinalizationWitnessService', 'FinalizationWitnessService'), ('WaitForTopicSpinner', 'WaitForTopicSpinner'), ('nsHTMLDNSPrefetch::nsDeferrals', 'nsDeferrals'), ('mozilla::LogModulePrefWatcher', 'LogModulePrefWatcher'), ('mozilla::dom::MediaKeySystemAccessManager', 'MediaKeySystemAccessManager'), ('FullscreenTransitionTask::Observer', 'Observer'), ('mozilla::dom::nsFakeSynthServices', 'nsFakeSynthServices'), ('nsWindowMemoryReporter', 'nsW...(truncated), throwflag=0) at ../Python/ceval.c:2666 #11 0x0000000000524b9a in PyEval_EvalCodeEx (co=0x7ffff41f85c0, globals={'macro_needles': <function at remote 0x7ffff41f7e28>, 'chain': <type at remote 0x8dd980>, 'decl_needles': <function at remote 0x7ffff41f7c30>, 'needles_from_graph': <function at remote 0x7ffff41f7f78>, '__package__': 'dxr.plugins.clang', 'all_needles': <function at remote 0x7ffff3f763a8>, 'with_start_and_end': <function at remote 0x7ffff4927258>, '__doc__': None, 'overridden_needles': <function at remote 0x7ffff3f76108>, '__builtins__': {'bytearray': <type at remote 0x890d40>, 'IndexError': <type at remote 0x8973e0>, 'all': <built-in function all>, 'help': <_Helper at remote 0x7ffff7e9dca0>, 'vars': <built-in function vars>, 'SyntaxError': <type at remote 0x896d60>, 'unicode': <type at remote 0x8ae520>, 'UnicodeDecodeError': <type at remote 0x897d00>, 'memoryview': <type at remote 0x8a1e00>, 'isinstance': <built-in function isinstance>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2014 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCo...(truncated), locals=0x0, args=0x33ee348, argcount=2, kws=0x33ee358, kwcount=0, defs=0x0, defcount=0, closure=0x0) at ../Python/ceval.c:3252 #12 0x000000000052799e in fast_function (func=<function at remote 0x7ffff41f7ed0>, pp_stack=0x7fffff7ff930, n=2, na=2, nk=0) at ../Python/ceval.c:4116 #13 0x0000000000527588 in call_function (pp_stack=0x7fffff7ff930, oparg=2) at ../Python/ceval.c:4041 #14 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0x33ee190, for file /home/dxr/dxr/dxr/plugins/clang/needles.py, line 146, in <genexpr> (.0=<listiterator at remote 0x7fffe893c6f0>, dest_qualname='IPC::ParamTraits', dest_name='ParamTraits'), throwflag=0) at ../Python/ceval.c:2666 #15 0x0000000000452c14 in gen_send_ex (gen=0x7fffe893bae0, arg=0x0, exc=0) at ../Objects/genobject.c:85 #16 0x0000000000453581 in gen_iternext (gen=0x7fffe893bae0) at ../Objects/genobject.c:283 #17 0x0000000000429436 in PyIter_Next (iter=<generator at remote 0x7fffe893bae0>) at ../Objects/abstract.c:3107 #18 0x00000000005d00d3 in chain_next (lz=0x7fffe893c760) at ../Modules/itertoolsmodule.c:1711 #19 0x0000000000429436 in PyIter_Next (iter=<itertools.chain at remote 0x7fffe893c760>) at ../Objects/abstract.c:3107 #20 0x00000000005d02a1 in chain_next (lz=0x7fffe893c840) at ../Modules/itertoolsmodule.c:1723 #21 0x00000000005d0378 in chain_next (lz=0x7fffe893c840) at ../Modules/itertoolsmodule.c:1733 #22 0x0000000000429436 in PyIter_Next (iter=<itertools.chain at remote 0x7fffe893c840>) at ../Objects/abstract.c:3107 #23 0x00000000005d02a1 in chain_next (lz=0x7fffe893c5a0) at ../Modules/itertoolsmodule.c:1723 #24 0x0000000000429436 in PyIter_Next (iter=<itertools.chain at remote 0x7fffe893c5a0>) at ../Objects/abstract.c:3107 #25 0x00000000005d02a1 in chain_next (lz=0x7fffe893c680) at ../Modules/itertoolsmodule.c:1723 #26 0x0000000000429436 in PyIter_Next (iter=<itertools.chain at remote 0x7fffe893c680>) at ../Objects/abstract.c:3107 ... #130669 0x00000000005d02a1 in chain_next (lz=0x7fffe89d6ca0) at ../Modules/itertoolsmodule.c:1723 #130670 0x0000000000429436 in PyIter_Next (iter=<itertools.chain at remote 0x7fffe89d6ca0>) at ../Objects/abstract.c:3107 #130671 0x00000000005d02a1 in chain_next (lz=0x7fffe89d6a00) at ../Modules/itertoolsmodule.c:1723 #130672 0x0000000000429436 in PyIter_Next (iter=<itertools.chain at remote 0x7fffe89d6a00>) at ../Objects/abstract.c:3107 #130673 0x00000000005d02a1 in chain_next (lz=0x7fffe89d6ae0) at ../Modules/itertoolsmodule.c:1723 #130674 0x0000000000429436 in PyIter_Next (iter=<itertools.chain at remote 0x7fffe89d6ae0>) at ../Objects/abstract.c:3107 #130675 0x00000000005d02a1 in chain_next (lz=0x7fffe89d67d0) at ../Modules/itertoolsmodule.c:1723 #130676 0x0000000000429436 in PyIter_Next (iter=<itertools.chain at remote 0x7fffe89d67d0>) at ../Objects/abstract.c:3107 #130677 0x00000000005d02a1 in chain_next (lz=0x7fffe89d66f0) at ../Modules/itertoolsmodule.c:1723 #130678 0x0000000000429436 in PyIter_Next (iter=<itertools.chain at remote 0x7fffe89d66f0>) at ../Objects/abstract.c:3107 #130679 0x0000000000493abe in set_update_internal (so=0x7ffff5b274c0, other=<itertools.chain at remote 0x7fffe89d66f0>) at ../Objects/setobject.c:969 #130680 0x0000000000497c43 in set_init (self=0x7ffff5b274c0, args=(<itertools.chain at remote 0x7fffe89d66f0>,), kwds=0x0) at ../Objects/setobject.c:2005 #130681 0x00000000004b0973 in type_call (type=0x8a4080 <PySet_Type>, args=(<itertools.chain at remote 0x7fffe89d66f0>,), kwds=0x0) at ../Objects/typeobject.c:745 #130682 0x000000000042778d in PyObject_Call (func=<type at remote 0x8a4080>, arg=(<itertools.chain at remote 0x7fffe89d66f0>,), kw=0x0) at ../Objects/abstract.c:2529 #130683 0x00000000005281f3 in do_call (func=<type at remote 0x8a4080>, pp_stack=0x7fffffff9710, na=1, nk=0) at ../Python/ceval.c:4238 #130684 0x00000000005275a4 in call_function (pp_stack=0x7fffffff9710, oparg=1) at ../Python/ceval.c:4043 #130685 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0x1248160, for file /home/dxr/dxr/dxr/plugins/clang/needles.py, line 164, in needles_from_graph (graph={'nsCycleCollectionNoteRootCallback': [('CCGraphBuilder', 'CCGraphBuilder')], 'nsIObserver': [('mozilla::net::SchedulingContextService', 'SchedulingContextService'), ('nsSHistoryObserver', 'nsSHistoryObserver'), ('nsWifiMonitor', 'nsWifiMonitor'), ('mozilla::dom::VolumeStateObserver', 'VolumeStateObserver'), ('FontPrefsObserver', 'FontPrefsObserver'), ('nsProfiler', 'nsProfiler'), ('nsHtml5ParserThreadTerminator', 'nsHtml5ParserThreadTerminator'), ('mozilla::FinalizationWitnessService', 'FinalizationWitnessService'), ('WaitForTopicSpinner', 'WaitForTopicSpinner'), ('nsHTMLDNSPrefetch::nsDeferrals', 'nsDeferrals'), ('mozilla::LogModulePrefWatcher', 'LogModulePrefWatcher'), ('mozilla::dom::MediaKeySystemAccessManager', 'MediaKeySystemAccessManager'), ('FullscreenTransitionTask::Observer', 'Observer'), ('mozilla::dom::nsFakeSynthServices', 'nsFakeSynthServices'), ('nsWindowMemoryReporter', 'nsWindowMemory...(truncated), throwflag=0) at ../Python/ceval.c:2666 #130686 0x0000000000524b9a in PyEval_EvalCodeEx (co=0x7ffff3f70720, globals={'macro_needles': <function at remote 0x7ffff41f8e28>, 'chain': <type at remote 0x8dd980>, 'decl_needles': <function at remote 0x7ffff41f8c30>, 'needles_from_graph': <function at remote 0x7ffff41f8f78>, '__package__': 'dxr.plugins.clang', 'all_needles': <function at remote 0x7ffff3f773a8>, 'with_start_and_end': <function at remote 0x7ffff4927258>, '__doc__': None, 'overridden_needles': <function at remote 0x7ffff3f77108>, '__builtins__': {'bytearray': <type at remote 0x890d40>, 'IndexError': <type at remote 0x8973e0>, 'all': <built-in function all>, 'help': <_Helper at remote 0x7ffff7e9dca0>, 'vars': <built-in function vars>, 'SyntaxError': <type at remote 0x896d60>, 'unicode': <type at remote 0x8ae520>, 'UnicodeDecodeError': <type at remote 0x897d00>, 'memoryview': <type at remote 0x8a1e00>, 'isinstance': <built-in function isinstance>, 'copyright': <_Printer(_Printer__data='Copyright (c) 2001-2014 Python Software Foundation.\nAll Rights Reserved.\n\nCopyright (c) 2000 BeOpen.com.\nAll Rights Reserved.\n\nCo...(truncated), locals=0x0, args=0xfc6b80, argcount=4, kws=0xfc6ba0, kwcount=0, defs=0x0, defcount=0, closure=0x0) at ../Python/ceval.c:3252 #130687 0x000000000052799e in fast_function (func=<function at remote 0x7ffff41f8f78>, pp_stack=0x7fffffff9bb0, n=4, na=4, nk=0) at ../Python/ceval.c:4116 #130688 0x0000000000527588 in call_function (pp_stack=0x7fffffff9bb0, oparg=4) at ../Python/ceval.c:4041 #130689 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0xfc69c0, for file /home/dxr/dxr/dxr/plugins/clang/needles.py, line 244, in inheritance_needles (condensed={'function': set([]), 'typedef': set([<...>, <...>, <...>]), 'ref': set([<...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>]), 'macro': set([<...>]), 'namespace_alias': set([]), 'func_override': set([]), 'namespace': set([<...>, <...>,...(truncated), throwflag=0) at ../Python/ceval.c:2666 #130690 0x0000000000452c14 in gen_send_ex (gen=0x7fffe5e5bee0, arg=0x0, exc=0) at ../Objects/genobject.c:85 #130691 0x0000000000453581 in gen_iternext (gen=0x7fffe5e5bee0) at ../Objects/genobject.c:283 #130692 0x0000000000429436 in PyIter_Next (iter=<generator at remote 0x7fffe5e5bee0>) at ../Objects/abstract.c:3107 #130693 0x00000000005d02a1 in chain_next (lz=0x7fffe8ccbdf0) at ../Modules/itertoolsmodule.c:1723 #130694 0x00000000005d0378 in chain_next (lz=0x7fffe8ccbdf0) at ../Modules/itertoolsmodule.c:1733 #130695 0x0000000000429436 in PyIter_Next (iter=<itertools.chain at remote 0x7fffe8ccbdf0>) at ../Objects/abstract.c:3107 #130696 0x00000000005cfc39 in imap_next (lz=0x7fffe8ccb1b0) at ../Modules/itertoolsmodule.c:1564 #130697 0x0000000000429436 in PyIter_Next (iter=<itertools.imap at remote 0x7fffe8ccb1b0>) at ../Objects/abstract.c:3107 #130698 0x00000000005d00d3 in chain_next (lz=0x7fffe89d6840) at ../Modules/itertoolsmodule.c:1711 #130699 0x00000000005d0378 in chain_next (lz=0x7fffe89d6840) at ../Modules/itertoolsmodule.c:1733 #130700 0x0000000000521a7b in PyEval_EvalFrameEx ( f=Frame 0xfc6c00, for file /home/dxr/dxr/dxr/indexers.py, line 552, in with_start_and_end (triples=<itertools.chain at remote 0x7fffe89d6840>, key='c_member', mapping={'start': 2, 'end': 25, 'qualname': 'mozilla::hal::FMRadioOperation', 'name': 'FMRadioOperation'}, extent=<Extent at remote 0x7fffe8b2c8e0>), throwflag=0) at ../Python/ceval.c:2497 #130701 0x0000000000452c14 in gen_send_ex (gen=0x7fffe5e5bf60, arg=0x0, exc=0) at ../Objects/genobject.c:85 #130702 0x0000000000453581 in gen_iternext (gen=0x7fffe5e5bf60) at ../Objects/genobject.c:283 #130703 0x0000000000521a7b in PyEval_EvalFrameEx ( f=Frame 0xfc7070, for file /code/dbg-venv/local/lib/python2.7/site-packages/funcy/seqs.py, line 244, in group_by (f=<function at remote 0x7fffe899e108>, seq=<generator at remote 0x7fffe5e5bf60>, result={7: [('c_macro', {'start': 8, 'end': 27, 'name': 'mozilla_hal_Types_h'}, <Extent at remote 0x7fffe9637160>)], 12: [('c_namespace', {'start': 10, 'end': 17, 'qualname': 'mozilla', 'name': 'mozilla'}, <Extent at remote 0x7fffe96374e0>)], 13: [('c_namespace', {'start': 10, 'end': 13, 'qualname': 'mozilla::hal', 'name': 'hal'}, <Extent at remote 0x7ffff58e78e0>)], 20: [('c_var', {'start': 15, 'end': 41, 'qualname': 'mozilla::hal::CONTENT_PROCESS_ID_UNKNOWN', 'name': 'CONTENT_PROCESS_ID_UNKNOWN'}, <Extent at remote 0x7fffe8c3e6e0>)], 21: [('c_var', {'start': 15, 'end': 38, 'qualname': 'mozilla::hal::CONTENT_PROCESS_ID_MAIN', 'name': 'CONTENT_PROCESS_ID_MAIN'}, <Extent at remote 0x7fffe8c3e860>)], 28: [('c_type', {'start': 5, 'end': 17, 'qualname': 'mozilla::hal::ShutdownMode', 'name': 'ShutdownMode'}, <Extent at remot...(truncated), throwflag=0) at ../Python/ceval.c:2497 #130704 0x0000000000524b9a in PyEval_EvalCodeEx (co=0x7ffff58c0720, globals={'partial': <type at remote 0x8c90c0>, 'chain': <type at remote 0x8dd980>, 'reductions': <function at remote 0x7ffff58d35a0>, 'izip': <type at remote 0x8df360>, 'isplit': <function at remote 0x7ffff58cd450>, 'rest': <function at remote 0x7ffff58ca258>, 'ipartition_by': <function at remote 0x7ffff58d3258>, 'split_at': <function at remote 0x7ffff58cd6f0>, 'with_prev': <function at remote 0x7ffff58d33a8>, 'wrap_selector': <function at remote 0x7ffff58bb060>, 'count_by': <function at remote 0x7ffff58cdc30>, 'isplit_at': <function at remote 0x7ffff58cd648>, 'add': <built-in function add>, 'group_by': <function at remote 0x7ffff58cd990>, 'PY2': True, 'split': <function at remote 0x7ffff58cd5a0>, '__file__': '/code/dbg-venv/local/lib/python2.7/site-packages/funcy/seqs.pyc', 'icat': <built-in method from_iterable of type object at remote 0x8dd980>, 'sums': <functools.partial at remote 0x7ffff58c7308>, 'first': <function at remote 0x7ffff58bbf78>, 'iconcat': <type at remote 0x8dd980>, 'ichunks': <function at remote 0x...(truncated), locals=0x0, args=0x7fffe8b23b50, argcount=2, kws=0x0, kwcount=0, defs=0x0, defcount=0, closure=0x0) at ../Python/ceval.c:3252 #130705 0x0000000000464f21 in function_call (func=<function at remote 0x7ffff58cd8e8>, arg=(<function at remote 0x7fffe899e108>, <generator at remote 0x7fffe5e5bf60>), kw=0x0) at ../Objects/funcobject.c:526 #130706 0x000000000042778d in PyObject_Call (func=<function at remote 0x7ffff58cd8e8>, arg=(<function at remote 0x7fffe899e108>, <generator at remote 0x7fffe5e5bf60>), kw=0x0) at ../Objects/abstract.c:2529 #130707 0x0000000000528869 in ext_do_call (func=<function at remote 0x7ffff58cd8e8>, pp_stack=0x7fffffffa7b0, flags=1, na=1, nk=0) at ../Python/ceval.c:4333 #130708 0x000000000052259a in PyEval_EvalFrameEx ( f=Frame 0x12469a0, for file /code/dbg-venv/local/lib/python2.7/site-packages/funcy/funcmakers.py, line 41, in <lambda> (f=<function at remote 0x7fffe899e108>, seqs=(<generator at remote 0x7fffe5e5bf60>,)), throwflag=0) at ../Python/ceval.c:2705 #130709 0x0000000000524b9a in PyEval_EvalCodeEx (co=0x7ffff58b80f0, globals={'PY2': True, 're_tester': <function at remote 0x7ffff58b0ae0>, 'make_func': <function at remote 0x7ffff58b0d80>, 'wrap_selector': <function at remote 0x7ffff58bb060>, 'wraps': <function at remote 0x7ffff6df8060>, '__all__': ('make_func', 'make_pred', 'wrap_mapper', 'wrap_selector'), 'Mapping': <ABCMeta(_abc_cache=<WeakSet(_remove=<function at remote 0x7ffff7e92840>, _pending_removals=[], _iterating=set([]), data=set([<weakref at remote 0x7ffff7e86e30>])) at remote 0x7ffff7e88df0>, __ne__=<function at remote 0x7ffff7e92798>, __module__='_abcoll', __abstractmethods__=frozenset(['__iter__', '__getitem__', '__len__']), _abc_negative_cache=<WeakSet(_remove=<function at remote 0x7ffff3ebdcd8>, _pending_removals=[], _iterating=set([]), data=set([<weakref at remote 0x7fffec452308>, <weakref at remote 0x7fffec452528>, <weakref at remote 0x7ffff563eb88>, <weakref at remote 0x7ffff3ed2748>])) at remote 0x7ffff3ed6370>, __getitem__=<function at remote 0x7ffff7e92108>, __contains__=<function at remote 0x7ffff7e92258>, ke...(truncated), locals=0x0, args=0xfc6fe8, argcount=2, kws=0xfc6ff8, kwcount=0, defs=0x0, defcount=0, closure=(<cell at remote 0x7ffff58c8e30>, <cell at remote 0x7ffff58c8e98>, <cell at remote 0x7ffff58c8f00>)) at ../Python/ceval.c:3252 #130710 0x000000000052799e in fast_function (func=<function at remote 0x7ffff58cd990>, pp_stack=0x7fffffffac50, n=2, na=2, nk=0) at ../Python/ceval.c:4116 #130711 0x0000000000527588 in call_function (pp_stack=0x7fffffffac50, oparg=2) at ../Python/ceval.c:4041 #130712 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0xfc6e20, for file /home/dxr/dxr/dxr/indexers.py, line 561, in iterable_per_line (triples=<generator at remote 0x7fffe5e5bf60>), throwflag=0) at ../Python/ceval.c:2666 #130713 0x000000000052787d in fast_function (func=<function at remote 0x7ffff4927300>, pp_stack=0x7fffffffaf80, n=1, na=1, nk=0) at ../Python/ceval.c:4106 #130714 0x0000000000527588 in call_function (pp_stack=0x7fffffffaf80, oparg=1) at ../Python/ceval.c:4041 #130715 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0xf67e90, for file /home/dxr/dxr/dxr/plugins/clang/needles.py, line 292, in all_needles (condensed={'function': set([]), 'typedef': set([<...>, <...>, <...>]), 'ref': set([<...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>]), 'macro': set([<...>]), 'namespace_alias': set([]), 'func_override': set([]), 'namespace': set([<...>, <...>, <...>])...(truncated), throwflag=0) at ../Python/ceval.c:2666 #130716 0x000000000052787d in fast_function (func=<function at remote 0x7ffff3f773a8>, pp_stack=0x7fffffffb2b0, n=5, na=5, nk=0) at ../Python/ceval.c:4106 #130717 0x0000000000527588 in call_function (pp_stack=0x7fffffffb2b0, oparg=5) at ../Python/ceval.c:4041 #130718 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0xf54fb0, for file /home/dxr/dxr/dxr/plugins/clang/indexers.py, line 75, in needles_by_line (self=<FileToIndex(condensed={'function': set([]), 'typedef': set([<...>, <...>, <...>]), 'ref': set([<...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>, <...>]), 'macro': set([<...>]), 'namespace_alias': set([]), 'func_override': set([]), 'namespace': set(...(truncated), throwflag=0) at ../Python/ceval.c:2666 #130719 0x000000000052787d in fast_function (func=<function at remote 0x7ffff3f775a0>, pp_stack=0x7fffffffb5e0, n=1, na=1, nk=0) at ../Python/ceval.c:4106 #130720 0x0000000000527588 in call_function (pp_stack=0x7fffffffb5e0, oparg=0) at ../Python/ceval.c:4041 #130721 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0x11267a0, for file /home/dxr/dxr/dxr/build.py, line 484, in index_file (tree=<TreeConfig(_section={'ignore_filenames': ['.hg', '.git', 'CVS', '.svn', '.bzr', '.deps', '.libs', '.DS_Store', '.nfs*', '*~', '._*'], 'build_command': 'cd $source_folder && ./mach clobber && make -f client.mk build MOZ_OBJDIR=$object_folder MOZ_MAKE_FLAGS="-s -j$jobs"', 'description': '', 'core': {}, 'enabled_plugins': [<Plugin(tree_to_index=<type at remote 0xfb3310>, file_to_skim=None, filters=[<type at remote 0xfc9b10>, <type at remote 0xfb2350>, <type at remote 0xfb1f60>, <type at remote 0xfb2f20>, <type at remote 0xfb1b70>, <type at remote 0xfb2b30>], analyzers={'tokenizer': {'trigram_tokenizer': {'max_gram': 3, 'type': 'nGram', 'min_gram': 3}}, 'analyzer': {'trigramalyzer': {'type': 'custom', 'tokenizer': 'trigram_tokenizer'}, 'lowercase': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'keyword'}, 'trigramalyzer_lower': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'trigram_tokenizer'}}}, refs={}, na...(truncated), throwflag=0) at ../Python/ceval.c:2666 #130722 0x0000000000524b9a in PyEval_EvalCodeEx (co=0x7ffff424f0f0, globals={'create_index_and_wait': <function at remote 0x7ffff46dfae0>, 'show_progress': <function at remote 0x7ffff4263b88>, 'save_scribbles': <function at remote 0x7ffff4263c30>, 'OrderedDict': <type at remote 0xbe5b70>, 'chain': <type at remote 0x8dd980>, 'FORMAT': '17', 'current_app': <LocalProxy at remote 0x7ffff4c7db28>, 'izip': <type at remote 0x8df360>, 'append_by_line': <function at remote 0x7ffff4975108>, 'IndexAlreadyExistsError': <type at remote 0xe4eb20>, 'datetime': <type at remote 0x7ffff5ef3820>, 'ElasticHttpNotFoundError': <type at remote 0xf15200>, 'filter_menu_items': <function at remote 0x7ffff444e648>, 'FILE': 'file', 'uuid1': <function at remote 0x7ffff530f1b0>, 'chunks': <function at remote 0x7ffff58d3108>, '_unignored_folders': <function at remote 0x7ffff4263d80>, 'LINE': 'line', 'dirname': <function at remote 0x7ffff7ef4258>, 'swap_alias': <function at remote 0x7ffff4263990>, '_fill_and_write_template': <function at remote 0x7ffff4265258>, 'index_file': <function at remote 0x7ffff4263f78>, 'UN...(truncated), locals=0x0, args=0xf541c8, argcount=5, kws=0xf541f0, kwcount=0, defs=0x0, defcount=0, closure=0x0) at ../Python/ceval.c:3252 #130723 0x000000000052799e in fast_function (func=<function at remote 0x7ffff4263f78>, pp_stack=0x7fffffffba80, n=5, na=5, nk=0) at ../Python/ceval.c:4116 #130724 0x0000000000527588 in call_function (pp_stack=0x7fffffffba80, oparg=5) at ../Python/ceval.c:4041 #130725 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0xf53fc0, for file /home/dxr/dxr/dxr/build.py, line 580, in index_chunk (tree=<TreeConfig(_section={'ignore_filenames': ['.hg', '.git', 'CVS', '.svn', '.bzr', '.deps', '.libs', '.DS_Store', '.nfs*', '*~', '._*'], 'build_command': 'cd $source_folder && ./mach clobber && make -f client.mk build MOZ_OBJDIR=$object_folder MOZ_MAKE_FLAGS="-s -j$jobs"', 'description': '', 'core': {}, 'enabled_plugins': [<Plugin(tree_to_index=<type at remote 0xfb3310>, file_to_skim=None, filters=[<type at remote 0xfc9b10>, <type at remote 0xfb2350>, <type at remote 0xfb1f60>, <type at remote 0xfb2f20>, <type at remote 0xfb1b70>, <type at remote 0xfb2b30>], analyzers={'tokenizer': {'trigram_tokenizer': {'max_gram': 3, 'type': 'nGram', 'min_gram': 3}}, 'analyzer': {'trigramalyzer': {'type': 'custom', 'tokenizer': 'trigram_tokenizer'}, 'lowercase': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'keyword'}, 'trigramalyzer_lower': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'trigram_tokenizer'}}}, refs={}, na...(truncated), throwflag=0) at ../Python/ceval.c:2666 #130726 0x0000000000524b9a in PyEval_EvalCodeEx (co=0x7ffff424f1a0, globals={'create_index_and_wait': <function at remote 0x7ffff46dfae0>, 'show_progress': <function at remote 0x7ffff4263b88>, 'save_scribbles': <function at remote 0x7ffff4263c30>, 'OrderedDict': <type at remote 0xbe5b70>, 'chain': <type at remote 0x8dd 980>, 'FORMAT': '17', 'current_app': <LocalProxy at remote 0x7ffff4c7db28>, 'izip': <type at remote 0x8df360>, 'append_by_line': <function at remote 0x7ffff4975108>, 'IndexAlreadyExistsError': <type at remote 0xe4eb20>, 'datetime': <type at remote 0x7ffff5ef3820>, 'ElasticHttpNotFoundError': <type at remote 0xf15200>, 'filter_menu_items': <function at remote 0x7ffff444e648>, 'FILE': 'file', 'uuid1': <function at remote 0x7ffff530f1b0>, 'chunks': <function at remote 0x7ffff58d3108>, '_unignored_folders': <function at remote 0x7ffff4263d80>, 'LINE': 'line', 'dirname': <function at remote 0x7ffff7ef4258>, 'swap_alias': <function at remote 0x7ffff4263990>, '_fill_and_write_template': <function at remote 0x7ffff4265258>, 'index_file': <function at remote 0x7ffff4263f78>, 'UN...(truncated), locals=0x0, args=0xf6f310, argcount=4, kws=0xf6f330, kwcount=1, defs=0x7ffff4423da8, defcount=2, closure=0x0) at ../Python/ceval.c:3252 #130727 0x000000000052799e in fast_function (func=<function at remote 0x7ffff4265060>, pp_stack=0x7fffffffbf20, n=6, na=4, nk=1) at ../Python/ceval.c:4116 #130728 0x0000000000527588 in call_function (pp_stack=0x7fffffffbf20, oparg=260) at ../Python/ceval.c:4041 #130729 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0xf6f100, for file /home/dxr/dxr/dxr/build.py, line 627, in index_files (tree=<TreeConfig(_section={'ignore_filenames': ['.hg', '.git', 'CVS', '.svn', '.bzr', '.deps', '.libs', '.DS_Store', '.nfs*', '*~', '._*'], 'build_command': 'cd $source_folder && ./mach clobber && make -f client.mk build MOZ_OBJDIR=$object_folder MOZ_MAKE_FLAGS="-s -j$jobs"', 'description': '', 'core': {}, 'enabled_plugins': [<Plugin(tree_to_index=<type at remote 0xfb3310>, file_to_skim=None, filters=[<type at remote 0xfc9b10>, <type at remote 0xfb2350>, <type at remote 0xfb1f60>, <type at remote 0xfb2f20>, <type at remote 0xfb1b70>, <type at remote 0xfb2b30>], analyzers={'tokenizer': {'trigram_tokenizer': {'max_gram': 3, 'type': 'nGram', 'min_gram': 3}}, 'analyzer': {'trigramalyzer': {'type': 'custom', 'tokenizer': 'trigram_tokenizer'}, 'lowercase': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'keyword'}, 'trigramalyzer_lower': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'trigram_tokenizer'}}}, refs={}, na...(truncated), throwflag=0) at ../Python/ceval.c:2666 #130730 0x000000000052787d in fast_function (func=<function at remote 0x7ffff42651b0>, pp_stack=0x7fffffffc250, n=5, na=5, nk=0) at ../Python/ceval.c:4106 #130731 0x0000000000527588 in call_function (pp_stack=0x7fffffffc250, oparg=5) at ../Python/ceval.c:4041 #130732 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0xb0acb0, for file /home/dxr/dxr/dxr/build.py, line 274, in index_tree (tree=<TreeConfig(_section={'ignore_filenames': ['.hg', '.git', 'CVS', '.svn', '.bzr', '.deps', '.libs', '.DS_Store', '.nfs*', '*~', '._*'], 'build_command': 'cd $source_folder && ./mach clobber && make -f client.mk build MOZ_OBJDIR=$object_folder MOZ_MAKE_FLAGS="-s -j$jobs"', 'description': '', 'core': {}, 'enabled_plugins': [<Plugin(tree_to_index=<type at remote 0xfb3310>, file_to_skim=None, filters=[<type at remote 0xfc9b10>, <type at remote 0xfb2350>, <type at remote 0xfb1f60>, <type at remote 0xfb2f20>, <type at remote 0xfb1b70>, <type at remote 0xfb2b30>], analyzers={'tokenizer': {'trigram_tokenizer': {'max_gram': 3, 'type': 'nGram', 'min_gram': 3}}, 'analyzer': {'trigramalyzer': {'type': 'custom', 'tokenizer': 'trigram_tokenizer'}, 'lowercase': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'keyword'}, 'trigramalyzer_lower': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'trigram_tokenizer'}}}, refs={}, nam...(truncated), throwflag=0) at ../Python/ceval.c:2666 #130733 0x0000000000524b9a in PyEval_EvalCodeEx (co=0x7ffff4466ca0, globals={'create_index_and_wait': <function at remote 0x7ffff46dfae0>, 'show_progress': <function at remote 0x7ffff4263b88>, 'save_scribbles': <function at remote 0x7ffff4263c30>, 'OrderedDict': <type at remote 0xbe5b70>, 'chain': <type at remote 0x8dd980>, 'FORMAT': '17', 'current_app': <LocalProxy at remote 0x7ffff4c7db28>, 'izip': <type at remote 0x8df360>, 'append_by_line': <function at remote 0x7ffff4975108>, 'IndexAlreadyExistsError': <type at remote 0xe4eb20>, 'datetime': <type at remote 0x7ffff5ef3820>, 'ElasticHttpNotFoundError': <type at remote 0xf15200>, 'filter_menu_items': <function at remote 0x7ffff444e648>, 'FILE': 'file', 'uuid1': <function at remote 0x7ffff530f1b0>, 'chunks': <function at remote 0x7ffff58d3108>, '_unignored_folders': <function at remote 0x7ffff4263d80>, 'LINE': 'line', 'dirname': <function at remote 0x7ffff7ef4258>, 'swap_alias': <function at remote 0x7ffff4263990>, '_fill_and_write_template': <function at remote 0x7ffff4265258>, 'index_file': <function at remote 0x7ffff4263f78>, 'UN...(truncated), locals=0x0, args=0x1076f78, argcount=2, kws=0x1076f88, kwcount=1, defs=0x7ffff424e248, defcount=1, closure=0x0) at ../Python/ceval.c:3252 #130734 0x000000000052799e in fast_function (func=<function at remote 0x7ffff4263a38>, pp_stack=0x7fffffffc6f0, n=4, na=2, nk=1) at ../Python/ceval.c:4116 #130735 0x0000000000527588 in call_function (pp_stack=0x7fffffffc6f0, oparg=258) at ../Python/ceval.c:4041 #130736 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0x1076dc0, for file /home/dxr/dxr/dxr/build.py, line 63, in index_and_deploy_tree (tree=<TreeConfig(_section={'ignore_filenames': ['.hg', '.git', 'CVS', '.svn', '.bzr', '.deps', '.libs', '.DS_Store', '.nfs*', '*~', '._*'], 'build_command': 'cd $source_folder && ./mach clobber && make -f client.mk build MOZ_OBJDIR=$object_folder MOZ_MAKE_FLAGS="-s -j$jobs"', 'description': '', 'core': {}, 'enabled_plugins': [<Plugin(tree_to_index=<type at remote 0xfb3310>, file_to_skim=None, filters=[<type at remote 0xfc9b10>, <type at remote 0xfb2350>, <type at remote 0xfb1f60>, <type at remote 0xfb2f20>, <type at remote 0xfb1b70>, <type at remote 0xfb2b30>], analyzers={'tokenizer': {'trigram_tokenizer': {'max_gram': 3, 'type': 'nGram', 'min_gram': 3}}, 'analyzer': {'trigramalyzer': {'type': 'custom', 'tokenizer': 'trigram_tokenizer'}, 'lowercase': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'keyword'}, 'trigramalyzer_lower': {'filter': ['lowercase'], 'type': 'custom', 'tokenizer': 'trigram_tokenizer'}}}, r...(truncated), throwflag=0) at ../Python/ceval.c:2666 #130737 0x0000000000524b9a in PyEval_EvalCodeEx (co=0x7ffff46e7460, globals={'create_index_and_wait': <function at remote 0x7ffff46dfae0>, 'show_progress': <function at remote 0x7ffff4263b88>, 'save_scribbles': <function at remote 0x7ffff4263c30>, 'OrderedDict': <type at remote 0xbe5b70>, 'chain': <type at remote 0x8dd980>, 'FORMAT': '17', 'current_app': <LocalProxy at remote 0x7ffff4c7db28>, 'izip': <type at remote 0x8df360>, 'append_by_line': <function at remote 0x7ffff4975108>, 'IndexAlreadyExistsError': <type at remote 0xe4eb20>, 'datetime': <type at remote 0x7ffff5ef3820>, 'ElasticHttpNotFoundError': <type at remote 0xf15200>, 'filter_menu_items': <function at remote 0x7ffff444e648>, 'FILE': 'file', 'uuid1': <function at remote 0x7ffff530f1b0>, 'chunks': <function at remote 0x7ffff58d3108>, '_unignored_folders': <function at remote 0x7ffff4263d80>, 'LINE': 'line', 'dirname': <function at remote 0x7ffff7ef4258>, 'swap_alias': <function at remote 0x7ffff4263990>, '_fill_and_write_template': <function at remote 0x7ffff4265258>, 'index_file': <function at remote 0x7ffff4263f78>, 'UN...(truncated), locals=0x0, args=0xe09ad8, argcount=1, kws=0xe09ae0, kwcount=1, defs=0x7ffff424e328, defcount=1, closure=0x0) at ../Python/ceval.c:3252 #130738 0x000000000052799e in fast_function (func=<function at remote 0x7ffff42634f8>, pp_stack=0x7fffffffcb90, n=3, na=1, nk=1) at ../Python/ceval.c:4116 #130739 0x0000000000527588 in call_function (pp_stack=0x7fffffffcb90, oparg=257) at ../Python/ceval.c:4041 #130740 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0xe09920, for file /home/dxr/dxr/dxr/cli/index.py, line 26, in index (config=<Config(_section={'es_hosts': 'http://127.0.0.1:9200/', 'default_tree': 'mozilla-central', 'log_folder': '/code/dxr-logs-{tree}', 'es_alias': 'dxr_{format}_{tree}', 'es_catalog_index': 'dxr_catalog', 'workers': 0, 'max_thumbnail_size': 20000, 'es_indexing_timeout': 60, 'google_analytics_key': '', 'es_refresh_interval': 60, 'es_catalog_replicas': 1, 'generated_date': 'Mon, 08 Feb 2016 17:30:15 +0000', 'skip_stages': ['build'], 'www_root': '', 'temp_folder': '/code/dxr-temp-{tree}', 'es_index': 'dxr_{format}_{tree}_{unique}'}, trees=<OrderedDict(_OrderedDict__map={'mozilla-central': ['mozilla-central', [None, [...], [...]], [...]]}, _OrderedDict__end=[...]) at remote 0x7ffff3f145c0>) at remote 0x7ffff4387140>, verbose=False, tree_names=(), tree=<TreeConfig(_section={'ignore_filenames': ['.hg', '.git', 'CVS', '.svn', '.bzr', '.deps', '.libs', '.DS_Store', '.nfs*', '*~', '._*'], 'build_command': 'cd $source_folder && ./mach clobber...(truncated), throwflag=0) at ../Python/ceval.c:2666 #130741 0x0000000000524b9a in PyEval_EvalCodeEx (co=0x7ffff497b3b0, globals={'index': <Command(add_help_option=True, name='index', options_metavar='[OPTIONS]', callback=<function at remote 0x7ffff42654f8>, context_settings={}, params=[<Option(prompt=None, help='The configuration file', secondary_opts=[], hide_input=False, flag_value=False, confirmation_prompt=False, multiple=False, is_flag=False, metavar=None, allow_from_autoenv=True, type=<ConfigObject(writable=False, name='path', exists=True, resolve_path=False, readable=True, dir_okay=False, path_type='Path', file_okay=True) at remote 0x7ffff4924fb0>, is_bool_flag=False, expose_value=True, nargs=1, is_eager=False, count=False, name='config', default='dxr.config', required=False, callback=None, show_default=True, envvar=None, opts=['--config', '-c']) at remote 0x7ffff4260920>, <Option(prompt=None, help='Display the build logs during the build instead of only on error.', secondary_opts=[], hide_input=False, flag_value=True, confirmation_prompt=False, multiple=False, is_flag=True, metavar=None, allow_from_autoenv=True, type=<BoolPara...(truncated), locals=0x0, args=0x7ffff7fa6088, argcount=0, kws=0x7ffff3f10970, kwcount=3, defs=0x0, defcount=0, closure=0x0) at ../Python/ceval.c:3252 #130742 0x0000000000464f21 in function_call (func=<function at remote 0x7ffff42654f8>, arg=(), kw={'config': <Config(_section={'es_hosts': 'http://127.0.0.1:9200/', 'default_tree': 'mozilla-central', 'log_folder': '/code/dxr-logs-{tree}', 'es_alias': 'dxr_{format}_{tree}', 'es_catalog_index': 'dxr_catalog', 'workers': 0, 'max_thumbnail_size': 20000, 'es_indexing_timeout': 60, 'google_analytics_key': '', 'es_refresh_interval': 60, 'es_catalog_replicas': 1, 'generated_date': 'Mon, 08 Feb 2016 17:30:15 +0000', 'skip_stages': ['build'], 'www_root': '', 'temp_folder': '/code/dxr-temp-{tree}', 'es_index': 'dxr_{format}_{tree}_{unique}'}, trees=<OrderedDict(_OrderedDict__map={'mozilla-central': ['mozilla-central', [None, [...], [...]], [...]]}, _OrderedDict__end=[...]) at remote 0x7ffff3f145c0>) at remote 0x7ffff4387140>, 'verbose': False, 'tree_names': ()}) at ../Objects/funcobject.c:526 #130743 0x000000000042778d in PyObject_Call (func=<function at remote 0x7ffff42654f8>, arg=(), kw={'config': <Config(_section={'es_hosts': 'http://127.0.0.1:9200/', 'default_tree': 'mozilla-central', 'log_folder': '/code/dxr-logs-{tree}', 'es_alias': 'dxr_{format}_{tree}', 'es_catalog_index': 'dxr_catalog', 'workers': 0, 'max_thumbnail_size': 20000, 'es_indexing_timeout': 60, 'google_analytics_key': '', 'es_refresh_interval': 60, 'es_catalog_replicas': 1, 'generated_date': 'Mon, 08 Feb 2016 17:30:15 +0000', 'skip_stages': ['build'], 'www_root': '', 'temp_folder': '/code/dxr-temp-{tree}', 'es_index': 'dxr_{format}_{tree}_{unique}'}, trees=<OrderedDict(_OrderedDict__map={'mozilla-central': ['mozilla-central', [None, [...], [...]], [...]]}, _OrderedDict__end=[...]) at remote 0x7ffff3f145c0>) at remote 0x7ffff4387140>, 'verbose': False, 'tree_names': ()}) at ../Objects/abstract.c:2529 #130744 0x0000000000528869 in ext_do_call (func=<function at remote 0x7ffff42654f8>, pp_stack=0x7fffffffd070, flags=3, na=0, nk=0) at ../Python/ceval.c:4333 #130745 0x000000000052259a in PyEval_EvalFrameEx ( f=Frame 0xa31170, for file /code/dbg-venv/local/lib/python2.7/site-packages/click/core.py, line 464, in invoke (args=(), kwargs={'config': <Config(_section={'es_hosts': 'http://127.0.0.1:9200/', 'default_tree': 'mozilla-central', 'log_folder': '/code/dxr-logs-{tree}', 'es_alias': 'dxr_{format}_{tree}', 'es_catalog_index': 'dxr_catalog', 'workers': 0, 'max_thumbnail_size': 20000, 'es_indexing_timeout': 60, 'google_analytics_key': '', 'es_refresh_interval': 60, 'es_catalog_replicas': 1, 'generated_date': 'Mon, 08 Feb 2016 17:30:15 +0000', 'skip_stages': ['build'], 'www_root': '', 'temp_folder': '/code/dxr-temp-{tree}', 'es_index': 'dxr_{format}_{tree}_{unique}'}, trees=<OrderedDict(_OrderedDict__map={'mozilla-central': ['mozilla-central', [None, [...], [...]], [...]]}, _OrderedDict__end=[...]) at remote 0x7ffff3f145c0>) at remote 0x7ffff4387140>, 'verbose': False, 'tree_names': ()}, self=<Context(_depth=2, token_normalize_func=None, default_map=None, obj=None, parent=<Context(_depth=2, token_normalize_func=None, ...(truncated), throwflag=0) at ../Python/ceval.c:2705 #130746 0x0000000000524b9a in PyEval_EvalCodeEx (co=0x7ffff6b3e460, globals={'join_options': <function at remote 0x7ffff5c54300>, 'prompt': <function at remote 0x7ffff5c40798>, 'UsageError': <type at remote 0xbcf890>, 'contextmanager': <function at remote 0x7ffff5c7f5a0>, 'PY2': True, 'iteritems': <function at remote 0x7ffff5c1c6f0>, 'echo': <function at remote 0x7ffff5c326f0>, 'isidentifier': <function at remote 0x7ffff5c30060>, 'HelpFormatter': <type at remote 0xbdd740>, 'Group': <type at remote 0xb9d9a0>, 'SUBCOMMAND_METAVAR': 'COMMAND [ARGS]...', 'iter_params_for_processing': <function at remote 0x7ffff5c57060>, 'group': <function at remote 0x7ffff5bc3ed0>, 'Option': <type at remote 0xbe3670>, 'confirm': <function at remote 0x7ffff5c408e8>, 'Parameter': <type at remote 0xb9e7e0>, 'BaseCommand': <type at remote 0xbde250>, '__package__': 'click', 'augment_usage_errors': <function at remote 0x7ffff5c54f78>, 'command': <function at remote 0x7ffff5bc3e28>, 'ClickException': <type at remote 0xbd5a50>, 'OptionParser': <type at remote 0xbe22d0>, '_bashcomplete': <function at remote 0x7ff...(truncated), locals=0x0, args=0x7ffff43becb8, argcount=2, kws=0x7ffff41eda08, kwcount=3, defs=0x0, defcount=0, closure=0x0) at ../Python/ceval.c:3252 #130747 0x0000000000464f21 in function_call (func=<function at remote 0x7ffff5c57d80>, arg=(<Context(_depth=2, token_normalize_func=None, default_map=None, obj=None, parent=<Context(_depth=2, token_normalize_func=None, default_map=None, obj=None, parent=None, allow_interspersed_args=False, max_content_width=None, ignore_unknown_options=False, args=['index'], allow_extra_args=True, info_name='dxr', invoked_subcommand=u'index', color=None, params={}, help_option_names=['--help'], command=<Group(invoke_without_command=False, commands={'index': <Command(add_help_option=True, name='index', options_metavar='[OPTIONS]', callback=<function at remote 0x7ffff42654f8>, context_settings={}, params=[<Option(prompt=None, help='The configuration file', secondary_opts=[], hide_input=False, flag_value=False, confirmation_prompt=False, multiple=False, is_flag=False, metavar=None, allow_from_autoenv=True, type=<ConfigObject(writable=False, name='path', exists=True, resolve_path=False, readable=True, dir_okay=False, path_type='Path', file_okay=True) at remote 0x7ffff4924fb0>, is_bool_flag=False, expose_value=True, nar...(truncated), kw={'config': <Config(_section={'es_hosts': 'http://127.0.0.1:9200/', 'default_tree': 'mozilla-central', 'log_folder': '/code/dxr-logs-{tree}', 'es_alias': 'dxr_{format}_{tree}', 'es_catalog_index': 'dxr_catalog', 'workers': 0, 'max_thumbnail_size': 20000, 'es_indexing_timeout': 60, 'google_analytics_key': '', 'es_refresh_interval': 60, 'es_catalog_replicas': 1, 'generated_date': 'Mon, 08 Feb 2016 17:30:15 +0000', 'skip_stages': ['build'], 'www_root': '', 'temp_folder': '/code/dxr-temp-{tree}', 'es_index': 'dxr_{format}_{tree}_{unique}'}, trees=<OrderedDict(_OrderedDict__map={'mozilla-central': ['mozilla-central', [None, [...], [...]], [...]]}, _OrderedDict__end=[...]) at remote 0x7ffff3f145c0>) at remote 0x7ffff4387140>, 'verbose': False, 'tree_names': ()}) at ../Objects/funcobject.c:526 #130748 0x000000000042778d in PyObject_Call (func=<function at remote 0x7ffff5c57d80>, arg=(<Context(_depth=2, token_normalize_func=None, default_map=None, obj=None, parent=<Context(_depth=2, token_normalize_func=None, default_map=None, obj=None, parent=None, allow_interspersed_args=False, max_content_width=None, ignore_unknown_options=False, args=['index'], allow_extra_args=True, info_name='dxr', invoked_subcommand=u'index', color=None, params={}, help_option_names=['--help'], command=<Group(invoke_without_command=False, commands={'index': <Command(add_help_option=True, name='index', options_metavar='[OPTIONS]', callback=<function at remote 0x7ffff42654f8>, context_settings={}, params=[<Option(prompt=None, help='The configuration file', secondary_opts=[], hide_input=False, flag_value=False, confirmation_prompt=False, multiple=False, is_flag=False, metavar=None, allow_from_autoenv=True, type=<ConfigObject(writable=False, name='path', exists=True, resolve_path=False, readable=True, dir_okay=False, path_type='Path', file_okay=True) at remote 0x7ffff4924fb0>, is_bool_flag=False, expose_value=True, nar...(truncated), kw={'config': <Config(_section={'es_hosts': 'http://127.0.0.1:9200/', 'default_tree': 'mozilla-central', 'log_folder': '/code/dxr-logs-{tree}', 'es_alias': 'dxr_{format}_{tree}', 'es_catalog_index': 'dxr_catalog', 'workers': 0, 'max_thumbnail_size': 20000, 'es_indexing_timeout': 60, 'google_analytics_key': '', 'es_refresh_interval': 60, 'es_catalog_replicas': 1, 'generated_date': 'Mon, 08 Feb 2016 17:30:15 +0000', 'skip_stages': ['build'], 'www_root': '', 'temp_folder': '/code/dxr-temp-{tree}', 'es_index': 'dxr_{format}_{tree}_{unique}'}, trees=<OrderedDict(_OrderedDict__map={'mozilla-central': ['mozilla-central', [None, [...], [...]], [...]]}, _OrderedDict__end=[...]) at remote 0x7ffff3f145c0>) at remote 0x7ffff4387140>, 'verbose': False, 'tree_names': ()}) at ../Objects/abstract.c:2529 #130749 0x0000000000528869 in ext_do_call (func=<function at remote 0x7ffff5c57d80>, pp_stack=0x7fffffffd550, flags=2, na=2, nk=0) at ../Python/ceval.c:4333 #130750 0x000000000052259a in PyEval_EvalFrameEx ( f=Frame 0x7ffff438a450, for file /code/dbg-venv/local/lib/python2.7/site-packages/click/core.py, line 837, in invoke (self=<Command(add_help_option=True, name='index', options_metavar='[OPTIONS]', callback=<function at remote 0x7ffff42654f8>, context_settings={}, params=[<Option(prompt=None, help='The configuration file', secondary_opts=[], hide_input=False, flag_value=False, confirmation_prompt=False, multiple=False, is_flag=False, metavar=None, allow_from_autoenv=True, type=<ConfigObject(writable=False, name='path', exists=True, resolve_path=False, readable=True, dir_okay=False, path_type='Path', file_okay=True) at remote 0x7ffff4924fb0>, is_bool_flag=False, expose_value=True, nargs=1, is_eager=False, count=False, name='config', default='dxr.config', required=False, callback=None, show_default=True, envvar=None, opts=['--config', '-c']) at remote 0x7ffff4260920>, <Option(prompt=None, help='Display the build logs during the build instead of only on error.', secondary_opts=[], hide_input=False, flag_value=True,...(truncated), throwflag=0) at ../Python/ceval.c:2705 #130751 0x000000000052787d in fast_function (func=<function at remote 0x7ffff5c58e28>, pp_stack=0x7fffffffd880, n=2, na=2, nk=0) at ../Python/ceval.c:4106 #130752 0x0000000000527588 in call_function (pp_stack=0x7fffffffd880, oparg=1) at ../Python/ceval.c:4041 #130753 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0xc76760, for file /code/dbg-venv/local/lib/python2.7/site-packages/click/core.py, line 991, in invoke (self=<Group(invoke_without_command=False, commands={'index': <Command(add_help_option=True, name='index', options_metavar='[OPTIONS]', callback=<function at remote 0x7ffff42654f8>, context_settings={}, params=[<Option(prompt=None, help='The configuration file', secondary_opts=[], hide_input=False, flag_value=False, confirmation_prompt=False, multiple=False, is_flag=False, metavar=None, allow_from_autoenv=True, type=<ConfigObject(writable=False, name='path', exists=True, resolve_path=False, readable=True, dir_okay=False, path_type='Path', file_okay=True) at remote 0x7ffff4924fb0>, is_bool_flag=False, expose_value=True, nargs=1, is_eager=False, count=False, name='config', default='dxr.config', required=False, callback=None, show_default=True, envvar=None, opts=['--config', '-c']) at remote 0x7ffff4260920>, <Option(prompt=None, help='Display the build logs during the build instead of only on error.', sec...(truncated), throwflag=0) at ../Python/ceval.c:2666 #130754 0x0000000000524b9a in PyEval_EvalCodeEx (co=0x7ffff5c7d300, globals={'join_options': <function at remote 0x7ffff5c54300>, 'prompt': <function at remote 0x7ffff5c40798>, 'UsageError': <type at remote 0xbcf890>, 'contextmanager': <function at remote 0x7ffff5c7f5a0>, 'PY2': True, 'iteritems': <function at remote 0x7ffff5c1c6f0>, 'echo': <function at remote 0x7ffff5c326f0>, 'isidentifier': <function at remote 0x7ffff5c30060>, 'HelpFormatter': <type at remote 0xbdd740>, 'Group': <type at remote 0xb9d9a0>, 'SUBCOMMAND_METAVAR': 'COMMAND [ARGS]...', 'iter_params_for_processing': <function at remote 0x7ffff5c57060>, 'group': <function at remote 0x7ffff5bc3ed0>, 'Option': <type at remote 0xbe3670>, 'confirm': <function at remote 0x7ffff5c408e8>, 'Parameter': <type at remote 0xb9e7e0>, 'BaseCommand': <type at remote 0xbde250>, '__package__': 'click', 'augment_usage_errors': <function at remote 0x7ffff5c54f78>, 'command': <function at remote 0x7ffff5bc3e28>, 'ClickException': <type at remote 0xbd5a50>, 'OptionParser': <type at remote 0xbe22d0>, '_bashcomplete': <function at remote 0x7ff...(truncated), locals=0x0, args=0xf53870, argcount=2, kws=0xf53880, kwcount=0, defs=0x0, defcount=0, closure=0x0) at ../Python/ceval.c:3252 #130755 0x000000000052799e in fast_function (func=<function at remote 0x7ffff5c59300>, pp_stack=0x7fffffffdd20, n=2, na=2, nk=0) at ../Python/ceval.c:4116 #130756 0x0000000000527588 in call_function (pp_stack=0x7fffffffdd20, oparg=1) at ../Python/ceval.c:4041 #130757 0x00000000005222e1 in PyEval_EvalFrameEx ( f=Frame 0xf536d0, for file /home/dxr/dxr/dxr/cli/__init__.py, line 29, in main (ctx=<Context(_depth=2, token_normalize_func=None, default_map=None, obj=None, parent=None, allow_interspersed_args=False, max_content_width=None, ignore_unknown_options=False, args=['index'], allow_extra_args=True, info_name='dxr', invoked_subcommand=u'index', color=None, params={}, help_option_names=['--help'], command=<Group(invoke_without_command=False, commands={'index': <Command(add_help_option=True, name='index', options_metavar='[OPTIONS]', callback=<function at remote 0x7ffff42654f8>, context_settings={}, params=[<Option(prompt=None, help='The configuration file', secondary_opts=[], hide_input=False, flag_value=False, confirmation_prompt=False, multiple=False, is_flag=False, metavar=None, allow_from_autoenv=True, type=<ConfigObject(writable=False, name='path', exists=True, resolve_path=False, readable=True, dir_okay=False, path_type='Path', file_okay=True) at remote 0x7ffff4924fb0>, is_bool_flag=False, expose_value=True, nar...(truncated), throwflag=0) at ../Python/ceval.c:2666 #130758 0x000000000052787d in fast_function (func=<function at remote 0x7ffff4380060>, pp_stack=0x7fffffffe050, n=0, na=0, nk=0) at ../Python/ceval.c:4106 #130759 0x0000000000527588 in call_function (pp_stack=0x7fffffffe050, oparg=0) at ../Python/ceval.c:4041 #130760 0x00000000005222e1 in PyEval_EvalFrameEx (f=Frame 0x7ffff7e8fa38, for file dbg-venv/bin/dxr, line 9, in <module> (), throwflag=0) at ../Python/ceval.c:2666 #130761 0x0000000000524b9a in PyEval_EvalCodeEx (co=0x7ffff7f2c3b0, globals={'__builtins__': <module at remote 0x7ffff7f674d8>, '__file__': 'dbg-venv/bin/dxr', '__package__': None, 'sys': <module at remote 0x7ffff7f67610>, '__requires__': 'dxr==2.0', 'load_entry_point': <function at remote 0x7ffff6dbba38>, '__name__': '__main__', '__doc__': None}, locals={'__builtins__': <module at remote 0x7ffff7f674d8>, '__file__': 'dbg-venv/bin/dxr', '__package__': None, 'sys': <module at remote 0x7ffff7f67610>, '__requires__': 'dxr==2.0', 'load_entry_point': <function at remote 0x7ffff6dbba38>, '__name__': '__main__', '__doc__': None}, args=0x0, argcount=0, kws=0x0, kwcount=0, defs=0x0, defcount=0, closure=0x0) at ../Python/ceval.c:3252 #130762 0x000000000051ad3f in PyEval_EvalCode (co=0x7ffff7f2c3b0, globals={'__builtins__': <module at remote 0x7ffff7f674d8>, '__file__': 'dbg-venv/bin/dxr', '__package__': None, 'sys': <module at remote 0x7ffff7f67610>, '__requires__': 'dxr==2.0', 'load_entry_point': <function at remote 0x7ffff6dbba38>, '__name__': '__main__', '__doc__': None}, locals={'__builtins__': <module at remote 0x7ffff7f674d8>, '__file__': 'dbg-venv/bin/dxr', '__package__': None, 'sys': <module at remote 0x7ffff7f67610>, '__requires__': 'dxr==2.0', 'load_entry_point': <function at remote 0x7ffff6dbba38>, '__name__': '__main__', '__doc__': None}) at ../Python/ceval.c:667 #130763 0x00000000005572ad in run_mod (mod=0x9e3d38, filename=0x7fffffffe964 "dbg-venv/bin/dxr", globals={'__builtins__': <module at remote 0x7ffff7f674d8>, '__file__': 'dbg-venv/bin/dxr', '__package__': None, 'sys': <module at remote 0x7ffff7f67610>, '__requires__': 'dxr==2.0', 'load_entry_point': <function at remote 0x7ffff6dbba38>, '__name__': '__main__', '__doc__': None}, locals={'__builtins__': <module at remote 0x7ffff7f674d8>, '__file__': 'dbg-venv/bin/dxr', '__package__': None, 'sys': <module at remote 0x7ffff7f67610>, '__requires__': 'dxr==2.0', 'load_entry_point': <function at remote 0x7ffff6dbba38>, '__name__': '__main__', '__doc__': None}, flags=0x7fffffffe540, arena=0x9ebf60) at ../Python/pythonrun.c:1370 #130764 0x0000000000557233 in PyRun_FileExFlags (fp=0xa29c20, filename=0x7fffffffe964 "dbg-venv/bin/dxr", start=257, globals={'__builtins__': <module at remote 0x7ffff7f674d8>, '__file__': 'dbg-venv/bin/dxr', '__package__': None, 'sys': <module at remote 0x7ffff7f67610>, '__requires__': 'dxr==2.0', 'load_entry_point': <function at remote 0x7ffff6dbba38>, '__name__': '__main__', '__doc__': None}, locals={'__builtins__': <module at remote 0x7ffff7f674d8>, '__file__': 'dbg-venv/bin/dxr', '__package__': None, 'sys': <module at remote 0x7ffff7f67610>, '__requires__': 'dxr==2.0', 'load_entry_point': <function at remote 0x7ffff6dbba38>, '__name__': '__main__', '__doc__': None}, closeit=1, flags=0x7fffffffe540) at ../Python/pythonrun.c:1356 #130765 0x0000000000555a13 in PyRun_SimpleFileExFlags (fp=0xa29c20, filename=0x7fffffffe964 "dbg-venv/bin/dxr", closeit=1, flags=0x7fffffffe540) at ../Python/pythonrun.c:948 #130766 0x00000000005550a1 in PyRun_AnyFileExFlags (fp=0xa29c20, filename=0x7fffffffe964 "dbg-venv/bin/dxr", closeit=1, flags=0x7fffffffe540) at ../Python/pythonrun.c:752 #130767 0x0000000000570dc1 in Py_Main (argc=3, argv=0x7fffffffe758) at ../Modules/main.c:640 #130768 0x0000000000417fbd in main (argc=3, argv=0x7fffffffe758) at ../Modules/python.c:23
An overflow looks very likely: (gdb) info frame 130768 Stack frame at 0x7fffffffe680: rip = 0x417fbd in main (../Modules/python.c:23); saved rip = 0x7ffff6ef2ec5 caller of frame at 0x7fffffffe660 source language c. Arglist at 0x7fffffffe670, args: argc=3, argv=0x7fffffffe758 Locals at 0x7fffffffe670, Previous frame's sp is 0x7fffffffe680 Saved registers: rbp at 0x7fffffffe670, rip at 0x7fffffffe678 (gdb) info frame 0 Stack frame at 0x7fffff7ff010: rip = 0x7ffff6f53754 in __GI___libc_malloc (malloc.c:2876); saved rip = 0x48ee00 called by frame at 0x7fffff7ff050 source language c. Arglist at 0x7fffff7ff000, args: bytes=528 Locals at 0x7fffff7ff000, Previous frame's sp is 0x7fffff7ff010 Saved registers: rbp at 0x7fffff7ff000, rip at 0x7fffff7ff008 7fffffffe680 - 7fffff7ff010 = 7ff670 = 8386160 bytes = 7.99767 MB $ ulimit -s 8192 7.99767 is suspiciously close to the stack size limit. Kaboom.
Raising the stack limit to 32768 just makes it take longer (maybe 45min vs. 15min) to crash. So clearly this stack use is unreasonable. Let's attack the root of the problem, seeing why we have such deep stacks.
Deep nestings of itertools primitives results in deep recursion without the interposition of the interpreter, thus dodging its recursion depth checking (and delivering itertools' speed). Similar bugs filed against CPython include https://bugs.python.org/issue14507, https://bugs.python.org/issue14010, and https://bugs.python.org/issue24606.
The trigger is a cycle in moz-central's inheritance graph. In _nonunique_needles_from_graph()... (Pdb) print graph['IPC::ParamTraits'] [('IPC::ParamTraits', 'ParamTraits')] That shouldn't happen. The chain itself may or may not itself be a problem.
I'm pretty sure the compiler plugin is emitting cycles, which isn't right. But for now, I've added detection of cycles to _walk_graph() (and moved detection of dupes up into it, since it happens as a natural matter of course). Got through an entire moz-central index, workers=0, which took 9 hours. The chain() calls didn't survive, since they no longer fit with the imperative style needed to keep track of the seen set.
Commit pushed to master at https://github.com/mozilla/dxr https://github.com/mozilla/dxr/commit/04507c86cb51b836da1a9b2366687587c9d56915 Fix a segfault during clang CSV ingestion. Fixes bug 1246700. It was triggered by the compiler plugin emitting cycles and then manifested as a segfault rather than a RuntimeError because we were nesting itertools.chain() so deeply. For now (since moz-central is a week behind), I've simply added detection of cycles to _walk_graph()--and moved detection of dupes up into it, since it happens as a natural matter of course. Ehsan has expressed interest in moving the full inheritance computation to the compiler plugin in the longer term. Got through an entire moz-central index with workers=0. The chain() calls didn't survive, since they no longer fit with the imperative style needed to keep track of the seen set. It would be interesting to see if this is faster (since it prunes the graph traversal earlier) or slower (since it spends more time in the interpreter) than the old impl.
Status: NEW → RESOLVED
Closed: 10 years ago
Resolution: --- → FIXED
Product: Webtools → Webtools Graveyard
You need to log in before you can comment on or make changes to this bug.