1433752 - dxr.mozilla.org out of date [No space left on device]

Status: RESOLVED FIXED

(Webtools Graveyard :: DXR, defect)

Description

[Sebastian Hengst [:aryx] (needinfo me if it's about an intermittent or backout)]

"This page was generated by DXR 2018-1-24 22:37." is in the footer at https://dxr.mozilla.org/mozilla-central/source/

From the log:

20:48:07 A worker failed while indexing /home/jenkins/src/mozilla-central/dom/base/nsINode.cpp:
20:48:07 Traceback (most recent call last):
20:48:07   File "/home/jenkins/dxr/dxr/build.py", line 577, in index_chunk
20:48:07     index_file(tree, tree_indexers, path, es, index)
20:48:07   File "/home/jenkins/dxr/dxr/build.py", line 548, in index_file
20:48:07     es.bulk(chunk, index=index, doc_type=LINE)
20:48:07   File "/home/jenkins/venv/local/lib/python2.7/site-packages/pyelasticsearch/client.py", line 93, in decorate
20:48:07     return func(*args, query_params=query_params, **kwargs)
20:48:07   File "/home/jenkins/venv/local/lib/python2.7/site-packages/pyelasticsearch/client.py", line 460, in bulk
20:48:07     raise BulkError(errors, successes)
20:48:07 BulkError: ([{u'create': {u'status': 500, u'_type': u'line', u'_id': u'AWEul3FuvJjeH6k2O8aZ', u'error': u'CreateFailedEngineException[[dxr_hot_19_mozilla-central_247c5714-01cc-11e8-83e9-0242ac110675][3] Create failed for [line#AWEul3FuvJjeH6k2O8aZ]]; nested: IOException[No space left on device]; ', u'_index': u'dxr_hot_19_mozilla-central_247c5714-01cc-11e8-83e9-0242ac110675'}}], [{u'create': {u'status': 201, u'_type': u'line', u'_id': u'AWEul3FuvJjeH6k2O8aW', u'_version': 1, u'_index': u'dxr_hot_19_mozilla-central_247c5714-01cc-11e8-83e9-0242ac110675'}}, {u'create': {u'status': 201, u'_type': u'line', u'_id': u'AWEul3FuvJjeH6k2O8aX', u'_version': 1, u'_index': u'dxr_hot_19_mozilla-central_247c5714-01cc-11e8-83e9-0242ac110675'}}, {u'create': {u'status': 201, u'_type': u'line', u'_id': u'AWEul3FuvJjeH6k2O8aY', u'_version': 1, u'_index': u'dxr_hot_19_mozilla-central_247c5714-01cc-11e8-83e9-0242ac110675'}}, {u'create': {u'status': 201, u'_type': u'line', u'_id': u'AWEul3FuvJjeH6k2O8aa', u'_version': 1, u'_index': u'dxr_hot_19_mozilla-central_247c5714-01cc-11e8-83e9-0242ac110675'}}, {u'create': {u'status': 201, u'_type': u'line', u'_id': u'AWEul3FuvJjeH6k2O8ab', u'_version': 1, u'_index': u'dxr_hot_19_mozilla-central_247c5714-01cc-11e8-83e9-0242ac110675'}}, {u'create': {u'status': 201, u'_type': u'line', u'_id': u'AWEul3FuvJjeH6k2O8ac', u'_version': 1, u'_index': u'dxr_hot_19_mozilla-central_247c5714-01cc-11e8-83e9-0242ac110675'}}, {u'create': {u'status': 201, u'_type': u'line', u'_id': u'AWEul3FuvJjeH6k2O8ad', u'_version': 1, u'_index': u'dxr_hot_19_mozilla-central_247c5714-01cc-11e8-83e9-0242ac110675'}}])

Comment 1

[Kendall Libby [:fubar] (he/him)]

This is my bad; I was trying to get the ES cluster back to a happy state on Friday, disabled all of the indexing nodes, and then forgot to re-enable. An m-c run should kick off in a few minutes.

Comment 2

[Kendall Libby [:fubar] (he/him)]

finished yesterday afternoon..