984586 - Missing Elastic Search index in stage?

Status: RESOLVED FIXED

(Socorro :: General, task)

Description

[Selena Deckelmann :selenamarie :selena]

This error is popping up on stage: 

2014-03-17 14:00:06,707 DEBUG  - MainThread - error when running <class 'socorro.cron.jobs.automatic_emails.AutomaticEmailsCronApp'> on None
Traceback (most recent call last):
  File "/data/socorro/application/socorro/cron/crontabber.py", line 942, in _run_one
    for last_success in self._run_job(job_class, config, info):
  File "/data/socorro/application/socorro/cron/base.py", line 199, in main
    function(when)
  File "/data/socorro/application/socorro/cron/base.py", line 208, in _run_proxy
    return self.run(*args, **kwargs)
  File "/data/socorro/application/socorro/cron/jobs/automatic_emails.py", line 226, in run
    count = search.count()  # Total number of results.
  File "/data/socorro/socorro-virtualenv/lib/python2.6/site-packages/elasticutils/__init__.py", line 1306, in count
    return self[:0].raw()['hits']['total']
  File "/data/socorro/socorro-virtualenv/lib/python2.6/site-packages/elasticutils/__init__.py", line 1286, in raw
    doc_type=self.get_doctypes())
  File "/data/socorro/socorro-virtualenv/lib/python2.6/site-packages/pyelasticsearch/client.py", line 96, in decorate
    return func(*args, query_params=query_params, **kwargs)
  File "/data/socorro/socorro-virtualenv/lib/python2.6/site-packages/pyelasticsearch/client.py", line 590, in search
    return self._search_or_count('_search', query, **kwargs)
  File "/data/socorro/socorro-virtualenv/lib/python2.6/site-packages/pyelasticsearch/client.py", line 567, in _search_or_count
    query_params=query_params)
  File "/data/socorro/socorro-virtualenv/lib/python2.6/site-packages/pyelasticsearch/client.py", line 254, in send_request
    self._raise_exception(resp, prepped_response)
  File "/data/socorro/socorro-virtualenv/lib/python2.6/site-packages/pyelasticsearch/client.py", line 269, in _raise_exception
    raise error_class(response.status_code, error_message)
ElasticHttpNotFoundError: (404, u'IndexMissingException[[socorro201411] missing]')

Comment 1

[Selena Deckelmann :selenamarie :selena]

From :adrian, this was caused by crashes not being inserted into the ES index for a while. The problem correct itself after stage recovered from the hung postgres database. 

No errors this morning.