972037 - Elastic search error with new crashstorage.py for processed_crash

Status: RESOLVED FIXED

(Socorro :: Backend, task)

Description

[Selena Deckelmann :selenamarie :selena]

This turned up once the new external/postgresql/crashstorage.py hit stage: 

Traceback (most recent call last):
  File "/data/socorro/application/socorro/lib/threaded_task_manager.py", line 336, in run
    function(*args, **kwargs)  # execute the task
  File "/data/socorro/application/socorro/processor/processor_app.py", line 166, in transform
    crash_id
  File "/data/socorro/application/socorro/external/crashstorage_base.py", line 465, in save_raw_and_processed
    crash_id
  File "/data/socorro/application/socorro/external/elasticsearch/crashstorage.py", line 136, in save_raw_and_processed
    crash_document
  File "/data/socorro/application/socorro/database/transaction_executor.py", line 104, in __call__
    result = function(connection, *args, **kwargs)
  File "/data/socorro/application/socorro/external/elasticsearch/crashstorage.py", line 170, in _submit_crash_to_elasticsearch
    replication='async'
  File "/data/socorro/socorro-virtualenv/lib/python2.6/site-packages/pyelasticsearch/client.py", line 96, in decorate
    return func(*args, query_params=query_params, **kwargs)
  File "/data/socorro/socorro-virtualenv/lib/python2.6/site-packages/pyelasticsearch/client.py", line 344, in index
    query_params)
  File "/data/socorro/socorro-virtualenv/lib/python2.6/site-packages/pyelasticsearch/client.py", line 254, in send_request
    self._raise_exception(resp, prepped_response)
  File "/data/socorro/socorro-virtualenv/lib/python2.6/site-packages/pyelasticsearch/client.py", line 269, in _raise_exception
    raise error_class(response.status_code, error_message)
ElasticHttpError: (500, u'RemoteTransportException[Failed to deserialize exception response from stream]; nested: TransportSerializationException[Failed to deserialize exception response from stream]; nested: EOFException; ')

Comment 1

[K Lars Lohn [:lars] [:klohn]]

changed to PG not replacing datetime instances with strings.  HB code ought to do the same thing.

Comment 2

[[github robot]]

Commit pushed to master at https://github.com/mozilla/socorro

https://github.com/mozilla/socorro/commit/1c26d0c7b5341e7efb2d5569669413e2cc0c0245
Merge pull request #1883 from selenamarie/bug972037-es-error-cuz-json-transform

Bug972037 ElasticSearch error because of destructive JSON transform

Comment 3

[Selena Deckelmann :selenamarie :selena]

Caused another bug: 

Traceback (most recent call last):
  File "/data/socorro/application/socorro/lib/threaded_task_manager.py", line 336, in run
    function(*args, **kwargs)  # execute the task
  File "/data/socorro/application/socorro/processor/processor_app.py", line 166, in transform
    crash_id
  File "/data/socorro/application/socorro/external/crashstorage_base.py", line 465, in save_raw_and_processed
    crash_id
  File "/data/socorro/application/socorro/external/hb/crashstorage.py", line 340, in save_raw_and_processed
    self.save_processed(processed_crash)
  File "/data/socorro/application/socorro/external/hb/crashstorage.py", line 330, in save_processed
    return transaction()
  File "/data/socorro/application/socorro/external/hb/crashstorage.py", line 104, in <lambda>
    return lambda: self.transaction(lambda conn_ctx: f(conn_ctx.client))
  File "/data/socorro/application/socorro/database/transaction_executor.py", line 104, in __call__
    result = function(connection, *args, **kwargs)
  File "/data/socorro/application/socorro/external/hb/crashstorage.py", line 104, in <lambda>
    return lambda: self.transaction(lambda conn_ctx: f(conn_ctx.client))
  File "/data/socorro/application/socorro/external/hb/crashstorage.py", line 310, in transaction
    + 1
TypeError: object of type 'datetime.datetime' has no len()