1155702 - publish-resultset KeyError exceptions in _merge_result_set_details()

Status: RESOLVED WORKSFORME

(Tree Management :: Treeherder: Infrastructure, defect, P3)

Description

[Ed Morley [:emorley]]

eg:
https://rpm.newrelic.com/accounts/677903/applications/5585473/traced_errors/3601293082/similar_errors?original_error_id=3601293082

Traceback (most recent call last):
File "/usr/lib64/python2.7/site-packages/newrelic-2.44.0.36/newrelic/hooks/application_celery.py", line 66, in wrapper return wrapped(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 437, in __protected_call__ return self.run(*args, **kwargs)
File "/data/www/treeherder.allizom.org/treeherder-service/treeherder/model/tasks.py", line 145, in publish_resultset for entry in jm.get_result_set_list_by_ids(ids):
File "/data/www/treeherder.allizom.org/treeherder-service/treeherder/model/derived/jobs.py", line 989, in get_result_set_list_by_ids result_set_ids, aggregate_details, True)
File "/data/www/treeherder.allizom.org/treeherder-service/treeherder/model/derived/jobs.py", line 1034, in _merge_result_set_details detail = aggregate_details[result['id']][0]
KeyError: 1261L

Comment 1

[Ed Morley [:emorley]]

Still occurring, eg:

[2015-08-20 11:55:46,641: ERROR/MainProcess] Task publish-resultset[adcb74a2-16b3-4577-870b-b65d906bd919] raised unexpected: KeyError(875L,)
Traceback (most recent call last):
  File "/data/www/treeherder.allizom.org/venv/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task
    R = retval = fun(*args, **kwargs)
  File "/data/www/treeherder.allizom.org/venv/lib/python2.7/site-packages/newrelic-2.52.0.40/newrelic/hooks/application_celery.py", line 66, in wrapper
    return wrapped(*args, **kwargs)
  File "/data/www/treeherder.allizom.org/venv/lib/python2.7/site-packages/celery/app/trace.py", line 438, in __protected_call__
    return self.run(*args, **kwargs)
  File "/data/www/treeherder.allizom.org/treeherder-service/treeherder/model/tasks.py", line 138, in publish_resultset
    for entry in jm.get_result_set_list_by_ids(ids):
  File "/data/www/treeherder.allizom.org/treeherder-service/treeherder/model/derived/jobs.py", line 842, in get_result_set_list_by_ids
    result_set_ids, aggregate_details, True)
  File "/data/www/treeherder.allizom.org/treeherder-service/treeherder/model/derived/jobs.py", line 887, in _merge_result_set_details
    detail = aggregate_details[result['id']][0]
KeyError: 875L

Comment 2

[Ed Morley [:emorley]]

This is still occurring, eg:
https://rpm.newrelic.com/accounts/677903/applications/5585473/traced_errors/5c731e-4f836ebd-da46-11e5-a1e3-b82a72d22a14