Search Unavailable error in Compatibility Reports page

REOPENED
Unassigned

Status

addons.mozilla.org Graveyard
Compatibility Tools
--
critical
REOPENED
3 years ago
2 years ago

People

(Reporter: jorgev, Unassigned)

Tracking

unspecified
2015-03

Details

(URL)

(Reporter)

Description

3 years ago
I filed bug 1137864 to get Firefox 36 to show up as an option in the compatibility reports page (https://addons.mozilla.org/en-US/admin/compat). Jason ran update_product_details to fix this, but after doing so the page started showing a Search Unavailable error.
Traceback for those that don't have access to New Relic:

Traceback (most recent call last):
File "/data/mkt.prod/www/addons.mozilla.org/current/venv/lib/python2.6/site-packages/newrelic-2.20.1.18/newrelic/hooks/framework_django.py", line 492, in wrapper return wrapped(*args, **kwargs)
File "/data/mkt.prod/www/addons.mozilla.org/deploy-olympia-prod-20150227204024-fd03eba6d6/olympia/apps/amo/decorators.py", line 32, in wrapper return func(request, *args, **kw)
File "/data/mkt.prod/www/addons.mozilla.org/deploy-olympia-prod-20150227204024-fd03eba6d6/olympia/apps/zadmin/decorators.py", line 35, in wrapper return f(request, *args, **kw)
File "/data/mkt.prod/www/addons.mozilla.org/deploy-olympia-prod-20150227204024-fd03eba6d6/olympia/apps/zadmin/views.py", line 437, in compat binary)
File "/data/mkt.prod/www/addons.mozilla.org/deploy-olympia-prod-20150227204024-fd03eba6d6/olympia/apps/zadmin/views.py", line 459, in compat_stats addons = amo.utils.paginate(request, qs)
File "/data/mkt.prod/www/addons.mozilla.org/deploy-olympia-prod-20150227204024-fd03eba6d6/olympia/apps/amo/utils.py", line 138, in paginate paginated = p.page(page)
File "/data/mkt.prod/www/addons.mozilla.org/deploy-olympia-prod-20150227204024-fd03eba6d6/olympia/apps/amo/utils.py", line 711, in page list(page.object_list)
File "/data/mkt.prod/www/addons.mozilla.org/deploy-olympia-prod-20150227204024-fd03eba6d6/olympia/apps/amo/search.py", line 253, in __iter__ return iter(self._do_search())
File "/data/mkt.prod/www/addons.mozilla.org/deploy-olympia-prod-20150227204024-fd03eba6d6/olympia/apps/amo/search.py", line 225, in _do_search hits = self.raw()
File "/data/mkt.prod/www/addons.mozilla.org/deploy-olympia-prod-20150227204024-fd03eba6d6/olympia/apps/amo/search.py", line 243, in raw doc_type=self.type._meta.db_table
File "/data/mkt.prod/www/addons.mozilla.org/current/venv/lib/python2.6/site-packages/elasticsearch/client/utils.py", line 68, in _wrapped return func(*args, params=params, **kwargs)
File "/data/mkt.prod/www/addons.mozilla.org/current/venv/lib/python2.6/site-packages/elasticsearch/client/__init__.py", line 440, in search params=params, body=body)
File "/data/mkt.prod/www/addons.mozilla.org/current/venv/lib/python2.6/site-packages/elasticsearch/transport.py", line 276, in perform_request status, headers, data = connection.perform_request(method, url, params, body, ignore=ignore, timeout=timeout)
File "/data/mkt.prod/www/addons.mozilla.org/current/venv/lib/python2.6/site-packages/elasticsearch/connection/http_urllib3.py", line 55, in perform_request self._raise_error(response.status, raw_data)
File "/data/mkt.prod/www/addons.mozilla.org/current/venv/lib/python2.6/site-packages/elasticsearch/connection/base.py", line 97, in _raise_error raise HTTP_EXCEPTIONS.get(status_code, TransportError)(status_code, error_message, additional_info)
RequestError: TransportError(400, u'SearchPhaseExecutionException[Failed to execute phase [query], all shards failed; shardFailures {[bHqu3uu4Qj653wYibX5OYA][addons-20141015073422][0]: RemoteTransportException[[es2.mktweb.services.phx1.mozilla.com][inet[/10.32.124.62:10300]][search/phase/query]]; nested: SearchParseException[[addons-20141015073422][0]: from[-1],size[-1]: Parse Failure [Failed to parse source [{"sort": [{"works.1.36000000200100.failure_ratio": "desc"}, {"works.1.36000000200100.total": "desc"}], "query": {"filtered": {"filter": {"and": [{"range": {"works.1.36000000200100.failure": {"gt": 10}}}, {"range": {"support.1.max": {"gte": 0}}}, {"range": {"works.1.36000000200100.failure_ratio": {"gt": 0.80000000000000004}}}]}, "query": {"function_score": {"query": {"match_all": {}}, "functions": [{"field_value_factor": {"field": "boost"}}]}}}}, "size": 20}]]]; nested: SearchParseException[[addons-20141015073422][0]: from[-1],size[-1]: Parse Failure [No mapping found for [works.1.36000000200100.failure_ratio] in order to sort on]]; }{[vX00L5oZSlel1cA6b4i2dw][addons-20141015073422][1]: SearchParseException[[addons-20141015073422][1]: from[-1],size[-1]: Parse Failure [Failed to parse source [{"sort": [{"works.1.36000000200100.failure_ratio": "desc"}, {"works.1.36000000200100.total": "desc"}], "query": {"filtered": {"filter": {"and": [{"range": {"works.1.36000000200100.failure": {"gt": 10}}}, {"range": {"support.1.max": {"gte": 0}}}, {"range": {"works.1.36000000200100.failure_ratio": {"gt": 0.80000000000000004}}}]}, "query": {"function_score": {"query": {"match_all": {}}, "functions": [{"field_value_factor": {"field": "boost"}}]}}}}, "size": 20}]]]; nested: SearchParseException[[addons-20141015073422][1]: from[-1],size[-1]: Parse Failure [No mapping found for [works.1.36000000200100.failure_ratio] in order to sort on]]; }{[1-pAWIgJTJiyOL_jvM5gsw][addons-20141015073422][2]: RemoteTransportException[[es1.mktweb.services.phx1.mozilla.com][inet[/10.32.124.61:9300]][search/phase/query]]; nested: SearchParseException[[addons-20141015073422][2]: from[-1],size[-1]: Parse Failure [Failed to parse source [{"sort": [{"works.1.36000000200100.failure_ratio": "desc"}, {"works.1.36000000200100.total": "desc"}], "query": {"filtered": {"filter": {"and": [{"range": {"works.1.36000000200100.failure": {"gt": 10}}}, {"range": {"support.1.max": {"gte": 0}}}, {"range": {"works.1.36000000200100.failure_ratio": {"gt": 0.80000000000000004}}}]}, "query": {"function_score": {"query": {"match_all": {}}, "functions": [{"field_value_factor": {"field": "boost"}}]}}}}, "size": 20}]]]; nested: SearchParseException[[addons-20141015073422][2]: from[-1],size[-1]: Parse Failure [No mapping found for [works.1.36000000200100.failure_ratio] in order to sort on]]; }{[nM6qnWvcSmqKCtIV78N4zg][addons-20141015073422][3]: RemoteTransportException[[es1.mktweb.services.phx1.mozilla.com][inet[/10.32.124.61:10300]][search/phase/query]]; nested: SearchParseException[[addons-20141015073422][3]: from[-1],size[-1]: Parse Failure [Failed to parse source [{"sort": [{"works.1.36000000200100.failure_ratio": "desc"}, {"works.1.36000000200100.total": "desc"}], "query": {"filtered": {"filter": {"and": [{"range": {"works.1.36000000200100.failure": {"gt": 10}}}, {"range": {"support.1.max": {"gte": 0}}}, {"range": {"works.1.36000000200100.failure_ratio": {"gt": 0.80000000000000004}}}]}, "query": {"function_score": {"query": {"match_all": {}}, "functions": [{"field_value_factor": {"field": "boost"}}]}}}}, "size": 20}]]]; nested: SearchParseException[[addons-20141015073422][3]: from[-1],size[-1]: Parse Failure [No mapping found for [works.1.36000000200100.failure_ratio] in order to sort on]]; }{[3JQNbXr0R_6dxe5zk5vJpA][addons-20141015073422][4]: RemoteTransportException[[es2.mktweb.services.phx1.mozilla.com][inet[/10.32.124.62:9300]][search/phase/query]]; nested: SearchParseException[[addons-20141015073422][4]: from[-1],size[-1]: Parse Failure [Failed to parse source [{"sort": [{"works.1.36000000200100.failure_ratio": "desc"}, {"works.1.36000000200100.total": "desc"}], "query": {"filtered": {"filter": {"and": [{"range": {"works.1.36000000200100.failure": {"gt": 10}}}, {"range": {"support.1.max": {"gte": 0}}}, {"range": {"works.1.36000000200100.failure_ratio": {"gt": 0.80000000000000004}}}]}, "query": {"function_score": {"query": {"match_all": {}}, "functions": [{"field_value_factor": {"field": "boost"}}]}}}}, "size": 20}]]]; nested: SearchParseException[[addons-20141015073422][4]: from[-1],size[-1]: Parse Failure [No mapping found for [works.1.36000000200100.failure_ratio] in order to sort on]]; }]')

compatibility_report cron fixed up the ES mapping for product details changes. This currently runs every 3 hours. I think in the future we just need to make sure to run this after we update product details.
Turns out Fx36 is so new the cron that re-indexes hadn't run yet.
Status: NEW → RESOLVED
Last Resolved: 3 years ago
Resolution: --- → FIXED

Comment 3

3 years ago
Search Unavailable error is still displayed on -dev : http://screencast.com/t/5axEjzZl
Status: RESOLVED → REOPENED
Resolution: FIXED → ---
(Assignee)

Updated

2 years ago
Product: addons.mozilla.org → addons.mozilla.org Graveyard
You need to log in before you can comment on or make changes to this bug.