780823 - [traceback] DjangoUnicodeDecodeError: 'utf8' codec can't decode byte 0xae in position 41: invalid start byte - amo.utils.escape_all

Status: VERIFIED FIXED

(Marketplace Graveyard :: Reviewer Tools, defect, P2)

Description

[Christopher Van Wiemeersch [:cvan]]

http://sentry.dmz.phx1.mozilla.com/marketplace/group/1791/

DjangoUnicodeDecodeError: 'utf8' codec can't decode byte 0xae in position 41: invalid start byte. You passed in '{  \r\n  "version": "3.8",\r\n  "name": "W2MO\xae",\r\n  "description": "W2MO: Logistics 3D-Simulation, Optimization, Workforce Planning",\r\n  "icons": {\r\n    "16": "/img/icon-16.PNG",\r\n    "48": "/img/icon-48.PNG",\r\n    "128": "/img/icon-128.PNG"\r\n  },\r\n  "developer": {  \r\n    "name": "Logivations GmbH",\r\n    "url": "https://w2mo.logivations.com"  \r\n  },\r\n  "locales": {  \r\n    "de": {  \r\n      "description": "W2MO: Logistikoptimierung, 3D-Simulation, Personalplanung"    },\r\n    "en": {  \r\n      "description": "W2MO: Logistics 3D-Simulation, Optimization, Workforce Planning"\r\n    },  \r\n    "fr": {  \r\n      "description": "W2MO: Conception logistique, 3D-simulation, optimisation, planification du personnel"    },  \r\n    "nl": {  \r\n      "description": "W2MO: Logistiek planning. 3D Simulatie, optimalisatie, arbeidskrachten planning"    },  \r\n    "es": {  \r\n      "description": "W2MO: dise\xc3\xb1o log\xc3\xadstico, simulaci\xc3\xb3n 3D, optimizaci\xc3\xb3n, planificaci\xc3\xb3n de la plantilla"    },  \r\n    "pt-br": {  \r\n      "description": "W2MO: log\xc3\xadstica, simula\xc3\xa7\xc3\xa3o 3D e anima\xc3\xa7\xc3\xa3o, otimiza\xc3\xa7\xc3\xa3o, planejamento de pessoal"    },  \r\n    "pt-pt": {  \r\n      "description": "W2MO: log\xc3\xadstica, simula\xc3\xa7\xc3\xa3o 3D e anima\xc3\xa7\xc3\xa3o, otimiza\xc3\xa7\xc3\xa3o, planejamento de pessoal"    },  \r\n    "ru": {  \r\n      "description": "W2MO: \xd0\x9b\xd0\xbe\xd0\xb3\xd0\xb8\xd1\x81\xd1\x82\xd0\xb8\xd1\x87\xd0\xb5\xd1\x81\xd0\xba\xd0\xb8\xd0\xb9 \xd0\xb4\xd0\xb8\xd0\xb7\xd0\xb0\xd0\xb9\xd0\xbd, 3D-\xd1\x81\xd0\xb8\xd0\xbc\xd1\x83\xd0\xbb\xd1\x8f\xd1\x86\xd0\xb8\xd1\x8f, \xd0\xbe\xd0\xbf\xd1\x82\xd0\xb8\xd0\xbc\xd0\xb8\xd0\xb7\xd0\xb0\xd1\x86\xd0\xb8\xd1\x8f, \xd0\xba\xd0\xb0\xd0\xb4\xd1\x80\xd0\xbe\xd0\xb2\xd0\xbe\xd0\xb5 \xd0\xbf\xd0\xbb\xd0\xb0\xd0\xbd\xd0\xb8\xd1\x80\xd0\xbe\xd0\xb2\xd0\xb0\xd0\xbd\xd0\xb8\xd0\xb5, \xd1\x80\xd0\xb0\xd1\x81\xd1\x87\xd0\xb5\xd1\x82 \xd1\x81\xd1\x82\xd0\xbe\xd0\xb8\xd0\xbc\xd0\xbe\xd1\x81\xd1\x82\xd0\xb8"    },  \r\n    "cn": {  \r\n      "description": "W2MO: \xd0\x9b\xd0\xbe\xd0\xb3\xd1\x96\xd1\x81\xd1\x82\xd0\xb8\xd1\x87\xd0\xbd\xd0\xb8\xd0\xb9 \xd0\xb4\xd0\xb8\xd0\xb7\xd0\xb0\xd0\xb9\xd0\xbd, 3D-\xd1\x81\xd0\xb8\xd0\xbc\xd1\x83\xd0\xbb\xd1\x8f\xd1\x86\xd1\x96\xd1\x8f, \xd0\xbe\xd0\xbf\xd1\x82\xd0\xb8\xd0\xbc\xd1\x96\xd0\xb7\xd0\xb0\xd1\x86\xd1\x96\xd1\x8f, \xd0\xbf\xd0\xbb\xd0\xb0\xd0\xbd\xd1\x83\xd0\xb2\xd0\xb0\xd0\xbd\xd0\xbd\xd1\x8f \xd0\xbf\xd0\xb5\xd1\x80\xd1\x81\xd0\xbe\xd0\xbd\xd0\xb0\xd0\xbb\xd1\x83, \xd0\xba\xd0\xb0\xd0\xbb\xd1\x8c\xd0\xba\xd1\x83\xd0\xbb\xd1\x8f\xd1\x86\xd1\x96\xd1\x8f \xd0\xb2\xd0\xb8\xd1\x82\xd1\x80\xd0\xb0\xd1\x82"    }  \r\n  },  \r\n  "default_locale": "en"    \r\n}\r\n' (<type 'str'>)

Stacktrace (most recent call last):

  File "django/core/handlers/base.py", line 111, in get_response
    response = callback(request, *callback_args, **callback_kwargs)

  File "amo/decorators.py", line 29, in wrapper
    return func(request, *args, **kw)

  File "amo/decorators.py", line 61, in wrapper
    return f(request, *args, **kw)

  File "addons/decorators.py", line 32, in wrapper
    return f(request, addon, *args, **kw)

  File "amo/decorators.py", line 127, in wrapper
    response = func(*args, **kw)

  File "mkt/reviewers/views.py", line 329, in app_view_manifest
    return escape_all({'content': content, 'headers': headers})

  File "amo/utils.py", line 807, in escape_all
    v[k] = escape_all(lv)

  File "amo/utils.py", line 799, in escape_all
    v = jinja2.escape(smart_unicode(v))

  File "django/utils/encoding.py", line 39, in smart_unicode
    return force_unicode(s, encoding, strings_only, errors)

  File "django/utils/encoding.py", line 93, in force_unicode
    raise DjangoUnicodeDecodeError(s, *e.args)

Comment 1

[Christopher Van Wiemeersch [:cvan]]

Sample:
https://marketplace.mozilla.org/en-US/reviewers/apps/review/w2mo/
https://marketplace.mozilla.org/en-US/reviewers/apps/review/w2mo/manifest
https://w2mo.logivations.com/w2mo.webapp

Comment 2

[Christopher Van Wiemeersch [:cvan]]

https://github.com/mozilla/zamboni/commit/9850dfc

Comment 3

[krupa raj[:krupa]]

verified fixed at 
https://marketplace.mozilla.org/reviewers/apps/review/w2mo?lang=en-us
https://marketplace.mozilla.org/reviewers/apps/review/w2mo/manifest?lang=en-us