704333 - -dev environment can't handle unicode

Status: RESOLVED WORKSFORME

(Input Graveyard :: Submission, defect)

Description

[Dave Dash [:davedash, :dd] (assign all bugs to mbrandt)]

Upon submitting this:

Automated idea with unicode ☃

We get a traceback with a mysql encoding error:

OperationalError: (1267, "Illegal mix of collations (latin1_swedish_ci,IMPLICIT) and (utf8_general_ci,COERCIBLE) for operation '='")

Comment 1

[Dave Dash [:davedash, :dd] (assign all bugs to mbrandt)]

Fixed it on the db.

Comment 2

[Zac C (:zac)]

This test case passes on -dev.

But こんいちは　(jp) will not.

Stage ok.

Comment 3

[Stephen Donner [:stephend] Not actively reading bugmail]

In fact, here's the traceback:

Traceback (most recent call last):

  File "/data/www/input-dev.allizom.org/reporter/vendor/src/django/django/core/handlers/base.py", line 111, in get_response
    response = callback(request, *callback_args, **callback_kwargs)

  File "/data/www/input-dev.allizom.org/reporter/apps/input/decorators.py", line 102, in wrapped
    return f(request, *args, **kwargs)

  File "/data/www/input-dev.allizom.org/reporter/apps/feedback/views.py", line 52, in wrapped
    return f(request, ua=ua, *args, **kwargs)

  File "/data/www/input-dev.allizom.org/reporter/vendor/src/django/django/views/decorators/cache.py", line 79, in _wrapped_view_func
    response = view_func(request, *args, **kwargs)

  File "/data/www/input-dev.allizom.org/reporter/apps/feedback/views.py", line 77, in feedback
    request, typ, ua, form)

  File "/data/www/input-dev.allizom.org/reporter/apps/feedback/views.py", line 148, in save_opinion_from_form
    opinion.save()

  File "/data/www/input-dev.allizom.org/reporter/vendor/src/django/django/db/models/base.py", line 460, in save
    self.save_base(using=using, force_insert=force_insert, force_update=force_update)

  File "/data/www/input-dev.allizom.org/reporter/vendor/src/django/django/db/models/base.py", line 570, in save_base
    created=(not record_exists), raw=raw, using=using)

  File "/data/www/input-dev.allizom.org/reporter/vendor/src/django/django/dispatch/dispatcher.py", line 172, in send
    response = receiver(signal=self, sender=sender, **named)

  File "/data/www/input-dev.allizom.org/reporter/apps/feedback/models.py", line 151, in extract_terms
    this_term, created = Term.objects.get_or_create(term=term)

  File "/data/www/input-dev.allizom.org/reporter/vendor/src/django/django/db/models/manager.py", line 135, in get_or_create
    return self.get_query_set().get_or_create(**kwargs)

  File "/data/www/input-dev.allizom.org/reporter/vendor/src/django/django/db/models/query.py", line 378, in get_or_create
    return self.get(**lookup), False

  File "/data/www/input-dev.allizom.org/reporter/vendor/src/django/django/db/models/query.py", line 344, in get
    num = len(clone)

  File "/data/www/input-dev.allizom.org/reporter/vendor/src/django/django/db/models/query.py", line 82, in __len__
    self._result_cache = list(self.iterator())

  File "/data/www/input-dev.allizom.org/reporter/vendor/src/django-cache-machine/caching/base.py", line 103, in __iter__
    obj = iterator.next()

  File "/data/www/input-dev.allizom.org/reporter/vendor/src/django/django/db/models/query.py", line 273, in iterator
    for row in compiler.results_iter():

  File "/data/www/input-dev.allizom.org/reporter/vendor/src/django/django/db/models/sql/compiler.py", line 680, in results_iter
    for rows in self.execute_sql(MULTI):

  File "/data/www/input-dev.allizom.org/reporter/vendor/src/django/django/db/models/sql/compiler.py", line 735, in execute_sql
    cursor.execute(sql, params)

  File "/data/www/input-dev.allizom.org/reporter/vendor/src/django/django/db/backends/mysql/base.py", line 86, in execute
    return self.cursor.execute(query, args)

  File "/usr/lib/python2.6/site-packages/MySQLdb/cursors.py", line 173, in execute
    self.errorhandler(self, exc, value)

  File "/usr/lib/python2.6/site-packages/MySQLdb/connections.py", line 36, in defaulterrorhandler
    raise errorclass, errorvalue

OperationalError: (1267, "Illegal mix of collations (latin1_swedish_ci,IMPLICIT) and (utf8_general_ci,COERCIBLE) for operation '='")

Comment 4

[[:Cww]]

Unicode should work now with input rewrite. File new if still broken.