1356685 - OperationalError: (1366, "Incorrect string value: '\\xF0\\x9F\\x92\\xA9\\x0A\\x0A...' for column 'description' at row 1")

Status: RESOLVED INVALID

(MozReview Graveyard :: Infrastructure, defect)

Description

[Gregory Szorc [:gps]]

snorp got an HTTP 500 submitting a review series. Server logs make it look like MySQL is rejecting a Unicode code point.

2017-04-14 21:27:53,446 - INFO -  - processing BatchReviewRequest for snorp
2017-04-14 21:27:53,455 - INFO -  - processing batch submission bz://1322650/snorp to gecko with 12 commits
2017-04-14 21:27:53,460 - INFO -  - using squashed review request 126450
2017-04-14 21:27:53,460 - INFO -  - bz://1322650/snorp: generating squashed diffset for 126450
2017-04-14 21:27:54,020 - INFO -  - bz://1322650/snorp: updated squashed diffset for 126450
2017-04-14 21:27:54,023 - INFO -  - bz://1322650/snorp: 12 previous commits; 0 discard on publish; 0 unpublished
2017-04-14 21:27:54,024 - INFO -  - bz://1322650/snorp: 0/12 commits mapped exactly
2017-04-14 21:27:54,024 - INFO -  - bz://1322650/snorp: 0/12 mapped exactly or to precursors
2017-04-14 21:27:54,050 - INFO -  - bz://1322650/snorp: commit ID 68VSbXdfsMH for 7c4d9968bec79e930cb6d5c1ebaf329c5d376c65 found in review request 126452
2017-04-14 21:27:55,265 - INFO -  - importing Bugzilla users from query "jchen": [e-mail], [e-mail]
2017-04-14 21:27:56,267 - INFO -  - bz://1322650/snorp: commit ID 7YUTVB4Bydg for 0a9667d0d6ed860df5daadf6bd9721178905672b found in review request 129010
2017-04-14 21:27:57,455 - INFO -  - importing Bugzilla users from query "jgilbert": [e-mail]
2017-04-14 21:27:58,486 - INFO -  - bz://1322650/snorp: commit ID 6ysRGDNCQa0 for 91d01d862f3f05212f4783dfd7cd1157a44ced7d found in review request 129012
2017-04-14 21:27:58,890 - WARNING -  - bz://1322650/snorp: commit 4248e60f195631b7b16ce46724304515f024e19e does not have commit id
2017-04-14 21:27:58,890 - INFO -  - bz://1322650/snorp: commit ID EXQ5YDSMMGL for 7c88de212d66dc9970b60cf9a964ed34c816a1a3 found in review request 129016
2017-04-14 21:28:00,153 - INFO -  - importing Bugzilla users from query "jolin": [e-mail]
2017-04-14 21:28:00,947 - INFO -  - bz://1322650/snorp: commit ID 9DUMoLQFhlv for 44659f77516ac2ef2267edd2912747362f420b00 found in review request 129018
2017-04-14 21:28:01,415 - INFO -  - bz://1322650/snorp: commit ID 5yNIoZHonla for 77ffc8f984d70ecd1694fb3ff3934ace75194fee found in review request 129020
2017-04-14 21:28:01,943 - ERROR -  - Exception thrown for user snorp at https://reviewboard.mozilla.org/api/extensions/mozreview.extension.MozReviewExtension/batch-review-requests/

(1366, "Incorrect string value: '\\xF0\\x9F\\x92\\xA9\\x0A\\x0A...' for column 'description' at row 1")
Traceback (most recent call last):
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/django/core/handlers/base.py", line 112, in get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
  File "/usr/lib64/python2.6/site-packages/newrelic-2.44.0.36/newrelic/hooks/framework_django.py", line 497, in wrapper
    return wrapped(*args, **kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/django/views/decorators/cache.py", line 52, in _wrapped_view_func
    response = view_func(request, *args, **kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/django/views/decorators/vary.py", line 19, in inner_func
    response = func(*args, **kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/djblets/webapi/resources/base.py", line 196, in __call__
    request, method, view, api_format=api_format, *args, **kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/djblets/webapi/resources/mixins/api_tokens.py", line 65, in call_method_view
    return view(request, *args, **kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/djblets/webapi/resources/base.py", line 449, in post
    return self.create(*args, **kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/djblets/webapi/decorators.py", line 122, in _call
    return view_func(*args, **kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/ReviewBoard-2.5.4.moz-py2.6.egg/reviewboard/webapi/decorators.py", line 139, in _check
    return view_func(*args, **kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/djblets/webapi/decorators.py", line 122, in _call
    return view_func(*args, **kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/djblets/webapi/decorators.py", line 143, in _checklogin
    return view_func(*args, **kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/djblets/webapi/decorators.py", line 122, in _call
    return view_func(*args, **kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/djblets/webapi/decorators.py", line 122, in _call
    return view_func(*args, **kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/djblets/webapi/decorators.py", line 307, in _validate
    return view_func(*args, **new_kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/mozreview-0.1.2a0-py2.6.egg/mozreview/resources/batch_review_request.py", line 351, in create
    identifier, commits)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/mozreview-0.1.2a0-py2.6.egg/mozreview/resources/batch_review_request.py", line 627, in _process_submission
    create_comm_msg_filediff)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/mozreview-0.1.2a0-py2.6.egg/mozreview/resources/batch_review_request.py", line 1092, in update_review_request
    update_review_request_draft_diffset(rr, diffset, draft=draft)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/mozreview-0.1.2a0-py2.6.egg/mozreview/resources/batch_review_request.py", line 850, in update_review_request_draft_diffset
    draft.save()
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/ReviewBoard-2.5.4.moz-py2.6.egg/reviewboard/reviews/models/base_review_request_details.py", line 290, in save
    super(BaseReviewRequestDetails, self).save(**kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/django/db/models/base.py", line 545, in save
    force_update=force_update, update_fields=update_fields)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/django/db/models/base.py", line 573, in save_base
    updated = self._save_table(raw, cls, force_insert, force_update, using, update_fields)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/django/db/models/base.py", line 635, in _save_table
    forced_update)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/django/db/models/base.py", line 679, in _do_update
    return filtered._update(values) > 0
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/django/db/models/query.py", line 510, in _update
    return query.get_compiler(self.db).execute_sql(None)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/django/db/models/sql/compiler.py", line 980, in execute_sql
    cursor = super(SQLUpdateCompiler, self).execute_sql(result_type)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/django/db/models/sql/compiler.py", line 786, in execute_sql
    cursor.execute(sql, params)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/django/db/backends/util.py", line 53, in execute
    return self.cursor.execute(sql, params)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/django/db/utils.py", line 99, in __exit__
    six.reraise(dj_exc_type, dj_exc_value, traceback)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/django/db/backends/util.py", line 53, in execute
    return self.cursor.execute(sql, params)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/django/db/backends/mysql/base.py", line 124, in execute
    return self.cursor.execute(query, args)
  File "/usr/lib64/python2.6/site-packages/newrelic-2.44.0.36/newrelic/hooks/database_dbapi2.py", line 22, in execute
    *args, **kwargs)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/MySQLdb/cursors.py", line 205, in execute
    self.errorhandler(self, exc, value)
  File "/data/www/reviewboard.mozilla.org/venv/lib/python2.6/site-packages/MySQLdb/connections.py", line 36, in defaulterrorhandler
    raise errorclass, errorvalue
OperationalError: (1366, "Incorrect string value: '\\xF0\\x9F\\x92\\xA9\\x0A\\x0A...' for column 'description' at row 1")

Comment 1

[Gregory Szorc [:gps]]

https://reviewboard-hg.mozilla.org/gecko/rev/77ffc8f984d70ecd1694fb3ff3934ace75194fee is the bad revision.

It seems to be failing on pile of poo. That emoji also summarizes my feelings on how many MySQL configurations deal with Unicode.

Comment 2

[BMO Automation]

MozReview is now obsolete. Please use Phabricator instead. Closing this bug.