1037537 - fetch-adi-from-hive job failing on prod/stage

Status: RESOLVED FIXED

(Socorro :: General, task)

Description

[Robert Helmer [:rhelmer]]

https://errormill.mozilla.org/webtools/socorro-prod/group/170443/

DataError: invalid byte sequence for encoding "UTF8": 0x00
CONTEXT:  COPY raw_adi_logs, line 34976


Stacktrace (most recent call last):

  File "crontabber/app.py", line 984, in _run_one
    for last_success in self._run_job(job_class, config, info):
  File "crontabber/base.py", line 199, in main
    function(when)
  File "crontabber/mixins.py", line 165, in _run_proxy
    **kwargs
  File "crontabber/transaction_executor.py", line 46, in __call__
    result = function(connection, *args, **kwargs)
  File "socorro/cron/jobs/fetch_adi_from_hive.py", line 193, in run
    'count'

Comment 1

[[github robot]]

Commits pushed to master at https://github.com/mozilla/socorro

https://github.com/mozilla/socorro/commit/372cfb1c2380c528f4a63bd8b8b8866d933c7feb
fix bug 1037537 - encode utf-8 properly, and remove NULL characters which postgres will not allow to be imported into TEXT NOT NULL columns

https://github.com/mozilla/socorro/commit/f52e5eaf116ce955f8bca9aa70b60d6ca4e48459
Merge pull request #2187 from rhelmer/bug1037537-fetch-adi-failing-on-bad-unicode

fix bug 1037537 - encode utf-8 properly, and remove NULL characters whic...