1631860 - Problem in log parser?

Status: NEW

(Tree Management :: Treeherder, defect, P1)

Description

[Kyle Lahnakoski [:ekyle]]

Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3: [2020-04-21 17:46:57,496: ERROR/ForkPoolWorker-3] Task log-parser[a4e42617-b648-4460-bad8-f4f0233b7019] raised unexpected: DataError(1406, "Data too long for column 'expected' at row 1") 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3: Traceback (most recent call last): 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/backends/utils.py", line 86, in _execute 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     return self.cursor.execute(sql, params) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/backends/mysql/base.py", line 74, in execute 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     return self.cursor.execute(query, args) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/newrelic/hooks/database_dbapi2.py", line 25, in execute 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     *args, **kwargs) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/MySQLdb/cursors.py", line 209, in execute 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     res = self._query(query) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/MySQLdb/cursors.py", line 315, in _query 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     db.query(q) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/MySQLdb/connections.py", line 239, in query 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     _mysql.connection.query(self, query) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3: MySQLdb._exceptions.DataError: (1406, "Data too long for column 'expected' at row 1") 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3: The above exception was the direct cause of the following exception: 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3: Traceback (most recent call last): 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/celery/app/trace.py", line 385, in trace_task 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     R = retval = fun(*args, **kwargs) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/newrelic/hooks/application_celery.py", line 85, in wrapper 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     return wrapped(*args, **kwargs) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/celery/app/trace.py", line 650, in __protected_call__ 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     return self.run(*args, **kwargs) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/treeherder/workers/task.py", line 65, in inner 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     raise task_func.retry(exc=e, countdown=timeout) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/celery/app/task.py", line 704, in retry 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     raise_with_context(exc) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/treeherder/workers/task.py", line 41, in inner 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     return f(*args, **kwargs) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/treeherder/log_parser/tasks.py", line 76, in parse_logs 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     raise first_exception 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/treeherder/log_parser/tasks.py", line 58, in parse_logs 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     parser(job_log) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/treeherder/log_parser/tasks.py", line 110, in store_failure_lines 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     failureline.store_failure_lines(job_log) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/treeherder/log_parser/failureline.py", line 22, in store_failure_lines 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     return write_failure_lines(job_log, log_iter) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/treeherder/log_parser/failureline.py", line 52, in write_failure_lines 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     failure_lines = create(job_log, log_list) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/treeherder/log_parser/failureline.py", line 138, in create 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     failure_lines = [create_failure_line(job_log, failure_line) for failure_line in log_list] 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/treeherder/log_parser/failureline.py", line 138, in <listcomp> 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     failure_lines = [create_failure_line(job_log, failure_line) for failure_line in log_list] 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/treeherder/log_parser/failureline.py", line 108, in create_failure_line 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     **get_kwargs(failure_line), 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/models/manager.py", line 82, in manager_method 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     return getattr(self.get_queryset(), name)(*args, **kwargs) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/models/query.py", line 433, in create 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     obj.save(force_insert=True, using=self.db) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/models/base.py", line 746, in save 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     force_update=force_update, update_fields=update_fields) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/models/base.py", line 784, in save_base 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     force_update, using, update_fields, 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/models/base.py", line 887, in _save_table 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     results = self._do_insert(cls._base_manager, using, fields, returning_fields, raw) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/models/base.py", line 926, in _do_insert 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     using=using, raw=raw, 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/models/manager.py", line 82, in manager_method 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     return getattr(self.get_queryset(), name)(*args, **kwargs) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/models/query.py", line 1204, in _insert 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     return query.get_compiler(using=using).execute_sql(returning_fields) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/models/sql/compiler.py", line 1391, in execute_sql 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     cursor.execute(sql, params) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/backends/utils.py", line 68, in execute 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     return self._execute_with_wrappers(sql, params, many=False, executor=self._execute) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/backends/utils.py", line 77, in _execute_with_wrappers 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     return executor(sql, params, many, context) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/backends/utils.py", line 86, in _execute 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     return self.cursor.execute(sql, params) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/utils.py", line 90, in __exit__ 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     raise dj_exc_value.with_traceback(traceback) from exc_value 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/backends/utils.py", line 86, in _execute 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     return self.cursor.execute(sql, params) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/django/db/backends/mysql/base.py", line 74, in execute 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     return self.cursor.execute(query, args) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/newrelic/hooks/database_dbapi2.py", line 25, in execute 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     *args, **kwargs) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/MySQLdb/cursors.py", line 209, in execute 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     res = self._query(query) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/MySQLdb/cursors.py", line 315, in _query 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     db.query(q) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:   File "/app/.heroku/python/lib/python3.7/site-packages/MySQLdb/connections.py", line 239, in query 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3:     _mysql.connection.query(self, query) 
Apr 21 17:46:57 treeherder-stage app/worker_log_parser.3: django.db.utils.DataError: (1406, "Data too long for column 'expected' at row 1") 
Apr 21 17:46:58 treeherder-stage app/worker_log_parser.3: [2020-04-21 17:46:57,732] 

Comment 1

[Sarah Clements [:sclements]]

I'm doing some cleanup of the log parser so I can look into this.