Closed Bug 1305982 Opened 9 years ago Closed 9 years ago

Log parser is pending forever

Categories

(Tree Management :: Treeherder, defect)

Product:
Tree Management
Component:
Treeherder
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED DUPLICATE of bug 1283859

People

(Reporter: wcosta, Unassigned)

References

Details

Weird, running test_parse_log on the log url works fine (https://public-artifacts.taskcluster.net/VepO1mafQB63RRw1vnlilA/0/public/logs/live_backing.log). Is it possible that the url didn't work when you submitted the job? I could probably figure out what happened when the job was submitted, though it might take a little digging because it's so old.
Flags: needinfo?(wcosta)
(In reply to William Lachance (:wlach) from comment #1) > Weird, running test_parse_log on the log url works fine > (https://public-artifacts.taskcluster.net/VepO1mafQB63RRw1vnlilA/0/public/ > logs/live_backing.log). Is it possible that the url didn't work when you > submitted the job? > Not that I can see in the code... > I could probably figure out what happened when the job was submitted, though > it might take a little digging because it's so old. I just triggered a new job to make easier to you https://tools.taskcluster.net/task-inspector/#PgAww8yURkyjG46s8152rA
Flags: needinfo?(wcosta)
Ok, found it: Sep 29 10:03:30 treeherder-prototype heroku/worker_log_parser.1: source=worker_log_parser.1 dyno=heroku.36423356.c6ba83f9-68ec-419b-820f-6032d90d4ae0 sample#memory_total=301.16MB sample#memory_rss=296.21MB sample#memory_cache=1.55MB sample#memory_swap=3.40MB sample#memory_pgpgin=37341098pages sample#memory_pgpgout=37481535pages sample#memory_quota=512.00MB Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: [2016-09-29 06:03:30,146] ERROR [treeherder.log_parser.utils:67] Failed to store parsed artifact for try 3e0030c3-cc94-464c-a31b-8eacf35e76ac/0 (https://queue.taskcluster.net/v1/task/PgAww8yURkyjG46s8152rA/runs/0/artifacts/public%2Flogs%2Flive_backing.log): (1064, "syntax error, unexpected '-'") Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: [2016-09-29 06:03:30,146: ERROR/Worker-158] Failed to store parsed artifact for try 3e0030c3-cc94-464c-a31b-8eacf35e76ac/0 (https://queue.taskcluster.net/v1/task/PgAww8yURkyjG46s8152rA/runs/0/artifacts/public%2Flogs%2Flive_backing.log): (1064, "syntax error, unexpected '-'") Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: [2016-09-29 06:03:30,158: ERROR/MainProcess] Task log-parser[a0d244df-d9b4-40f4-bc54-036bd6d04e4c] raised unexpected: ProgrammingError(1064, "syntax error, unexpected '-'") Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: Traceback (most recent call last): Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/.heroku/python/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: R = retval = fun(*args, **kwargs) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/.heroku/python/lib/python2.7/site-packages/newrelic-2.68.0.50/newrelic/hooks/application_celery.py", line 84, in wrapper Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: return wrapped(*args, **kwargs) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/.heroku/python/lib/python2.7/site-packages/celery/app/trace.py", line 438, in __protected_call__ Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: return self.run(*args, **kwargs) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/treeherder/workers/task.py", line 33, in inner Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: return f(*args, **kwargs) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/treeherder/workers/taskset.py", line 24, in inner Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: rv = f(*args, **kwargs) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/treeherder/log_parser/tasks.py", line 35, in inner Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: return f(project, job_guid, job_log, priority) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/treeherder/log_parser/tasks.py", line 105, in parse_log Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: post_log_artifacts(project, job_guid, job_log) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/treeherder/log_parser/utils.py", line 63, in post_log_artifacts Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: artifacts_model.load_job_artifacts(serialized_artifacts) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/treeherder/model/derived/artifacts.py", line 252, in load_job_artifacts Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: self.store_text_log_summary(job, artifact) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/treeherder/model/derived/artifacts.py", line 169, in store_text_log_summary Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: load_error_summary(job.repository.name, job.id) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/treeherder/model/error_summary.py", line 180, in load_error_summary Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: "blob": json.dumps(get_error_summary(job)) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/treeherder/model/error_summary.py", line 39, in get_error_summary Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: bugs = Bugscache.search(search_term) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/treeherder/model/models.py", line 180, in search Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: return {"open_recent": [model_to_dict(item, exclude=["modified"]) for item in recent], Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/.heroku/python/lib/python2.7/site-packages/django/db/models/query.py", line 1284, in __iter__ Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: query = iter(self.query) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/.heroku/python/lib/python2.7/site-packages/django/db/models/sql/query.py", line 80, in __iter__ Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: self._execute_query() Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/.heroku/python/lib/python2.7/site-packages/django/db/models/sql/query.py", line 98, in _execute_query Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: self.cursor.execute(self.sql, self.params) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/.heroku/python/lib/python2.7/site-packages/django/db/backends/utils.py", line 64, in execute Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: return self.cursor.execute(sql, params) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/.heroku/python/lib/python2.7/site-packages/django/db/utils.py", line 98, in __exit__ Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: six.reraise(dj_exc_type, dj_exc_value, traceback) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/.heroku/python/lib/python2.7/site-packages/django/db/backends/utils.py", line 64, in execute Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: return self.cursor.execute(sql, params) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/.heroku/python/lib/python2.7/site-packages/django/db/backends/mysql/base.py", line 124, in execute Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: return self.cursor.execute(query, args) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/.heroku/python/lib/python2.7/site-packages/newrelic-2.68.0.50/newrelic/hooks/database_dbapi2.py", line 22, in execute Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: *args, **kwargs) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/.heroku/python/lib/python2.7/site-packages/MySQLdb/cursors.py", line 226, in execute Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: self.errorhandler(self, exc, value) Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: File "/app/.heroku/python/lib/python2.7/site-packages/MySQLdb/connections.py", line 36, in defaulterrorhandler Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: raise errorvalue Sep 29 10:03:30 treeherder-stage app/worker_log_parser.1: ProgrammingError: (1064, "syntax error, unexpected '-'") Sep 29 10:03:30 treeherder-prototype app/worker_log_parser.3: [2016-09-29 06:03:30,448: WARNING/Worker-1844] /app/.heroku/python/lib/python2.7/site-packages/MySQLdb/cursors.py:258: Warning: Invalid utf8 character string: '9C8B8E'
Looks like this is bug 1283859.
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → DUPLICATE
Component: Treeherder: Log Viewer → TreeHerder
You need to log in before you can comment on or make changes to this bug.