891831 - HTTP Error 500: Internal Server Error when submitting to autolog

Status: RESOLVED FIXED

(Remote Protocol :: Marionette, defect)

Description

[Zac C (:zac)]

Attachment: console trace including autolog500

Our Jenkins jobs are failing to submit results to autolog with the following stack trace.

Attached is one of many examples from this morning.


Dave Hunt suggested it may be related to this bug/commit:
https://bugzilla.mozilla.org/show_bug.cgi?id=889637
http://hg.mozilla.org/mozilla-central/rev/40f668ee694c



-----------------------

posting results to autolog
starting httpd
Traceback (most recent call last):
  File "/var/jenkins/workspace/b2g.unagi.comril.gaia.v1-train.ui/.env/bin/gaiatest", line 8, in <module>
    load_entry_point('gaiatest==0.12', 'console_scripts', 'gaiatest')()
  File "/var/jenkins/workspace/b2g.unagi.comril.gaia.v1-train.ui/gaiatest/runtests.py", line 280, in main
    cli(runner_class=GaiaTestRunner, parser_class=GaiaTestOptions)
  File "/var/jenkins/workspace/b2g.unagi.comril.gaia.v1-train.ui/.env/local/lib/python2.7/site-packages/marionette_client-0.5.35-py2.7.egg/marionette/runtests.py", line 780, in cli
    runner = startTestRunner(runner_class, options, tests)
  File "/var/jenkins/workspace/b2g.unagi.comril.gaia.v1-train.ui/.env/local/lib/python2.7/site-packages/marionette_client-0.5.35-py2.7.egg/marionette/runtests.py", line 772, in startTestRunner
    runner.run_tests(tests)
  File "/var/jenkins/workspace/b2g.unagi.comril.gaia.v1-train.ui/gaiatest/runtests.py", line 144, in run_tests
    MarionetteTestRunner.run_tests(self, tests)
  File "/var/jenkins/workspace/b2g.unagi.comril.gaia.v1-train.ui/.env/local/lib/python2.7/site-packages/marionette_client-0.5.35-py2.7.egg/marionette/runtests.py", line 436, in run_tests
    self.post_to_autolog(self.elapsedtime)
  File "/var/jenkins/workspace/b2g.unagi.comril.gaia.v1-train.ui/.env/local/lib/python2.7/site-packages/marionette_client-0.5.35-py2.7.egg/marionette/runtests.py", line 416, in post_to_autolog
    testgroup.submit()
  File "/var/jenkins/workspace/b2g.unagi.comril.gaia.v1-train.ui/.env/local/lib/python2.7/site-packages/mozautolog/mozautolog.py", line 677, in submit
    response_stream = urllib2.urlopen(req)
  File "/usr/lib/python2.7/urllib2.py", line 126, in urlopen
    return _opener.open(url, data, timeout)
  File "/usr/lib/python2.7/urllib2.py", line 406, in open
    response = meth(req, response)
  File "/usr/lib/python2.7/urllib2.py", line 519, in http_response
    'http', request, response, code, msg, hdrs)
  File "/usr/lib/python2.7/urllib2.py", line 444, in error
    return self._call_chain(*args)
  File "/usr/lib/python2.7/urllib2.py", line 378, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 527, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
urllib2.HTTPError: HTTP Error 500: Internal Server Error

Comment 1

[Jonathan Griffin (:jgriffin)]

This is caused by bug 891057.  In the short term I can fix by adding an explicit --es-server arg to the Jenkins job, which I'll do.

Comment 2

[Jonathan Griffin (:jgriffin)]

I added --es-server=elasticsearch-zlb.webapp.scl3.mozilla.com:9200 to the Jenkins jobs I noticed were using --autolog, if I missed any they should be fixed by adding the same argument.

Comment 3

[Jonathan Griffin (:jgriffin)]

I'm closing this, bug re-open if it still occurs.

Comment 4

[Zac C (:zac)]

Do --autolog and --es-server have a mutual dependency?

Comment 5

[Jonathan Griffin (:jgriffin)]

--es-server is meaningless without --autolog.  If --autolog and not --es-server, a default pair of ES servers will be used.  If --es-server is specified, then no default servers are used.

Comment 6

[Zac C (:zac)]

OK I see.
So when bug 891057 is closed we won't need to specify --es-server=elasticsearch-zlb.webapp.scl3.mozilla.com:9200 .

Comment 7

[Jonathan Griffin (:jgriffin)]

(In reply to Zac C (:zac) from comment #6)
> OK I see.
> So when bug 891057 is closed we won't need to specify
> --es-server=elasticsearch-zlb.webapp.scl3.mozilla.com:9200 .

That's correct.