982617 - Verify public BZ ETL logging to correct host

Status: RESOLVED FIXED

(bugzilla.mozilla.org :: Infrastructure, defect)

Description

[Kyle Lahnakoski [:ekyle]]

Starting around 04:16EDT the public ETL starting emailing errors.  I am most concerned with the URL it is reporting: http://klahnakoski-es.corp.tor1.mozilla.com:9200 (my staging server)  Please make sure the settings.json file for the public cluster logs to the private cluster (elasticsearch[456].bugs.scl3.mozilla.com).


> ERROR: Problem in thread log to debug
> 	at File /data/www/Bugzilla-ETL/bzETL/util/thread/threads.py, line 254, in _run
> 
> caused by
> 	ERROR: problem logging to es
> 	at File /data/www/Bugzilla-ETL/bzETL/util/env/log_usingElasticSearch.py, line 85, in time_delta_pusher
> 	at File /data/www/Bugzilla-ETL/bzETL/util/thread/threads.py, line 245, in _run
> 
> caused by
> 	ERROR: Problem with call to http://klahnakoski-es.corp.tor1.mozilla.com:9200/debug/bz_etl/_bulk
> 	at File /data/www/Bugzilla-ETL/bzETL/util/env/elasticsearch.py, line 322, in post
> 	at File /data/www/Bugzilla-ETL/bzETL/util/env/elasticsearch.py, line 235, in extend
> 	at File /data/www/Bugzilla-ETL/bzETL/util/env/log_usingElasticSearch.py, line 82, in time_delta_pusher
> 	at File /data/www/Bugzilla-ETL/bzETL/util/thread/threads.py, line 245, in _run
> 
> caused by
> 	ERROR: HTTPConnectionPool(host='klahnakoski-es.corp.tor1.mozilla.com', port=9200): Read timed out. (read timeout=600)
> 	at File /usr/lib/python2.7/site-packages/requests/adapters.py, line 391, in send
> 	at File /usr/lib/python2.7/site-packages/requests/sessions.py, line 486, in send
> 	at File /usr/lib/python2.7/site-packages/requests/sessions.py, line 383, in request
> 	at File /usr/lib/python2.7/site-packages/requests/api.py, line 44, in request
> 	at File /usr/lib/python2.7/site-packages/requests/api.py, line 88, in post
> 	at File /data/www/Bugzilla-ETL/bzETL/util/env/elasticsearch.py, line 308, in post

Comment 1

[Kendall Libby [:fubar] (he/him)]

Argh, didn't update the URL when I cut&paste. Fixed for the next cron run.

Comment 2

[Kyle Lahnakoski [:ekyle]]

I am amazed it worked anyway!  

Thanks!