1234552 - [pulse_actions/push-extender] TypeError: 'NoneType' object has no attribute '__getitem__'

Status: RESOLVED FIXED

(Testing :: General, defect)

Description

[Armen [:armenzg]]

Since yesterday we started having a lot of reports of this instance.
https://papertrailapp.com/groups/1671233/events?q=program%3Aapp%2Fworker2.1+AND+%28+Traceback+OR+Exception+OR+Error%29

For reference:
https://treeherder.mozilla.org/#/jobs?repo=try-comm-central&author=[e-mail]

Dec 22 03:54:07 pulse-actions app/worker2.1: INFO:	 New jobs requested by [e-mail] on repo_name try-comm-central with resultset_id: 1063 
Dec 22 03:54:07 pulse-actions app/worker2.1: root	 INFO:	 New jobs requested by [e-mail] on repo_name try-comm-central with resultset_id: 1063 
Dec 22 03:54:07 pulse-actions app/worker2.1: DEBUG:	 Find jobs matching 'TB OS X 10.7 try-comm-central build' 
Dec 22 03:54:07 pulse-actions app/worker2.1: DEBUG:	 About to fetch https://secure.pub.build.mozilla.org/buildapi/self-serve/try-comm-central/rev/1abad82d5ad5?format=json 
Dec 22 03:54:08 pulse-actions app/worker2.1: DEBUG:	 We have found 1 job(s) of 'TB OS X 10.7 try-comm-central build'. 
Dec 22 03:54:08 pulse-actions app/worker2.1: DEBUG:	 List of matching jobs: 
Dec 22 03:54:08 pulse-actions app/worker2.1: DEBUG:	 Job identified with complete_at value: 1450754246 run on 2015-12-22 UTC. 
Dec 22 03:54:08 pulse-actions app/worker2.1: DEBUG:	 The job completed at Tue, 22 Dec 2015 03:17:26 +0000 (UTC) (8 hours ago). 
Dec 22 03:54:08 pulse-actions app/worker2.1: DEBUG:	 The local file was last modified in Tue, 22 Dec 2015 09:30:37 GMT. 
Dec 22 03:54:08 pulse-actions app/worker2.1: DEBUG:	 The server's last modified in Tue, 22 Dec 2015 11:45:42 GMT 
Dec 22 03:54:08 pulse-actions app/worker2.1: INFO:	 Fetch newer version of /app/.mozilla/mozci/builds-2015-12-22.js. 
Dec 22 03:54:08 pulse-actions app/worker2.1: mozci	 INFO:	 Fetch newer version of /app/.mozilla/mozci/builds-2015-12-22.js. 
Dec 22 03:54:08 pulse-actions app/worker2.1: DEBUG:	 About to fetch /app/.mozilla/mozci/builds-2015-12-22.js from http://builddata.pub.build.mozilla.org/builddata/buildjson/builds-2015-12-22.js.gz 
Dec 22 03:54:09 pulse-actions app/worker2.1: DEBUG:	 Running in memory saving mode. 
Dec 22 03:54:09 pulse-actions app/worker2.1: DEBUG:	 About to load /app/.mozilla/mozci/builds-2015-12-22.js. 
Dec 22 03:54:56 pulse-actions app/worker2.1: DEBUG:	 Job identified with complete_at value: 1450754246 run on 2015-12-22 UTC. 
Dec 22 03:54:56 pulse-actions app/worker2.1: DEBUG:	 The job completed at Tue, 22 Dec 2015 03:17:26 +0000 (UTC) (8 hours ago). 
Dec 22 03:54:56 pulse-actions app/worker2.1: DEBUG:	 We are going to look for 91677541 in builds-2015-12-22.js. 
Dec 22 03:54:56 pulse-actions app/worker2.1: DEBUG:	 We want to find the files needed to trigger TB OS X 10.7 try-comm-central build 
Dec 22 03:54:56 pulse-actions app/worker2.1: DEBUG:	 We are going to test if we can reach http://archive.mozilla.org/pub/thunderbird/try-builds/[e-mail]-1abad82d5ad5f703c54dae406fe21b8e16b2184f/try-comm-central-macosx64/thunderbird-46.0a1.en-US.mac.web-platform.tests.zip 
Dec 22 03:54:56 pulse-actions app/worker2.1: DEBUG:	 We are going to test if we can reach http://archive.mozilla.org/pub/thunderbird/try-builds/[e-mail]-1abad82d5ad5f703c54dae406fe21b8e16b2184f/try-comm-central-macosx64/thunderbird-46.0a1.en-US.mac.dmg 
Dec 22 03:54:56 pulse-actions app/worker2.1: Traceback (most recent call last): 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "pulse_actions/worker.py", line 75, in run_pulse 
Dec 22 03:54:56 pulse-actions app/worker2.1:     pulse.listen() 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "/app/.heroku/python/lib/python2.7/site-packages/mozillapulse/consumers.py", line 151, in listen 
Dec 22 03:54:56 pulse-actions app/worker2.1:     self._drain_events_loop() 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "/app/.heroku/python/lib/python2.7/site-packages/mozillapulse/consumers.py", line 198, in _drain_events_loop 
Dec 22 03:54:56 pulse-actions app/worker2.1:     self.connection.drain_events(timeout=self.timeout) 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "/app/.heroku/python/lib/python2.7/site-packages/kombu/connection.py", line 275, in drain_events 
Dec 22 03:54:56 pulse-actions app/worker2.1:     return self.transport.drain_events(self.connection, **kwargs) 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "/app/.heroku/python/lib/python2.7/site-packages/kombu/transport/pyamqp.py", line 95, in drain_events 
Dec 22 03:54:56 pulse-actions app/worker2.1:     return connection.drain_events(**kwargs) 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "/app/.heroku/python/lib/python2.7/site-packages/amqp/connection.py", line 325, in drain_events 
Dec 22 03:54:56 pulse-actions app/worker2.1:     return amqp_method(channel, args, content) 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "/app/.heroku/python/lib/python2.7/site-packages/amqp/channel.py", line 1909, in _basic_deliver 
Dec 22 03:54:56 pulse-actions app/worker2.1:     fun(msg) 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "/app/.heroku/python/lib/python2.7/site-packages/kombu/messaging.py", line 596, in _receive_callback 
Dec 22 03:54:56 pulse-actions app/worker2.1:     return on_m(message) if on_m else self.receive(decoded, message) 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "/app/.heroku/python/lib/python2.7/site-packages/kombu/messaging.py", line 563, in receive 
Dec 22 03:54:56 pulse-actions app/worker2.1:     [callback(body, message) for callback in callbacks] 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "pulse_actions/worker.py", line 66, in handler_with_dry_run 
Dec 22 03:54:56 pulse-actions app/worker2.1:     return event_handler(data, message, dry_run) 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "/app/pulse_actions/handlers/route_functions.py", line 15, in route 
Dec 22 03:54:56 pulse-actions app/worker2.1:     treeherder_runnable.on_runnable_job_prod_event(data, message, dry_run) 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "/app/pulse_actions/handlers/treeherder_runnable.py", line 20, in on_runnable_job_prod_event 
Dec 22 03:54:56 pulse-actions app/worker2.1:     return on_runnable_job_event(data, message, dry_run, stage=False) 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "/app/pulse_actions/handlers/treeherder_runnable.py", line 70, in on_runnable_job_event 
Dec 22 03:54:56 pulse-actions app/worker2.1:     complete=False) 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "/app/.heroku/python/lib/python2.7/site-packages/mozci/sources/buildbot_bridge.py", line 159, in buildbot_graph_builder 
Dec 22 03:54:56 pulse-actions app/worker2.1:     if is_downstream(b): 
Dec 22 03:54:56 pulse-actions app/worker2.1:   File "/app/.heroku/python/lib/python2.7/site-packages/mozci/platforms.py", line 54, in is_downstream 
Dec 22 03:54:56 pulse-actions app/worker2.1:     return get_buildername_metadata(buildername)['downstream'] 
Dec 22 03:54:56 pulse-actions app/worker2.1: TypeError: 'NoneType' object has no attribute '__getitem__' 
Dec 22 03:54:57 pulse-actions app/worker2.1: DEBUG:	 We are going to look for 91677541 in builds-2015-12-22.js. 
Dec 22 03:54:57 pulse-actions app/worker2.1: DEBUG:	 {u'branch': u'try-comm-central', u'revision': u'1abad82d5ad5f703c54dae406fe21b8e16b2184f', u'buildername': u'TB OS X 10.7 try-comm-central build', u'status': 0, u'requests': [{u'branch': u'try-comm-central', u'request_id': 91677541, u'reason': u'scheduler', u'buildername': u'TB OS X 10.7 try-comm-central build', u'revision': u'1abad82d5ad5f703c54dae406fe21b8e16b2184f', u'submittime': 1450747458, u'priority': 0, u'claimed_at': 1450754206, u'complete_at': 1450754246, u'complete': 1}], u'build_id': 92842651, u'buildnumber': 80, u'claimed_by_name': u'buildbot-master83.bb.releng.scl3.mozilla.com:/builds/buildbot/try1/master', u'endtime': 1450754246, u'starttime': 1450747486} 
Dec 22 03:54:57 pulse-actions app/worker2.1: INFO:	 We have the necessary files to trigger the downstream job. 
Dec 22 03:54:57 pulse-actions app/worker2.1: mozci	 INFO:	 We have the necessary files to trigger the downstream job.

Comment 1

[Armen [:armenzg]]

I fixed this a couple of weeks ago.