1147704 - Update proxxy configs to point to tooltool

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Chris AtLee [:catlee]]

In bug 882712 we switched from runtime-binaries to tooltool for some things. runtime-binaries is in the proxxy configs, but tooltool is not.

http://hg.mozilla.org/build/puppet/file/13c0385caec3/modules/proxxy/manifests/settings.pp

Comment 1

[Chris AtLee [:catlee]]

Attachment: add tooltool to proxxy server configs

Comment 2

[Chris AtLee [:catlee]]

Now seeing this in the logs on proxxy:
Mar 26 05:37:25 proxxy1.srv.releng.use1.mozilla.com proxxy1.srv.releng.use1.mozilla.: nginx: { "@timestamp": "2015-03-26T05:37:25-07:00", "@fields": { "remote_addr": "10.134.157.21", "host": "tooltool.pvt.build.mozilla.org.proxxy1.srv.releng.use1.mozilla.com", "upstream_cache_status": "HIT", "upstream_response_time": "-", "body_bytes_sent": "1096224", "request_time": "0.031", "status": "200", "request": "GET /build/sha512/0748e900821820f1a42e2f1f3fa4d9002ef257c351b9e6b78e7de0ddd0202eace351f440372fbb1ae0b7e69e8361b036f6bd3362df99e67fc585082a311fc0df HTTP/1.1", "request_method": "GET", "http_referrer": "-", "http_user_agent": "Python-urllib/2.7" } } 

And logs on treeherder look good too:
05:24:30     INFO - #####
05:24:30     INFO - ##### Running start-emulators step.
05:24:30     INFO - #####
05:24:30     INFO - Running pre-action listener: _resource_record_pre_action
05:24:30     INFO - Running main action method: start_emulators
05:24:30     INFO - mkdir: /builds/slave/test/build/emulator
05:24:30     INFO - Writing to file /builds/slave/test/build/tooltool.tt
05:24:30     INFO - Contents:
05:24:30     INFO -  
05:24:30     INFO -          [
05:24:30     INFO -          {
05:24:30     INFO -          "size": 193383673,
05:24:30     INFO -          "digest": "6609e8b95db59c6a3ad60fc3dcfc358b2c8ec8b4dda4c2780eb439e1c5dcc5d550f2e47ce56ba14309363070078d09b5287e372f6e95686110ff8a2ef1838221",
05:24:30     INFO -          "algorithm": "sha512",
05:24:30     INFO -          "filename": "android-sdk18_0.r18moz1.orig.tar.gz",
05:24:30     INFO -          "unpack": "True"
05:24:30     INFO -          }
05:24:30     INFO -          ] 
05:24:30     INFO - proxxy config: {'regions': ['.use1.', '.usw2.'], 'instances': ['proxxy1.srv.releng.use1.mozilla.com', 'proxxy1.srv.releng.usw2.mozilla.com'], 'urls': [('http://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp-ssl.mozilla.org', 'ftp.mozilla.org'), ('http://pvtbuilds.pvt.build.mozilla.org', 'pvtbuilds.mozilla.org'), ('http://tooltool.pvt.build.mozilla.org', 'tooltool.pvt.build.mozilla.org'), ('http://pypi.pvt.build.mozilla.org', 'pypi.pvt.build.mozilla.org'), ('http://pypi.pub.build.mozilla.org', 'pypi.pub.build.mozilla.org')]}
05:24:30     INFO - http://tooltool.pvt.build.mozilla.org/build/ matches http://tooltool.pvt.build.mozilla.org
05:24:30     INFO - URL Candidate: http://tooltool.pvt.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/build/
05:24:30     INFO - retry: Calling run_command with args: (['/tools/tooltool.py', '--url', 'http://tooltool.pvt.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/build/', '--url', 'http://tooltool.pvt.build.mozilla.org/build/', 'fetch', '-m', '/builds/slave/test/build/tooltool.tt', '-o'],), kwargs: {'error_list': [{'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0xf6b910>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0xe6c440>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0xe96ce0>, 'level': 'critical'}, {'substr': 'ERROR - ', 'level': 'error'}], 'cwd': '/builds/slave/test/build', 'privileged': False}, attempt #1
05:24:30     INFO - Running command: ['/tools/tooltool.py', '--url', 'http://tooltool.pvt.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/build/', '--url', 'http://tooltool.pvt.build.mozilla.org/build/', 'fetch', '-m', '/builds/slave/test/build/tooltool.tt', '-o'] in /builds/slave/test/build
05:24:30     INFO - Copy/paste: /tools/tooltool.py --url http://tooltool.pvt.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/build/ --url http://tooltool.pvt.build.mozilla.org/build/ fetch -m /builds/slave/test/build/tooltool.tt -o
05:24:30     INFO -  INFO - Attempting to fetch from 'http://tooltool.pvt.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/build/'...
05:24:36     INFO -  INFO - File android-sdk18_0.r18moz1.orig.tar.gz fetched from http://tooltool.pvt.build.mozilla.org.proxxy1.srv.releng.usw2.mozilla.com/build/ as /builds/slave/test/build/tmpVVwfXs
05:24:39     INFO -  INFO - File integrity verified, renaming tmpVVwfXs to android-sdk18_0.r18moz1.orig.tar.gz
05:24:39     INFO -  INFO - untarring "android-sdk18_0.r18moz1.orig.tar.gz"
05:24:46     INFO - Return code: 0

I just noticed that this invocation of tooltool doesn't reference the local cache though.