Closed Bug 1670369 Opened 4 years ago Closed 4 years ago

Intermittent raptor-mitmproxy Critical: [chrome] Error while downloading C:\Users\task\build\tests\raptor\raptor\tooltool-manifests\<anything>.manifest from tooltool:Command failed

Categories

(Testing :: Raptor, defect, P5)

defect

Tracking

(Not tracked)

RESOLVED INCOMPLETE

People

(Reporter: intermittent-bug-filer, Unassigned)

Details

(Keywords: intermittent-failure)

Filed by: apavel [at] mozilla.com
Parsed log: https://treeherder.mozilla.org/logviewer.html#?job_id=318155595&repo=mozilla-central
Full log: https://firefox-ci-tc.services.mozilla.com/api/queue/v1/task/dOIAM-DVQkGVHfpSH7HQLg/runs/0/artifacts/public/logs/live_backing.log


[task 2020-10-09T10:34:43.576Z] 10:34:43     INFO -  raptor-perftest Warning: [chrome] Failed to get browser meta data through mozversion: LocalAppNotFoundError-Application not found at: C:\Progra~2\Google\Chrome\Application
[task 2020-10-09T10:34:43.577Z] 10:34:43     INFO -  raptor-perftest Info: Attempting to get version through fallback method...
[task 2020-10-09T10:34:43.636Z] 10:34:43     INFO -  raptor-perftest Info: Browser name: chrome
[task 2020-10-09T10:34:43.636Z] 10:34:43     INFO -  raptor-perftest Info: Browser version: 85.0.4183.121
[task 2020-10-09T10:34:43.637Z] 10:34:43     INFO -  raptor-control-server Info: raptor control server running on port 49900...
[task 2020-10-09T10:34:43.637Z] 10:34:43     INFO -  raptor-webext-desktop Info: creating browser runner using mozrunner
[task 2020-10-09T10:34:43.637Z] 10:34:43     INFO -  raptor-webext-desktop Info: test raptor-tp6-yahoo-mail-chrome-cold is running in cold mode; browser WILL be restarted between page cycles
[task 2020-10-09T10:34:43.637Z] 10:34:43     INFO -  raptor-webext-desktop Info: begin browser cycle 1 of 25 for test raptor-tp6-yahoo-mail-chrome-cold
[task 2020-10-09T10:34:43.637Z] 10:34:43     INFO -  raptor-perftest Info: starting test: raptor-tp6-yahoo-mail-chrome-cold
[task 2020-10-09T10:34:43.637Z] 10:34:43     INFO -  raptor-perftest Info: test uses playback tool: mitmproxy
[task 2020-10-09T10:34:43.637Z] 10:34:43     INFO -  raptor-mitmproxy Info: mitmproxy was not provided with a 'playback_binary_manifest' Using default playback_binary_manifest
[task 2020-10-09T10:34:43.637Z] 10:34:43     INFO -  raptor-mitmproxy Info: mozproxy_dir used for mitmproxy downloads and exe files: C:\Users\task_1602226217\testing\mozproxy
[task 2020-10-09T10:34:43.638Z] 10:34:43     INFO -  raptor-mitmproxy Info: Playback tool: mitmproxy
[task 2020-10-09T10:34:43.638Z] 10:34:43     INFO -  raptor-mitmproxy Info: Playback tool version: 5.1.1
[task 2020-10-09T10:34:43.638Z] 10:34:43     INFO -  raptor-mitmproxy Info: create mitmproxy 5.1.1 dir
[task 2020-10-09T10:34:43.638Z] 10:34:43     INFO -  raptor-mitmproxy Info: downloading mitmproxy binary
[task 2020-10-09T10:34:43.761Z] 10:34:43     INFO -  raptor-mitmproxy Info: INFO - File mitmproxy-5.1.1-windows.zip retrieved from local cache C:\builds\tooltool_cache
[task 2020-10-09T10:34:43.800Z] 10:34:43     INFO -  raptor-mitmproxy Info: INFO - unzipping "mitmproxy-5.1.1-windows.zip"
[task 2020-10-09T10:34:43.860Z] 10:34:43     INFO -  raptor-mitmproxy Info: downloading mitmproxy pageset
[task 2020-10-09T10:34:43.942Z] 10:34:43     INFO -  raptor-mitmproxy Info: INFO - File mitm5-linux-firefox-yahoo-mail.zip not present in local cache folder C:\builds\tooltool_cache
[task 2020-10-09T10:34:43.942Z] 10:34:43     INFO -  raptor-mitmproxy Info: INFO - Attempting to fetch from 'https://tooltool.mozilla-releng.net/'...
[task 2020-10-09T10:35:05.149Z] 10:35:05     INFO -  raptor-mitmproxy Info: INFO - ...failed to fetch 'mitm5-linux-firefox-yahoo-mail.zip' from https://tooltool.mozilla-releng.net/
[task 2020-10-09T10:35:05.149Z] 10:35:05    ERROR -  raptor-mitmproxy Info: Traceback (most recent call last):
[task 2020-10-09T10:35:05.149Z] 10:35:05     INFO -  raptor-mitmproxy Info:   File "C:\Users\task_1602226217\mozharness\external_tools\tooltool.py", line 846, in fetch_file
[task 2020-10-09T10:35:05.149Z] 10:35:05     INFO -  raptor-mitmproxy Info:     with request(url, auth_file) as f, open(temp_path, mode='wb') as out:
[task 2020-10-09T10:35:05.149Z] 10:35:05     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\contextlib.py", line 17, in __enter__
[task 2020-10-09T10:35:05.149Z] 10:35:05     INFO -  raptor-mitmproxy Info:     return self.gen.next()
[task 2020-10-09T10:35:05.150Z] 10:35:05     INFO -  raptor-mitmproxy Info:   File "C:\Users\task_1602226217\mozharness\external_tools\tooltool.py", line 824, in request
[task 2020-10-09T10:35:05.150Z] 10:35:05     INFO -  raptor-mitmproxy Info:     with closing(urllib2.urlopen(req)) as f:
[task 2020-10-09T10:35:05.150Z] 10:35:05     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 154, in urlopen
[task 2020-10-09T10:35:05.150Z] 10:35:05     INFO -  raptor-mitmproxy Info:     return opener.open(url, data, timeout)
[task 2020-10-09T10:35:05.150Z] 10:35:05     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 429, in open
[task 2020-10-09T10:35:05.150Z] 10:35:05     INFO -  raptor-mitmproxy Info:     response = self._open(req, data)
[task 2020-10-09T10:35:05.150Z] 10:35:05     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 447, in _open
[task 2020-10-09T10:35:05.151Z] 10:35:05     INFO -  raptor-mitmproxy Info:     '_open', req)
[task 2020-10-09T10:35:05.151Z] 10:35:05     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 407, in _call_chain
[task 2020-10-09T10:35:05.151Z] 10:35:05     INFO -  raptor-mitmproxy Info:     result = func(*args)
[task 2020-10-09T10:35:05.151Z] 10:35:05     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 1241, in https_open
[task 2020-10-09T10:35:05.151Z] 10:35:05     INFO -  raptor-mitmproxy Info:     context=self._context)
[task 2020-10-09T10:35:05.151Z] 10:35:05     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 1198, in do_open
[task 2020-10-09T10:35:05.151Z] 10:35:05     INFO -  raptor-mitmproxy Info:     raise URLError(err)
[task 2020-10-09T10:35:05.152Z] 10:35:05     INFO -  raptor-mitmproxy Info: URLError: <urlopen error [Errno 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond>
[task 2020-10-09T10:35:05.152Z] 10:35:05     INFO -  raptor-mitmproxy Info: ERROR - The following files failed: 'mitm5-linux-firefox-yahoo-mail.zip'
[task 2020-10-09T10:35:05.188Z] 10:35:05 CRITICAL -  raptor-mitmproxy Critical: [chrome] Error while downloading C:\Users\task_1602226217\build\tests\raptor\raptor\tooltool-manifests\playback\mitm5-linux-firefox-yahoo-mail.manifest from tooltool:Command failed
[task 2020-10-09T10:35:07.899Z] 10:35:07     INFO -  raptor-mitmproxy Info: INFO - File mitm5-linux-firefox-yahoo-mail.zip not present in local cache folder C:\builds\tooltool_cache
[task 2020-10-09T10:35:07.899Z] 10:35:07     INFO -  raptor-mitmproxy Info: INFO - Attempting to fetch from 'https://tooltool.mozilla-releng.net/'...
[task 2020-10-09T10:35:29.093Z] 10:35:29     INFO -  raptor-mitmproxy Info: INFO - ...failed to fetch 'mitm5-linux-firefox-yahoo-mail.zip' from https://tooltool.mozilla-releng.net/
[task 2020-10-09T10:35:29.093Z] 10:35:29    ERROR -  raptor-mitmproxy Info: Traceback (most recent call last):
[task 2020-10-09T10:35:29.093Z] 10:35:29     INFO -  raptor-mitmproxy Info:   File "C:\Users\task_1602226217\mozharness\external_tools\tooltool.py", line 846, in fetch_file
[task 2020-10-09T10:35:29.093Z] 10:35:29     INFO -  raptor-mitmproxy Info:     with request(url, auth_file) as f, open(temp_path, mode='wb') as out:
[task 2020-10-09T10:35:29.093Z] 10:35:29     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\contextlib.py", line 17, in __enter__
[task 2020-10-09T10:35:29.093Z] 10:35:29     INFO -  raptor-mitmproxy Info:     return self.gen.next()
[task 2020-10-09T10:35:29.093Z] 10:35:29     INFO -  raptor-mitmproxy Info:   File "C:\Users\task_1602226217\mozharness\external_tools\tooltool.py", line 824, in request
[task 2020-10-09T10:35:29.094Z] 10:35:29     INFO -  raptor-mitmproxy Info:     with closing(urllib2.urlopen(req)) as f:
task 2020-10-09T10:35:29.094Z] 10:35:29     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 154, in urlopen
[task 2020-10-09T10:35:29.094Z] 10:35:29     INFO -  raptor-mitmproxy Info:     return opener.open(url, data, timeout)
[task 2020-10-09T10:35:29.094Z] 10:35:29     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 429, in open
[task 2020-10-09T10:35:29.094Z] 10:35:29     INFO -  raptor-mitmproxy Info:     response = self._open(req, data)
[task 2020-10-09T10:35:29.094Z] 10:35:29     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 447, in _open
[task 2020-10-09T10:35:29.094Z] 10:35:29     INFO -  raptor-mitmproxy Info:     '_open', req)
[task 2020-10-09T10:35:29.094Z] 10:35:29     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 407, in _call_chain
[task 2020-10-09T10:35:29.094Z] 10:35:29     INFO -  raptor-mitmproxy Info:     result = func(*args)
[task 2020-10-09T10:35:29.094Z] 10:35:29     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 1241, in https_open
[task 2020-10-09T10:35:29.094Z] 10:35:29     INFO -  raptor-mitmproxy Info:     context=self._context)
[task 2020-10-09T10:35:29.094Z] 10:35:29     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 1198, in do_open
[task 2020-10-09T10:35:29.095Z] 10:35:29     INFO -  raptor-mitmproxy Info:     raise URLError(err)
[task 2020-10-09T10:35:29.095Z] 10:35:29     INFO -  raptor-mitmproxy Info: URLError: <urlopen error [Errno 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond>
[task 2020-10-09T10:35:29.095Z] 10:35:29     INFO -  raptor-mitmproxy Info: ERROR - The following files failed: 'mitm5-linux-firefox-yahoo-mail.zip'
[task 2020-10-09T10:35:29.145Z] 10:35:29 CRITICAL -  raptor-mitmproxy Critical: [chrome] Error while downloading C:\Users\task_1602226217\build\tests\raptor\raptor\tooltool-manifests\playback\mitm5-linux-firefox-yahoo-mail.manifest from tooltool:Command failed
[task 2020-10-09T10:35:31.691Z] 10:35:31     INFO -  raptor-mitmproxy Info: INFO - File mitm5-linux-firefox-yahoo-mail.zip not present in local cache folder C:\builds\tooltool_cache
[task 2020-10-09T10:35:31.693Z] 10:35:31     INFO -  raptor-mitmproxy Info: INFO - Attempting to fetch from 'https://tooltool.mozilla-releng.net/'...
[task 2020-10-09T10:35:53.007Z] 10:35:53     INFO -  raptor-mitmproxy Info: INFO - ...failed to fetch 'mitm5-linux-firefox-yahoo-mail.zip' from https://tooltool.mozilla-releng.net/
[task 2020-10-09T10:35:53.007Z] 10:35:53    ERROR -  raptor-mitmproxy Info: Traceback (most recent call last):
[task 2020-10-09T10:35:53.007Z] 10:35:53     INFO -  raptor-mitmproxy Info:   File "C:\Users\task_1602226217\mozharness\external_tools\tooltool.py", line 846, in fetch_file
[task 2020-10-09T10:35:53.007Z] 10:35:53     INFO -  raptor-mitmproxy Info:     with request(url, auth_file) as f, open(temp_path, mode='wb') as out:
[task 2020-10-09T10:35:53.007Z] 10:35:53     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\contextlib.py", line 17, in __enter__
[task 2020-10-09T10:35:53.007Z] 10:35:53     INFO -  raptor-mitmproxy Info:     return self.gen.next()
[task 2020-10-09T10:35:53.007Z] 10:35:53     INFO -  raptor-mitmproxy Info:   File "C:\Users\task_1602226217\mozharness\external_tools\tooltool.py", line 824, in request
[task 2020-10-09T10:35:53.008Z] 10:35:53     INFO -  raptor-mitmproxy Info:     with closing(urllib2.urlopen(req)) as f:
[task 2020-10-09T10:35:53.008Z] 10:35:53     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 154, in urlopen
[task 2020-10-09T10:35:53.008Z] 10:35:53     INFO -  raptor-mitmproxy Info:     return opener.open(url, data, timeout)
[task 2020-10-09T10:35:53.008Z] 10:35:53     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 429, in open
[task 2020-10-09T10:35:53.008Z] 10:35:53     INFO -  raptor-mitmproxy Info:     response = self._open(req, data)
[task 2020-10-09T10:35:53.008Z] 10:35:53     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 447, in _open
[task 2020-10-09T10:35:53.008Z] 10:35:53     INFO -  raptor-mitmproxy Info:     '_open', req)
[task 2020-10-09T10:35:53.008Z] 10:35:53     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 407, in _call_chain
[task 2020-10-09T10:35:53.009Z] 10:35:53     INFO -  raptor-mitmproxy Info:     result = func(*args)
[task 2020-10-09T10:35:53.009Z] 10:35:53     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 1241, in https_open
[task 2020-10-09T10:35:53.009Z] 10:35:53     INFO -  raptor-mitmproxy Info:     context=self._context)
[task 2020-10-09T10:35:53.009Z] 10:35:53     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\urllib2.py", line 1198, in do_open
[task 2020-10-09T10:35:53.009Z] 10:35:53     INFO -  raptor-mitmproxy Info:     raise URLError(err)
[task 2020-10-09T10:35:53.009Z] 10:35:53     INFO -  raptor-mitmproxy Info: URLError: <urlopen error [Errno 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond>
[task 2020-10-09T10:35:53.009Z] 10:35:53     INFO -  raptor-mitmproxy Info: ERROR - The following files failed: 'mitm5-linux-firefox-yahoo-mail.zip'
[task 2020-10-09T10:35:53.037Z] 10:35:53 CRITICAL -  raptor-mitmproxy Critical: [chrome] Error while downloading C:\Users\task_1602226217\build\tests\raptor\raptor\tooltool-manifests\playback\mitm5-linux-firefox-yahoo-mail.manifest from tooltool:Command failed
[task 2020-10-09T10:35:56.820Z] 10:35:56     INFO -  raptor-mitmproxy Info: INFO - File mitm5-linux-firefox-yahoo-mail.zip not present in local cache folder C:\builds\tooltool_cache
[task 2020-10-09T10:35:56.820Z] 10:35:56     INFO -  raptor-mitmproxy Info: INFO - Attempting to fetch from 'https://tooltool.mozilla-releng.net/'...
[task 2020-10-09T10:36:18.151Z] 10:36:18     INFO -  raptor-mitmproxy Info: INFO - ...failed to fetch 'mitm5-linux-firefox-yahoo-mail.zip' from https://tooltool.mozilla-releng.net/
[task 2020-10-09T10:36:18.151Z] 10:36:18    ERROR -  raptor-mitmproxy Info: Traceback (most recent call last):
[task 2020-10-09T10:36:18.151Z] 10:36:18     INFO -  raptor-mitmproxy Info:   File "C:\Users\task_1602226217\mozharness\external_tools\tooltool.py", line 846, in fetch_file
[task 2020-10-09T10:36:18.151Z] 10:36:18     INFO -  raptor-mitmproxy Info:     with request(url, auth_file) as f, open(temp_path, mode='wb') as out:
[task 2020-10-09T10:36:18.151Z] 10:36:18     INFO -  raptor-mitmproxy Info:   File "c:\mozilla-build\python\lib\contextlib.py", line 17, in __enter__
[task 2020-10-09T10:36:18.151Z] 10:36:18     INFO -  raptor-mitmproxy Info:     return self.gen.next()
Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → INCOMPLETE
Summary: Intermittent raptor-mitmproxy Critical: [chrome] Error while downloading C:\Users\task_1602226217\build\tests\raptor\raptor\tooltool-manifests\playback\mitm5-linux-firefox-yahoo-mail.manifest from tooltool:Command failed → Intermittent raptor-mitmproxy Critical: [chrome] Error while downloading C:\Users\task\build\tests\raptor\raptor\tooltool-manifests\<anything>.manifest from tooltool:Command failed
Status: RESOLVED → REOPENED
Resolution: INCOMPLETE → ---
Status: REOPENED → RESOLVED
Closed: 4 years ago4 years ago
Resolution: --- → INCOMPLETE
You need to log in before you can comment on or make changes to this bug.