Closed
Bug 1452179
Opened 6 years ago
Closed 6 years ago
Download failures: Could not install python package: /Users/cltbld/tasks/task_1523030156/build/venv/bin/pip install --timeout 120 --no-index jsonschema==2.5.1 failed after 5 tries!
Categories
(Release Engineering :: General, defect, P5)
Release Engineering
General
Tracking
(Not tracked)
RESOLVED
WORKSFORME
People
(Reporter: intermittent-bug-filer, Unassigned)
References
Details
(Whiteboard: [stockwell infra])
Attachments
(9 files)
45 bytes,
text/x-phabricator-request
|
nthomas
:
review+
|
Details | Review |
45 bytes,
text/x-phabricator-request
|
bhearsum
:
review+
|
Details | Review |
45 bytes,
text/x-phabricator-request
|
bhearsum
:
review+
|
Details | Review |
45 bytes,
text/x-phabricator-request
|
bhearsum
:
review+
|
Details | Review |
45 bytes,
text/x-phabricator-request
|
Details | Review | |
45 bytes,
text/x-phabricator-request
|
Details | Review | |
45 bytes,
text/x-phabricator-request
|
bhearsum
:
review+
|
Details | Review |
46 bytes,
text/x-phabricator-request
|
bhearsum
:
review+
|
Details | Review |
46 bytes,
text/x-phabricator-request
|
bhearsum
:
review+
|
Details | Review |
Filed by: ebalazs [at] mozilla.com https://treeherder.mozilla.org/logviewer.html#?job_id=172340306&repo=autoland https://queue.taskcluster.net/v1/task/bVdcHcTHRd6WakD9WUJZDQ/runs/0/artifacts/public/logs/live_backing.log
Comment 1•6 years ago
|
||
10:20:32 INFO - Ignoring indexes: https://pypi.python.org/simple 10:20:32 INFO - Collecting jsonschema==2.5.1 10:20:34 INFO - Retrying (Retry(total=4, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.HTTPConnection object at 0x10b0d2550>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)': /pub 10:20:34 INFO - Retrying (Retry(total=3, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.HTTPConnection object at 0x10b0d2710>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)': /pub 10:20:35 INFO - Retrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.HTTPConnection object at 0x10b0d2890>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)': /pub 10:20:37 INFO - Retrying (Retry(total=1, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.HTTPConnection object at 0x10b0d2a10>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)': /pub 10:20:41 INFO - Retrying (Retry(total=0, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.HTTPConnection object at 0x10b0d2b90>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)': /pub 10:20:42 INFO - Retrying (Retry(total=4, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.HTTPConnection object at 0x10b0d2610>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)': /pub 10:20:43 INFO - Retrying (Retry(total=3, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.HTTPConnection object at 0x10b0d29d0>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)': /pub 10:20:44 INFO - Retrying (Retry(total=2, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.HTTPConnection object at 0x10b0d2a90>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)': /pub 10:20:46 INFO - Retrying (Retry(total=1, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.HTTPConnection object at 0x10b0d2750>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)': /pub 10:20:50 INFO - Retrying (Retry(total=0, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.HTTPConnection object at 0x10b0d2e50>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',)': /pub 10:20:50 INFO - Could not find a version that satisfies the requirement jsonschema==2.5.1 (from versions: ) 10:20:50 INFO - No matching distribution found for jsonschema==2.5.1 10:20:50 WARNING - Return code: 1 10:20:50 FATAL - Could not install python package: /Users/cltbld/tasks/task_1523030156/build/venv/bin/pip install --timeout 120 --no-index jsonschema==2.5.1 failed after 5 tries! 10:20:50 FATAL - Running post_fatal callback... 10:20:50 FATAL - Exiting -1 10:20:50 INFO - Running post-action listener: _resource_record_post_action 10:20:50 INFO - Running post-action listener: _start_resource_monitoring 10:20:50 WARNING - Unable to start resource monitor: Traceback (most recent call last): 10:20:50 WARNING - File "/Users/cltbld/tasks/task_1523030156/mozharness/mozharness/base/python.py", line 515, in _start_resource_monitoring 10:20:50 WARNING - from mozsystemmonitor.resourcemonitor import SystemResourceMonitor 10:20:50 WARNING - ImportError: No module named mozsystemmonitor.resourcemonitor 10:20:50 INFO - [mozharness: 2018-04-06 17:20:50.100132Z] Finished create-virtualenv step (failed) 10:20:50 INFO - Running post-run listener: _resource_record_post_run 10:20:50 INFO - Running post-run listener: _upload_blobber_files 10:20:50 WARNING - Blob upload gear skipped. Missing cmdline options. 10:20:50 INFO - Running post-run listener: copy_logs_to_upload_dir 10:20:50 INFO - Copying logs to upload dir... 10:20:50 INFO - mkdir: /Users/cltbld/tasks/task_1523030156/build/upload/logs [taskcluster 2018-04-06T17:20:50.129Z] Exit Code: 255
Comment 2•6 years ago
|
||
It's frequent and across platforms. Trees are closed for this.
Severity: normal → blocker
Product: Firefox → Taskcluster
Updated•6 years ago
|
Component: General → General Automation
Product: Taskcluster → Release Engineering
QA Contact: catlee
Comment 3•6 years ago
|
||
Comment hidden (Intermittent Failures Robot) |
Updated•6 years ago
|
Whiteboard: [stockwell disable-recommended] → [stockwell infra]
Comment hidden (Intermittent Failures Robot) |
Comment 6•6 years ago
|
||
Comment 7•6 years ago
|
||
Comment on attachment 8965787 [details] Bug 1452179: Default to only using internal pypi; r=nthomas Nick Thomas [:nthomas] (UTC+13) has approved the revision. https://phabricator.services.mozilla.com/D873
Attachment #8965787 -
Flags: review+
Updated•6 years ago
|
Attachment #8965787 -
Attachment description: Bug 1452179: Default to only using internal pypi. → Bug 1452179: Default to only using internal pypi; r=nthomas
Updated•6 years ago
|
Keywords: leave-open
Pushed by mozilla@hocat.ca: https://hg.mozilla.org/mozilla-central/rev/88e916621af9 Default to only using internal pypi; r=nthomas
Comment hidden (Intermittent Failures Robot) |
Comment 10•6 years ago
|
||
We now vendor pip via the vendored copy of virtualenv. Stop trying to install a specific version of pip elsewhere, particularly stop downgrading it.
Comment 11•6 years ago
|
||
Comment on attachment 8968535 [details] Bug 1452179: Stop pinning pip; r=bhearsum Ben Hearsum (:bhearsum) has approved the revision. https://phabricator.services.mozilla.com/D962
Attachment #8968535 -
Flags: review+
Comment 12•6 years ago
|
||
https://hg.mozilla.org/mozilla-central/rev/5ded36cb383d3ccafd9b6c231c5120dcdae196a2
Comment 13•6 years ago
|
||
Pushed by mozilla@hocat.ca: https://hg.mozilla.org/integration/mozilla-inbound/rev/747d0b814dc1 Stop pinning pip; r=bhearsum
Comment 14•6 years ago
|
||
Comment 15•6 years ago
|
||
Backed out for talos failures backout: https://hg.mozilla.org/integration/mozilla-inbound/rev/33d4420119d61139f2cb7ced1cd73ba72efe8cc2 push with failures: https://treeherder.mozilla.org/#/jobs?repo=mozilla-inbound&revision=747d0b814dc1be3e5ac04e080361ab0b0fc034f9&filter-searchStr=talos&group_state=expanded failure log: https://treeherder.mozilla.org/logviewer.html#?job_id=174148761&repo=mozilla-inbound&lineNumber=549 17:31:35 INFO - C:\Users\task_1523985266\build/venv/scripts/python: can't open file 'C:\Users\task_1523985266\build/venv/scripts/easy_install-2.7-script.py': [Errno 2] No such file or directory 17:31:35 WARNING - Return code: 2 17:31:35 FATAL - Could not install python package: C:\Users\task_1523985266\build/venv/scripts/python C:\Users\task_1523985266\build/venv/scripts/easy_install-2.7-script.py --find-links http://pypi.pvt.build.mozilla.org/pub --find-links http://pypi.pub.build.mozilla.org/pub pywin32 failed after 5 tries! 17:31:35 FATAL - Running post_fatal callback... 17:31:35 FATAL - Exiting -1 17:31:35 INFO - Running post-action listener: _resource_record_post_action 17:31:35 INFO - Running post-action listener: _start_resource_monitoring 17:31:35 WARNING - Unable to start resource monitor: Traceback (most recent call last): 17:31:35 WARNING - File "C:\Users\task_1523985266\mozharness\mozharness\base\python.py", line 516, in _start_resource_monitoring 17:31:35 WARNING - from mozsystemmonitor.resourcemonitor import SystemResourceMonitor 17:31:35 WARNING - ImportError: No module named mozsystemmonitor.resourcemonitor 17:31:35 INFO - [mozharness: 2018-04-17 17:31:35.883000Z] Finished create-virtualenv step (failed) 17:31:35 INFO - Running post-run listener: _resource_record_post_run 17:31:35 INFO - Running post-run listener: _upload_blobber_files 17:31:35 WARNING - Blob upload gear skipped. Missing cmdline options. 17:31:35 INFO - Running post-run listener: copy_logs_to_upload_dir 17:31:35 INFO - Copying logs to upload dir... 17:31:35 INFO - mkdir: C:\Users\task_1523985266\build\upload\logs [taskcluster 2018-04-17T17:31:35.942Z] Exit Code: 4294967295 [taskcluster 2018-04-17T17:31:35.942Z] User Time: 15.625ms [taskcluster 2018-04-17T17:31:35.942Z] Kernel Time: 0s [taskcluster 2018-04-17T17:31:35.943Z] Wall Time: 16m54.4399875s [taskcluster 2018-04-17T17:31:35.943Z] Peak Memory: 5005312 [taskcluster 2018-04-17T17:31:35.943Z] Result: FAILED [taskcluster 2018-04-17T17:31:35.943Z] === Task Finished === [taskcluster 2018-04-17T17:31:35.943Z] Task Duration: 16m54.4526571s
Flags: needinfo?(mozilla)
Updated•6 years ago
|
Attachment #8968535 -
Attachment description: Bug 1452179: Stop pinning pip; r?bhearsum → Bug 1452179: Stop pinning pip; r=bhearsum
Comment 16•6 years ago
|
||
New versions of pip don't install entrypoint scripts with a `-script.py` on windows. Instead, just call the bare script name everywhere. On unix-like systems, this uses the shebang; on Windows, this executes the `.exe` wrapper.
Updated•6 years ago
|
Attachment #8968689 -
Attachment description: Bug 1452179: [mozharness] Don't special case the path to mozinstall on windows; r?nthomas → Bug 1452179: [mozharness] Don't special case the path to mozinstall on windows.
Comment 17•6 years ago
|
||
Comment 18•6 years ago
|
||
Pushed by mozilla@hocat.ca: https://hg.mozilla.org/integration/mozilla-inbound/rev/6e6214abf0f2 Stop pinning pip; r=bhearsum https://hg.mozilla.org/integration/mozilla-inbound/rev/bf49dbd6d055 [mozharness] Use `python -m easy_install` to run easy_install; r=bhearsum https://hg.mozilla.org/integration/mozilla-inbound/rev/8bfb70643041 [mozharness] Don't special case the path to mozinstall on windows; r=whimboo https://hg.mozilla.org/integration/mozilla-inbound/rev/5ddb466ecccf [mozharness] Don't set virtualenv_modules in talos, since it is unused; r=whimboo
Updated•6 years ago
|
Flags: needinfo?(mozilla)
Comment 19•6 years ago
|
||
Comment on attachment 8968608 [details] Bug 1452179: [mozharness] Use `python -m easy_install` to run easy_install; r=bhearsum Ben Hearsum (:bhearsum) has approved the revision. https://phabricator.services.mozilla.com/D964
Attachment #8968608 -
Flags: review+
Comment 20•6 years ago
|
||
bugherder |
https://hg.mozilla.org/mozilla-central/rev/6e6214abf0f2 https://hg.mozilla.org/mozilla-central/rev/bf49dbd6d055 https://hg.mozilla.org/mozilla-central/rev/8bfb70643041 https://hg.mozilla.org/mozilla-central/rev/5ddb466ecccf
Updated•6 years ago
|
Attachment #8967055 -
Attachment description: Bug 1452179: Get rid of pip configs when they match the default; r?nthomas → Bug 1452179: [mozharness] Get rid of pip configs when they match the default; r?bhearsum
Comment 21•6 years ago
|
||
Comment 22•6 years ago
|
||
Comment 23•6 years ago
|
||
Comment 24•6 years ago
|
||
Tom, I think I'm missing some context here - can you give me a quick rundown of the patches?
Flags: needinfo?(mozilla)
Comment 25•6 years ago
|
||
We have internal pypi mirrors that we want to use for everything. In https://phabricator.services.mozilla.com/D873 (already landed), I switched the default location to install from to be our internal mirror. The remaining patches get rid of the configs that point to that explicitly, as well as those that point to non-public copy of that. Then, since Bug 1399926 is now resolved, I switched to using https and dropped the code supported installing from non-https sources.
Flags: needinfo?(mozilla)
Comment 26•6 years ago
|
||
Comment on attachment 8969476 [details] Bug 1452179: [mozharness] Get rid of references to private pypi server; r?bhearsum Ben Hearsum (:bhearsum) has approved the revision. https://phabricator.services.mozilla.com/D999
Attachment #8969476 -
Flags: review+
Comment 27•6 years ago
|
||
Comment on attachment 8969477 [details] Bug 1452179: [mozharness] Use https for internal pypi mirror; r?bhearsum Ben Hearsum (:bhearsum) has approved the revision. https://phabricator.services.mozilla.com/D1000
Attachment #8969477 -
Flags: review+
Comment 28•6 years ago
|
||
Comment on attachment 8969478 [details] Bug 1452179: [mozharness] Remove support for installing from inscure python sources; r?bhearsum Ben Hearsum (:bhearsum) has approved the revision. https://phabricator.services.mozilla.com/D1001
Attachment #8969478 -
Flags: review+
Comment 29•6 years ago
|
||
Pushed by mozilla@hocat.ca: https://hg.mozilla.org/integration/mozilla-inbound/rev/8758f6f2e9fb [mozharness] Get rid of pip configs when they match the default; r=bhearsum https://hg.mozilla.org/integration/mozilla-inbound/rev/48284706be22 [mozharness] Get rid of references to private pypi server; r=bhearsum https://hg.mozilla.org/integration/mozilla-inbound/rev/4e9424aae45f [mozharness] Use https for internal pypi mirror; r=bhearsum https://hg.mozilla.org/integration/mozilla-inbound/rev/4f8ee709a28b [mozharness] Remove support for installing from inscure python sources; r=bhearsum
Comment 30•6 years ago
|
||
Comment on attachment 8967055 [details] Bug 1452179: [mozharness] Get rid of pip configs when they match the default; r?bhearsum Ben Hearsum (:bhearsum) has approved the revision. https://phabricator.services.mozilla.com/D911
Attachment #8967055 -
Flags: review+
Comment 31•6 years ago
|
||
bugherder |
https://hg.mozilla.org/mozilla-central/rev/8758f6f2e9fb https://hg.mozilla.org/mozilla-central/rev/48284706be22 https://hg.mozilla.org/mozilla-central/rev/4e9424aae45f https://hg.mozilla.org/mozilla-central/rev/4f8ee709a28b
Comment hidden (Intermittent Failures Robot) |
Comment 33•6 years ago
|
||
:tomprince, this is marked as leave open, is there more work to do here?
Flags: needinfo?(mozilla)
Assignee | ||
Updated•6 years ago
|
Component: General Automation → General
Updated•6 years ago
|
Status: NEW → RESOLVED
Closed: 6 years ago
Resolution: --- → WORKSFORME
Updated•6 years ago
|
Keywords: leave-open
Updated•5 years ago
|
Flags: needinfo?(mozilla)
You need to log in
before you can comment on or make changes to this bug.
Description
•