1459391 - Intermittent distutils.errors.DistutilsError: Could not find suitable distribution for Requirement.parse('vcversioner')

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P5)

Description

[Treeherder Bug Filer]

Filed by: rgurzau [at] mozilla.com

https://treeherder.mozilla.org/logviewer.html#?job_id=177094228&repo=mozilla-inbound

https://queue.taskcluster.net/v1/task/akdL01OXS7OO_BxeTnmTZg/runs/0/artifacts/public/logs/live_backing.log

22:22:23     INFO -  Ignoring indexes: https://pypi.python.org/simple
22:22:24     INFO -  Requirement already satisfied (use --upgrade to upgrade): six==1.10.0 in /Users/cltbld/tasks/task_1525494482/build/venv/lib/python2.7/site-packages (from -r /Users/cltbld/tasks/task_1525494482/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 2))
22:22:24     INFO -  Collecting twisted==10.2.0 (from -r /Users/cltbld/tasks/task_1525494482/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 4))
22:22:26     INFO -    Downloading http://pypi.pvt.build.mozilla.org/pub/Twisted-10.2.0.tar.gz (1.9MB)
22:22:28     INFO -  Collecting txws==0.9.1 (from -r /Users/cltbld/tasks/task_1525494482/build/tests/mochitest/websocketprocessbridge/websocketprocessbridge_requirements.txt (line 7))
22:22:30     INFO -    Downloading http://pypi.pvt.build.mozilla.org/pub/txWS-0.9.1.tar.gz
22:22:31     INFO -      Complete output from command python setup.py egg_info:
22:22:31     INFO -      Download error on https://pypi.python.org/simple/vcversioner/: [SSL: TLSV1_ALERT_PROTOCOL_VERSION] tlsv1 alert protocol version (_ssl.c:590) -- Some packages may not be found!
22:22:31     INFO -      Couldn't find index page for 'vcversioner' (maybe misspelled?)
22:22:31     INFO -      Download error on https://pypi.python.org/simple/: [SSL: TLSV1_ALERT_PROTOCOL_VERSION] tlsv1 alert protocol version (_ssl.c:590) -- Some packages may not be found!
22:22:31     INFO -      No local packages or working download links found for vcversioner
22:22:31    ERROR -      Traceback (most recent call last):
22:22:31     INFO -        File "<string>", line 1, in <module>
22:22:31     INFO -        File "/private/var/folders/0v/d9v62rxd5qzg6bh_rb85871000000w/T/pip-build-KI8DmH/txws/setup.py", line 15, in <module>
22:22:31     INFO -          url="http://github.com/MostAwesomeDude/txWS",
22:22:31     INFO -        File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/core.py", line 111, in setup
22:22:31     INFO -          _setup_distribution = dist = klass(attrs)
22:22:31     INFO -        File "/Users/cltbld/tasks/task_1525494482/build/venv/lib/python2.7/site-packages/setuptools/dist.py", line 348, in __init__
22:22:31     INFO -          self.fetch_build_eggs(attrs['setup_requires'])
22:22:31     INFO -        File "/Users/cltbld/tasks/task_1525494482/build/venv/lib/python2.7/site-packages/setuptools/dist.py", line 394, in fetch_build_eggs
22:22:31     INFO -          replace_conflicting=True,
22:22:31     INFO -        File "/Users/cltbld/tasks/task_1525494482/build/venv/lib/python2.7/site-packages/pkg_resources/__init__.py", line 826, in resolve
22:22:31     INFO -          dist = best[req.key] = env.best_match(req, ws, installer)
22:22:31     INFO -        File "/Users/cltbld/tasks/task_1525494482/build/venv/lib/python2.7/site-packages/pkg_resources/__init__.py", line 1098, in best_match
22:22:31     INFO -          return self.obtain(req, installer)
22:22:31     INFO -        File "/Users/cltbld/tasks/task_1525494482/build/venv/lib/python2.7/site-packages/pkg_resources/__init__.py", line 1110, in obtain
22:22:31     INFO -          return installer(requirement)
22:22:31     INFO -        File "/Users/cltbld/tasks/task_1525494482/build/venv/lib/python2.7/site-packages/setuptools/dist.py", line 461, in fetch_build_egg
22:22:31     INFO -          return cmd.easy_install(req)
22:22:31     INFO -        File "/Users/cltbld/tasks/task_1525494482/build/venv/lib/python2.7/site-packages/setuptools/command/easy_install.py", line 658, in easy_install
22:22:31     INFO -          raise DistutilsError(msg)
22:22:31     INFO -      distutils.errors.DistutilsError: Could not find suitable distribution for Requirement.parse('vcversioner')

Comment 1

[Intermittent Failures Robot]

5 failures in 551 pushes (0.009 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* mozilla-central: 3
* mozilla-inbound: 1
* autoland: 1

Platform breakdown:
* osx-10-10: 4
* macosx64-nightly: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459391&startday=2018-04-30&endday=2018-05-06&tree=trunk

Comment 2

[Intermittent Failures Robot]

28 failures in 107 pushes (0.262 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 10
* mozilla-inbound: 9
* try: 4
* mozilla-central: 4
* mozilla-esr60: 1

Platform breakdown:
* osx-10-10: 23
* macosx64-nightly: 4
* macosx64-devedition: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459391&startday=2018-05-07&endday=2018-05-07&tree=trunk

Comment 3

[Stefan Hindli [:stefan_hindli]]

Over the last 7 days there are 33 failures present on this bug, these happen on macosx64-nightly and OS X 10.10.

Here is the most recent log example: https://treeherder.mozilla.org/logviewer.html#?repo=mozilla-inbound&job_id=177451220&lineNumber=1022

06:50:17    ERROR -      Traceback (most recent call last):
06:50:17     INFO -        File "<string>", line 1, in <module>
06:50:17     INFO -        File "/private/var/folders/0v/d9v62rxd5qzg6bh_rb85871000000w/T/pip-build-adFDca/txws/setup.py", line 15, in <module>
06:50:17     INFO -          url="http://github.com/MostAwesomeDude/txWS",
06:50:17     INFO -        File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/distutils/core.py", line 111, in setup
06:50:17     INFO -          _setup_distribution = dist = klass(attrs)
06:50:17     INFO -        File "/Users/cltbld/tasks/task_1525787289/build/venv/lib/python2.7/site-packages/setuptools/dist.py", line 348, in __init__
06:50:17     INFO -          self.fetch_build_eggs(attrs['setup_requires'])
06:50:17     INFO -        File "/Users/cltbld/tasks/task_1525787289/build/venv/lib/python2.7/site-packages/setuptools/dist.py", line 394, in fetch_build_eggs
06:50:17     INFO -          replace_conflicting=True,
06:50:17     INFO -        File "/Users/cltbld/tasks/task_1525787289/build/venv/lib/python2.7/site-packages/pkg_resources/__init__.py", line 826, in resolve
06:50:17     INFO -          dist = best[req.key] = env.best_match(req, ws, installer)
06:50:17     INFO -        File "/Users/cltbld/tasks/task_1525787289/build/venv/lib/python2.7/site-packages/pkg_resources/__init__.py", line 1098, in best_match
06:50:17     INFO -          return self.obtain(req, installer)
06:50:17     INFO -        File "/Users/cltbld/tasks/task_1525787289/build/venv/lib/python2.7/site-packages/pkg_resources/__init__.py", line 1110, in obtain
06:50:17     INFO -          return installer(requirement)
06:50:17     INFO -        File "/Users/cltbld/tasks/task_1525787289/build/venv/lib/python2.7/site-packages/setuptools/dist.py", line 461, in fetch_build_egg
06:50:17     INFO -          return cmd.easy_install(req)
06:50:17     INFO -        File "/Users/cltbld/tasks/task_1525787289/build/venv/lib/python2.7/site-packages/setuptools/command/easy_install.py", line 658, in easy_install
06:50:17     INFO -          raise DistutilsError(msg)
06:50:17     INFO -      distutils.errors.DistutilsError: Could not find suitable distribution for Requirement.parse('vcversioner')

Comment 4

[:dhouse]

This looks like the same problem as bug 1449350 where pip fails to find the dependency "six" for txws.

I tried manually installing txws from  pypi.pvt.build.mozilla.org, and I get the same failure.
If I install vcversioner before txws, then txws installs without problems.
```
(test_pip)[[e-mail] test_pip]# pip install --index-url https://pypi.pvt.build.mozilla.org/pub/simple --extra-index-url https://pypi.python.org/pypi/simple txws
Ignoring indexes: https://pypi.pvt.build.mozilla.org/pub/simple,https://pypi.python.org/pypi/simple
Downloading/unpacking txws
  http://pypi.pvt.build.mozilla.org/pub uses an insecure transport scheme (http). Consider using https if pypi.pvt.build.mozilla.org has it available
  http://pypi.pub.build.mozilla.org/pub uses an insecure transport scheme (http). Consider using https if pypi.pub.build.mozilla.org has it available
  Downloading txWS-0.9.1.tar.gz
  Running setup.py (path:/builds/test_pip/test_pip/build/txws/setup.py) egg_info for package txws
    Couldn't find index page for 'vcversioner' (maybe misspelled?)
    No local packages or download links found for vcversioner
    Traceback (most recent call last):
      File "<string>", line 17, in <module>
      File "/builds/test_pip/test_pip/build/txws/setup.py", line 15, in <module>
        url="http://github.com/MostAwesomeDude/txWS",
      File "/tools/python27/lib/python2.7/distutils/core.py", line 112, in setup
        _setup_distribution = dist = klass(attrs)
      File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/dist.py", line 260, in __init__
      File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/dist.py", line 284, in fetch_build_eggs
      File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/pkg_resources.py", line 563, in resolve
      File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/pkg_resources.py", line 799, in best_match
      File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/pkg_resources.py", line 811, in obtain
      File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/dist.py", line 327, in fetch_build_egg
      File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/command/easy_install.py", line 434, in easy_install
      File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/package_index.py", line 475, in fetch_distribution
    AttributeError: 'NoneType' object has no attribute 'clone'
    Complete output from command python setup.py egg_info:
    Couldn't find index page for 'vcversioner' (maybe misspelled?)

No local packages or download links found for vcversioner

Traceback (most recent call last):

  File "<string>", line 17, in <module>

  File "/builds/test_pip/test_pip/build/txws/setup.py", line 15, in <module>

    url="http://github.com/MostAwesomeDude/txWS",

  File "/tools/python27/lib/python2.7/distutils/core.py", line 112, in setup

    _setup_distribution = dist = klass(attrs)

  File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/dist.py", line 260, in __init__

  File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/dist.py", line 284, in fetch_build_eggs

  File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/pkg_resources.py", line 563, in resolve

  File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/pkg_resources.py", line 799, in best_match

  File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/pkg_resources.py", line 811, in obtain

  File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/dist.py", line 327, in fetch_build_egg

  File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/command/easy_install.py", line 434, in easy_install

  File "/builds/test_pip/test_pip/lib/python2.7/site-packages/setuptools-0.6c11-py2.7.egg/setuptools/package_index.py", line 475, in fetch_distribution

AttributeError: 'NoneType' object has no attribute 'clone'

----------------------------------------
Cleaning up...
Command python setup.py egg_info failed with error code 1 in /builds/test_pip/test_pip/build/txws
Storing debug log for failure in /var/root/.pip/pip.log
```

```
(test_pip)[[e-mail] test_pip]# pip install --index-url https://pypi.pvt.build.mozilla.org/pub/simple --extra-index-url https://pypi.python.org/pypi/simple vcversioner
Ignoring indexes: https://pypi.pvt.build.mozilla.org/pub/simple,https://pypi.python.org/pypi/simple
Downloading/unpacking vcversioner
  http://pypi.pvt.build.mozilla.org/pub uses an insecure transport scheme (http). Consider using https if pypi.pvt.build.mozilla.org has it available
  http://pypi.pub.build.mozilla.org/pub uses an insecure transport scheme (http). Consider using https if pypi.pub.build.mozilla.org has it available
  Downloading vcversioner-2.16.0.0.tar.gz
  Running setup.py (path:/builds/test_pip/test_pip/build/vcversioner/setup.py) egg_info for package vcversioner
    
Installing collected packages: vcversioner
  Running setup.py install for vcversioner
    
Successfully installed vcversioner
Cleaning up...
(test_pip)[[e-mail] test_pip]# pip install --index-url https://pypi.pvt.build.mozilla.org/pub/simple --extra-index-url https://pypi.python.org/pypi/simple txws
Ignoring indexes: https://pypi.pvt.build.mozilla.org/pub/simple,https://pypi.python.org/pypi/simple
Downloading/unpacking txws
  http://pypi.pvt.build.mozilla.org/pub uses an insecure transport scheme (http). Consider using https if pypi.pvt.build.mozilla.org has it available
  http://pypi.pub.build.mozilla.org/pub uses an insecure transport scheme (http). Consider using https if pypi.pub.build.mozilla.org has it available
  Downloading txWS-0.9.1.tar.gz
  Running setup.py (path:/builds/test_pip/test_pip/build/txws/setup.py) egg_info for package txws
    
Installing collected packages: txws
  Running setup.py install for txws
    
Successfully installed txws
Cleaning up...
```

Comment 5

[Intermittent Failures Robot]

28 failures in 82 pushes (0.341 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* try: 12
* autoland: 6
* mozilla-inbound: 5
* mozilla-beta: 3
* mozilla-central: 2

Platform breakdown:
* osx-10-10: 18
* macosx64-devedition: 3
* linux64: 3
* linux32: 2
* macosx64-nightly: 1
* linux64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459391&startday=2018-05-11&endday=2018-05-11&tree=trunk

Comment 6

[Intermittent Failures Robot]

18 failures in 54 pushes (0.333 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* mozilla-inbound: 8
* autoland: 6
* mozilla-central: 4

Platform breakdown:
* osx-10-10: 16
* macosx64-nightly: 2

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459391&startday=2018-05-12&endday=2018-05-12&tree=trunk

Comment 7

[Intermittent Failures Robot]

100 failures in 660 pushes (0.152 failures/push) were associated with this bug in the last 7 days. 

This is the #7 most frequent failure this week. 

** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **

** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **   

Repository breakdown:
* autoland: 32
* mozilla-inbound: 28
* try: 17
* mozilla-central: 14
* mozilla-beta: 7
* mozilla-esr60: 2

Platform breakdown:
* osx-10-10: 77
* macosx64-nightly: 10
* macosx64-devedition: 7
* linux64: 3
* linux32: 2
* linux64-ccov: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459391&startday=2018-05-07&endday=2018-05-13&tree=trunk

Comment 8

[Ryan VanderMeulen [:RyanVM]]

Can we just land Aki's fix everywhere to resolve this?
https://hg.mozilla.org/releases/mozilla-release/rev/db83b4e5d306

Comment 9

[Aki Sasaki (not active)]

Sure.

Comment 10

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/mozilla-inbound/rev/b8db89c1dc0b
Fix intermittent OSX vcversioner install error. r=tomprince

Comment 11

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-release/rev/61c5b7004802

Comment 12

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-esr60/rev/f8098a5cd010

Comment 13

[Cosmin Sabou [:CosminS]]

https://hg.mozilla.org/mozilla-central/rev/b8db89c1dc0b

Comment 14

[Intermittent Failures Robot]

27 failures in 111 pushes (0.243 failures/push) were associated with this bug yesterday.    

Repository breakdown:
* autoland: 12
* mozilla-inbound: 4
* mozilla-central: 4
* try: 2
* mozilla-release: 2
* mozilla-beta: 2
* mozilla-esr60: 1

Platform breakdown:
* osx-10-10: 24
* macosx64-nightly: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459391&startday=2018-05-14&endday=2018-05-14&tree=trunk

Comment 15

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/releases/mozilla-beta/rev/f13605a00c2b

Comment 16

[Intermittent Failures Robot]

27 failures in 639 pushes (0.042 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 12
* mozilla-inbound: 4
* mozilla-central: 4
* try: 2
* mozilla-release: 2
* mozilla-beta: 2
* mozilla-esr60: 1

Platform breakdown:
* osx-10-10: 24
* macosx64-nightly: 3

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459391&startday=2018-05-14&endday=2018-05-20&tree=trunk

Comment 17

[Nick Thomas [:nthomas] (UTC+12)]

https://hg.mozilla.org/releases/mozilla-esr52/rev/a7ced1813d421901f213e238f62e92d31be50037

Comment 18

[Intermittent Failures Robot]

1 failures in 655 pushes (0.002 failures/push) were associated with this bug in the last 7 days.    

Repository breakdown:
* autoland: 1

Platform breakdown:
* linux64: 1

For more details, see:
https://treeherder.mozilla.org/intermittent-failures.html#/bugdetails?bug=1459391&startday=2018-05-28&endday=2018-06-03&tree=trunk