1403730 - Unable to install mozregression on macOS 10.13 due to existing six 1.4.1 installation

Status: RESOLVED INVALID

(Testing :: mozregression, defect)

Description

[Stephen A Pohl [:spohl]]

I just tried installing mozregression as usual on my new macOS 10.13 system. Unfortunately, I hit the following error and I'm unable to proceed. Note that even manually removing, moving or copying the six 1.4.1 files via sudo does not work either ("Operation not permitted").

spohl-44231:~ spohl$ sudo pip2 install -U mozregression
The directory '/Users/spohl/Library/Caches/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
The directory '/Users/spohl/Library/Caches/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
Collecting mozregression
  Downloading mozregression-2.3.17.tar.gz (46kB)
    100% |████████████████████████████████| 51kB 1.1MB/s 
Collecting mozfile==1.2 (from mozregression)
  Downloading mozfile-1.2.tar.gz
Collecting mozprocess==0.25 (from mozregression)
  Downloading mozprocess-0.25-py2-none-any.whl
Collecting mozprofile==0.28 (from mozregression)
  Downloading mozprofile-0.28.tar.gz
Collecting mozrunner==6.13 (from mozregression)
  Downloading mozrunner-6.13-py2-none-any.whl (76kB)
    100% |████████████████████████████████| 81kB 1.5MB/s 
Collecting BeautifulSoup==3.2.1 (from mozregression)
  Downloading BeautifulSoup-3.2.1.tar.gz
Collecting mozinstall==1.12 (from mozregression)
  Downloading mozInstall-1.12.tar.gz
Collecting mozinfo==0.10 (from mozregression)
  Downloading mozinfo-0.10.tar.gz
Collecting mozlog==3.3 (from mozregression)
  Downloading mozlog-3.3-py2-none-any.whl (49kB)
    100% |████████████████████████████████| 51kB 3.3MB/s 
Collecting mozversion==1.4 (from mozregression)
  Downloading mozversion-1.4.tar.gz
Collecting requests[security]==2.15.1 (from mozregression)
  Downloading requests-2.15.1-py2.py3-none-any.whl (558kB)
    100% |████████████████████████████████| 563kB 1.1MB/s 
Collecting redo==1.6 (from mozregression)
  Downloading redo-1.6.tar.gz
Collecting mozdevice==0.50 (from mozregression)
  Downloading mozdevice-0.50.tar.gz (43kB)
    100% |████████████████████████████████| 51kB 3.3MB/s 
Collecting taskcluster==0.3.4 (from mozregression)
  Downloading taskcluster-0.3.4.tar.gz (108kB)
    100% |████████████████████████████████| 112kB 1.8MB/s 
Collecting colorama==0.3.7 (from mozregression)
  Downloading colorama-0.3.7-py2.py3-none-any.whl
Collecting configobj==5.0.6 (from mozregression)
  Downloading configobj-5.0.6.tar.gz
Collecting blessings>=1.3 (from mozlog==3.3->mozregression)
  Downloading blessings-1.6.tar.gz
Collecting idna>=2.0.0; extra == "security" (from requests[security]==2.15.1->mozregression)
  Downloading idna-2.6-py2.py3-none-any.whl (56kB)
    100% |████████████████████████████████| 61kB 4.7MB/s 
Collecting cryptography>=1.3.4; extra == "security" (from requests[security]==2.15.1->mozregression)
  Downloading cryptography-2.0.3-cp27-cp27m-macosx_10_6_intel.whl (1.5MB)
    100% |████████████████████████████████| 1.5MB 715kB/s 
Collecting pyOpenSSL>=0.14; extra == "security" (from requests[security]==2.15.1->mozregression)
  Downloading pyOpenSSL-17.3.0-py2.py3-none-any.whl (51kB)
    100% |████████████████████████████████| 51kB 3.8MB/s 
Collecting moznetwork>=0.24 (from mozdevice==0.50->mozregression)
  Downloading moznetwork-0.27.tar.gz
Collecting mohawk>=0.3.1 (from taskcluster==0.3.4->mozregression)
  Downloading mohawk-0.3.4-py2-none-any.whl
Collecting slugid (from taskcluster==0.3.4->mozregression)
  Downloading slugid-1.0.7.tar.gz
Collecting six (from taskcluster==0.3.4->mozregression)
  Downloading six-1.11.0-py2.py3-none-any.whl
Collecting enum34 (from cryptography>=1.3.4; extra == "security"->requests[security]==2.15.1->mozregression)
  Downloading enum34-1.1.6-py2-none-any.whl
Collecting cffi>=1.7 (from cryptography>=1.3.4; extra == "security"->requests[security]==2.15.1->mozregression)
  Downloading cffi-1.11.0-cp27-cp27m-macosx_10_6_intel.whl (237kB)
    100% |████████████████████████████████| 245kB 1.7MB/s 
Collecting ipaddress (from cryptography>=1.3.4; extra == "security"->requests[security]==2.15.1->mozregression)
  Downloading ipaddress-1.0.18-py2-none-any.whl
Collecting asn1crypto>=0.21.0 (from cryptography>=1.3.4; extra == "security"->requests[security]==2.15.1->mozregression)
  Downloading asn1crypto-0.23.0-py2.py3-none-any.whl (99kB)
    100% |████████████████████████████████| 102kB 8.0MB/s 
Collecting pycparser (from cffi>=1.7->cryptography>=1.3.4; extra == "security"->requests[security]==2.15.1->mozregression)
  Downloading pycparser-2.18.tar.gz (245kB)
    100% |████████████████████████████████| 256kB 2.3MB/s 
Installing collected packages: mozfile, mozinfo, mozprocess, blessings, mozlog, mozprofile, moznetwork, mozdevice, mozrunner, BeautifulSoup, mozinstall, mozversion, idna, six, enum34, pycparser, cffi, ipaddress, asn1crypto, cryptography, pyOpenSSL, requests, redo, mohawk, slugid, taskcluster, colorama, configobj, mozregression
  Running setup.py install for mozfile ... done
  Running setup.py install for mozinfo ... done
  Running setup.py install for blessings ... done
  Running setup.py install for mozprofile ... done
  Running setup.py install for moznetwork ... done
  Running setup.py install for mozdevice ... done
  Running setup.py install for BeautifulSoup ... done
  Running setup.py install for mozinstall ... done
  Running setup.py install for mozversion ... done
  Found existing installation: six 1.4.1
    DEPRECATION: Uninstalling a distutils installed project (six) has been deprecated and will be removed in a future version. This is due to the fact that uninstalling a distutils project will only partially uninstall the project.
    Uninstalling six-1.4.1:
Exception:
Traceback (most recent call last):
  File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/basecommand.py", line 215, in main
    status = self.run(options, args)
  File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/commands/install.py", line 342, in run
    prefix=options.prefix_path,
  File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_set.py", line 778, in install
    requirement.uninstall(auto_confirm=True)
  File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_install.py", line 754, in uninstall
    paths_to_remove.remove(auto_confirm)
  File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/req/req_uninstall.py", line 115, in remove
    renames(path, new_path)
  File "/Library/Python/2.7/site-packages/pip-9.0.1-py2.7.egg/pip/utils/__init__.py", line 267, in renames
    shutil.move(old, new)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 302, in move
    copy2(src, real_dst)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 131, in copy2
    copystat(src, dst)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/shutil.py", line 103, in copystat
    os.chflags(dst, st.st_flags)
OSError: [Errno 1] Operation not permitted: '/tmp/pip-lP_S2_-uninstall/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/six-1.4.1-py2.7.egg-info'

Comment 1

[William Lachance (:wlach)]

Some suggestions here: https://stackoverflow.com/questions/31900008/oserror-errno-1-operation-not-permitted-when-installing-scrapy-in-osx-10-11

Maybe --ignore-installed will do the trick?

To be honest it's much better to install mozregression inside a virtualenv than globally. I haven't updated the instructions yet, because I'm worried that it will cause some non-technical users headaches but it's really pretty straightforward:

virtualenv mozregression-env
source mozregression-env/bin/activate
pip install mozregression

If you need to run mozregression again, just reactivate the virtualenv.

Comment 2

[Stephen A Pohl [:spohl]]

(In reply to William Lachance (:wlach) (use needinfo!) from comment #1)
> Some suggestions here:
> https://stackoverflow.com/questions/31900008/oserror-errno-1-operation-not-
> permitted-when-installing-scrapy-in-osx-10-11
> 
> Maybe --ignore-installed will do the trick?

This worked!

> To be honest it's much better to install mozregression inside a virtualenv
> than globally. I haven't updated the instructions yet, because I'm worried
> that it will cause some non-technical users headaches but it's really pretty
> straightforward:
> 
> virtualenv mozregression-env
> source mozregression-env/bin/activate
> pip install mozregression
> 
> If you need to run mozregression again, just reactivate the virtualenv.

And this worked as well! Thank you!

Comment 3

[William Lachance (:wlach)]

Going to resolve this one, but noting the point that maybe we should figure out better installation stories for mozregression than "install it in your global environment".