If you think a bug might affect users in the 57 release, please set the correct tracking and status flags for Release Management.

buildbot-configs_tests failing on Jenkins due to problem with pip install of master-pip.txt

RESOLVED FIXED

Status

Release Engineering
General
RESOLVED FIXED
3 years ago
4 months ago

People

(Reporter: pmoore, Unassigned)

Tracking

Firefox Tracking Flags

(Not tracked)

Details

(URL)

(Reporter)

Description

3 years ago
This is a strange one.

http://10.134.48.37:8080/job/buildbot-configs_tests/ has started failing.

I created a virtualenv locally, and managed to get failure too:
http://people.mozilla.org/~pmoore/pip.log

This appears to be this bug, which was fixed 4 years ago:
https://twistedmatrix.com/trac/ticket/4652

Since master-pip has not been updated for months, and the versions in there are frozen anyway, I suspect an old version of Twisted has somehow been deployed with the version number 10.1.0 by mistake on the remote pypi or our local pypi hosting site.

I will investigate further - please note above I am joining a lot of dots, I could have reached a very wrong conclusion.

I also need to check if the error on jenkins is identical to the one I had myself on my mac. Also I suspect jenkins is hosted on linux, where as my local clang issue could be OS specific.
(Reporter)

Comment 1

3 years ago
To be explicit:

I locally ran the following, to get the log file I link to above:

pip install -r buildbot-configs/master-pip.txt
The actual error is (we don't use clang):

  Running setup.py install for pyOpenSSL
    Running command /var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/bin/python -c "import setuptools;__file__='/var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/build/pyOpenSSL/setup.py';exec(compile(open(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --single-version-externally-managed --record /tmp/pip-QwnLaz-record/install-record.txt --install-headers /var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/include/site/python2.7
    /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'zip_safe'
      warnings.warn(msg)
    usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
       or: -c --help [cmd1 cmd2 ...]
       or: -c --help-commands
       or: -c cmd --help
    
    error: option --single-version-externally-managed not recognized
    Complete output from command /var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/bin/python -c "import setuptools;__file__='/var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/build/pyOpenSSL/setup.py';exec(compile(open(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --single-version-externally-managed --record /tmp/pip-QwnLaz-record/install-record.txt --install-headers /var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/include/site/python2.7:
    /usr/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown distribution option: 'zip_safe'

  warnings.warn(msg)

usage: -c [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]

   or: -c --help [cmd1 cmd2 ...]

   or: -c --help-commands

   or: -c cmd --help



error: option --single-version-externally-managed not recognized

----------------------------------------
  Rolling back uninstall of pyOpenSSL
  Replacing /var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/lib/python2.7/site-packages/OpenSSL
  Replacing /var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/lib/python2.7/site-packages/pyOpenSSL-0.14-py2.7.egg-info
Command /var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/bin/python -c "import setuptools;__file__='/var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/build/pyOpenSSL/setup.py';exec(compile(open(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --single-version-externally-managed --record /tmp/pip-QwnLaz-record/install-record.txt --install-headers /var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/include/site/python2.7 failed with error code 1 in /var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/build/pyOpenSSL

Exception information:
Traceback (most recent call last):
  File "/var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/local/lib/python2.7/site-packages/pip-1.1-py2.7.egg/pip/basecommand.py", line 104, in main
    status = self.run(options, args)
  File "/var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/local/lib/python2.7/site-packages/pip-1.1-py2.7.egg/pip/commands/install.py", line 250, in run
    requirement_set.install(install_options, global_options)
  File "/var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/local/lib/python2.7/site-packages/pip-1.1-py2.7.egg/pip/req.py", line 1133, in install
    requirement.install(install_options, global_options)
  File "/var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/local/lib/python2.7/site-packages/pip-1.1-py2.7.egg/pip/req.py", line 577, in install
    cwd=self.source_dir, filter_stdout=self._filter_install, show_stdout=False)
  File "/var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/local/lib/python2.7/site-packages/pip-1.1-py2.7.egg/pip/__init__.py", line 256, in call_subprocess
    % (command_desc, proc.returncode, cwd))
InstallationError: Command /var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/bin/python -c "import setuptools;__file__='/var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/build/pyOpenSSL/setup.py';exec(compile(open(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --single-version-externally-managed --record /tmp/pip-QwnLaz-record/install-record.txt --install-headers /var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/include/site/python2.7 failed with error code 1 in /var/lib/jenkins/jobs/buildbot-configs_tests/workspace/.pyenv/build/pyOpenSSL
(from /var/lib/jenkins/.pip/pip.log)
I replaced the "pip install --quiet -U pyOpenSSL" line with "pip install --quiet pyOpenSSL==0.14"  and deleted the old venv.

Requested a new build.
worked!
Status: NEW → RESOLVED
Last Resolved: 3 years ago
Resolution: --- → FIXED
(Assignee)

Updated

4 months ago
Component: Tools → General
Product: Release Engineering → Release Engineering
You need to log in before you can comment on or make changes to this bug.