645012 - Buildslave virtualenv install failing

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Dustin J. Mitchell [:dustin] (he/him)]

notice: //Node[talos-r3-fed-002.build.mozilla.org]/talosslave/talos_fedora/buildslave::install/Buildslave::Install::Version[0.8.4-pre-moz1]/Python::Virtualenv[/tools/buildbot-0.8.4-pre-moz1]/Exec[virtualenv /tools/buildbot-0.8.4-pre-moz1]/returns: Already using interpreter /usr/bin/python
err: //Node[talos-r3-fed-002.build.mozilla.org]/talosslave/talos_fedora/buildslave::install/Buildslave::Install::Version[0.8.4-pre-moz1]/Python::Virtualenv[/tools/buildbot-0.8.4-pre-moz1]/Exec[virtualenv /tools/buildbot-0.8.4-pre-moz1]/returns: change from notrun to 0 failed: /usr/bin/python /tools/misc-python/virtualenv.py                             --python=/usr/bin/python --distribute /tools/buildbot-0.8.4-pre-moz1 returned 1 instead of 0 at /etc/puppet/modules/python/manifests/virtualenv.pp:123

I haven't figured out what triggers this, since it's works in "most" places.  Deleting the directory and letting puppet run again fixes it, suggesting that this is a consequence of my development work on this system.

Comment 1

[Dustin J. Mitchell [:dustin] (he/him)]

Puppet is lying to me - this is the error:

[root@talos-r3-fed-002 ~]# /usr/bin/python /tools/misc-python/virtualenv.py                             --python=/usr/bin/python --distribute /tools/buildbot-0.8.4-pre-moz1
Already using interpreter /usr/bin/python
Traceback (most recent call last):
  File "/tools/misc-python/virtualenv.py", line 1647, in <module>
    main()
  File "/tools/misc-python/virtualenv.py", line 558, in main
    prompt=options.prompt)
  File "/tools/misc-python/virtualenv.py", line 647, in create_environment
    site_packages=site_packages, clear=clear))
  File "/tools/misc-python/virtualenv.py", line 751, in install_python
    fix_lib64(lib_dir)
  File "/tools/misc-python/virtualenv.py", line 1001, in fix_lib64
    if [p for p in distutils.sysconfig.get_config_vars().values()
  File "/usr/lib/python2.6/distutils/sysconfig.py", line 514, in get_config_vars
    func()
  File "/usr/lib/python2.6/distutils/sysconfig.py", line 371, in _init_posix
    raise DistutilsPlatformError(my_msg)
distutils.errors.DistutilsPlatformError: invalid Python installation: unable to open /usr/lib/python2.6/config/Makefile (No such file or directory)

which is because python-devel is not installed.  I was under the impression this was only missing on talos-r3-fed64-NNN, but perhaps that was incorrect.

Comment 2

[Dustin J. Mitchell [:dustin] (he/him)]

Fixing this will involve a new RPM:
 http://download.fedora.redhat.com/pub/archive/fedora/linux/releases/12/Everything/i386/os/Packages/python-devel-2.6.2-2.fc12.i686.rpm

Comment 3

[Dustin J. Mitchell [:dustin] (he/him)]

Attachment: m645012-puppet-manifests-r1.patch

The fix is in: install python-devel on all fedora platforms, and make that a prerequisite to any virtualenv installs.

Comment 4

[Dustin J. Mitchell [:dustin] (he/him)]

Comment on attachment 521841 [details] [diff] [review]
m645012-puppet-manifests-r1.patch

checked in, new RPM deployed to all puppet servers