Closed Bug 1617642 Opened 4 years ago Closed 4 years ago

pipfile-updates task needs version changes to work cleanly

Categories

(Release Engineering :: General, defect)

Product:
Release Engineering
Component:
General
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(firefox75 fixed)

Status:
RESOLVED FIXED
Tracking Flags:
Tracking Status
firefox75 --- fixed

People

(Reporter: sfraser, Assigned: sfraser)

References

Details

Attachments

(1 file)

Bug 1617642 Remove pip version restriction & force Python 3.8 for funsize r=jlorenzo
47 bytes, text/x-phabricator-request
Details | Review

Version incompatibility with the move to Python 3.8 causes backports.lzma issues:

ERROR: Command errored out with exit status 1:
   command: /home/worker/.local/share/virtualenvs/funsize-update-generator-8-kbVvbZ/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-kwytyvd7/backports.lzma/setup.py'"'"'; __file__='"'"'/tmp/pip-install-kwytyvd7/backports.lzma/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-s8kpjcim
       cwd: /tmp/pip-install-kwytyvd7/backports.lzma/
  Complete output (23 lines):
  This is backports.lzma version 0.0.14
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-3.6
  creating build/lib.linux-x86_64-3.6/backports
  copying backports/__init__.py -> build/lib.linux-x86_64-3.6/backports
  creating build/lib.linux-x86_64-3.6/backports/lzma
  copying backports/lzma/__init__.py -> build/lib.linux-x86_64-3.6/backports/lzma
  warning: build_py: byte-compiling is disabled, skipping.
  
  running build_ext
  building 'backports.lzma._lzma' extension
  creating build/temp.linux-x86_64-3.6
  creating build/temp.linux-x86_64-3.6/backports
  creating build/temp.linux-x86_64-3.6/backports/lzma
  x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/home/worker/.local/share/virtualenvs/funsize-update-generator-8-kbVvbZ/include -I/home/worker/include -I/opt/local/include -I/usr/local/include -I/home/worker/.local/share/virtualenvs/funsize-update-generator-8-kbVvbZ/include -I/usr/include/python3.6m -c backports/lzma/_lzmamodule.c -o build/temp.linux-x86_64-3.6/backports/lzma/_lzmamodule.o
  backports/lzma/_lzmamodule.c:12:10: fatal error: Python.h: No such file or directory
   #include "Python.h"
            ^~~~~~~~~~
  compilation terminated.
  error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
  ----------------------------------------
  ERROR: Failed building wheel for backports.lzma
    ERROR: Command errored out with exit status 1:
     command: /home/worker/.local/share/virtualenvs/funsize-update-generator-8-kbVvbZ/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-kwytyvd7/backports.lzma/setup.py'"'"'; __file__='"'"'/tmp/pip-install-kwytyvd7/backports.lzma/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-xs_s0gqw/install-record.txt --single-version-externally-managed --compile --install-headers /home/worker/.local/share/virtualenvs/funsize-update-generator-8-kbVvbZ/include/site/python3.6/backports.lzma
         cwd: /tmp/pip-install-kwytyvd7/backports.lzma/
    Complete output (23 lines):
    This is backports.lzma version 0.0.14
    running install
    running build
    running build_py
    creating build
    creating build/lib.linux-x86_64-3.6
    creating build/lib.linux-x86_64-3.6/backports
    copying backports/__init__.py -> build/lib.linux-x86_64-3.6/backports
    creating build/lib.linux-x86_64-3.6/backports/lzma
    copying backports/lzma/__init__.py -> build/lib.linux-x86_64-3.6/backports/lzma
    warning: build_py: byte-compiling is disabled, skipping.
    
    running build_ext
    building 'backports.lzma._lzma' extension
    creating build/temp.linux-x86_64-3.6
    creating build/temp.linux-x86_64-3.6/backports
    creating build/temp.linux-x86_64-3.6/backports/lzma
    x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/home/worker/.local/share/virtualenvs/funsize-update-generator-8-kbVvbZ/include -I/home/worker/include -I/opt/local/include -I/usr/local/include -I/home/worker/.local/share/virtualenvs/funsize-update-generator-8-kbVvbZ/include -I/usr/include/python3.6m -c backports/lzma/_lzmamodule.c -o build/temp.linux-x86_64-3.6/backports/lzma/_lzmamodule.o
    backports/lzma/_lzmamodule.c:12:10: fatal error: Python.h: No such file or directory
     #include "Python.h"
              ^~~~~~~~~~
    compilation terminated.
    error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
    ----------------------------------------
ERROR: Command errored out with exit status 1: /home/worker/.local/share/virtualenvs/funsize-update-generator-8-kbVvbZ/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-kwytyvd7/backports.lzma/setup.py'"'"'; __file__='"'"'/tmp/pip-install-kwytyvd7/backports.lzma/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-xs_s0gqw/install-record.txt --single-version-externally-managed --compile --install-headers /home/worker/.local/share/virtualenvs/funsize-update-generator-8-kbVvbZ/include/site/python3.6/backports.lzma Check the logs for full command output.

Closes the loop on Bug 1497162 too

backports.lzma couldn't cleanly be installed because we were now using Python3.8 but hadn't specified that in the Pipfile. Also took the opportunity to remove the pip version restriction which is no longer needed.

Pushed by sfraser@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/0e5de9eade9c
Remove pip version restriction & force Python 3.8 for funsize r=jlorenzo
Backout by shindli@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/425bb9b4969f
Backed out changeset 0e5de9eade9c for causing docker image build bustages CLOSED TREE

hmm, ./mach taskcluster-build-image doesn't report any errors, but it also doesn't build the container. Will fix and repatch.

Flags: needinfo?(sfraser)
Pushed by sfraser@mozilla.com:
https://hg.mozilla.org/integration/autoland/rev/320f84107679
Remove pip version restriction & force Python 3.8 for funsize r=jlorenzo

https://hg.mozilla.org/mozilla-central/rev/320f84107679

Status: NEW → RESOLVED
Closed: 4 years ago
status-firefox75: --- → fixed
Resolution: --- → FIXED
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: