Closed Bug 1641177 Opened 4 years ago Closed 4 years ago

FileNotFoundError: [Errno 2] No such file or directory: <objdir>/_virtualenvs/init_py3/bin/python

Categories

(Firefox Build System :: General, defect)

defect

Tracking

(Not tracked)

RESOLVED INVALID

People

(Reporter: emilio, Unassigned)

References

(Blocks 1 open bug)

Details

On a completely clean tree, I get the following error:

$ ./mach build                                                                                                                                                                             
 0:00.22 Failed to parse ccache stats output: could not write to output file        97
 Config object not found by mach.
 0:00.23 Clobber not needed.
 0:00.23 Adding make options from None
    MOZ_OBJDIR=/home/emilio/src/moz/gecko/obj-x86_64-pc-linux-gnu
    OBJDIR=/home/emilio/src/moz/gecko/obj-x86_64-pc-linux-gnu
 0:00.23 /usr/bin/gmake -f client.mk -s configure
 0:00.23 Generating /home/emilio/src/moz/gecko/configure
 0:00.23 Generating /home/emilio/src/moz/gecko/js/src/configure
 0:00.24 cd /home/emilio/src/moz/gecko/obj-x86_64-pc-linux-gnu
 0:00.24 /home/emilio/src/moz/gecko/configure
 0:00.30 Creating Python 3 environment
 0:00.35 Using base prefix '/usr'
 0:00.35 New python executable in /home/emilio/src/moz/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/init_py3/bin/python3
 0:00.35 Also creating executable in /home/emilio/src/moz/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/init_py3/bin/python
 0:00.74 Installing setuptools, pip, wheel...
 0:02.20 done.
 0:02.46 b"running build_ext\nbuilding 'psutil._psutil_linux' extension\ncreating build\ncreating build/temp.linux-x86_64-3.8\ncreating build/temp.linux-x86_64-3.8/psutil\ngcc -pthread -Wno-unused-result -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_SIZEOF_PID_T=4 -DPSUTIL_VERSION=570 -DPSUTIL_LINUX=1 -I/usr/include/python3.8 -c psutil/_psutil_common.c -o build/temp.linux-x86_64-3.8/psutil/_psutil_common.o\ngcc -pthread -Wno-unused-result -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_SIZEOF_PID_T=4 -DPSUTIL_VERSION=570 -DPSUTIL_LINUX=1 -I/usr/include/python3.8 -c psutil/_psutil_posix.c -o build/temp.linux-x86_64-3.8/psutil/_psutil_posix.o\nIn file included from /usr/include/string.h:495,\n                 from /usr/include/python3.8/Python.h:30,\n                 from psutil/_psutil_posix.c:9:\nIn function \xe2\x80\x98strncpy\xe2\x80\x99,\n    inlined from \xe2\x80\x98psutil_net_if_flags\xe2\x80\x99 at psutil/_psutil_posix.c:401:5:\n/usr/include/bits/string_fortified.h:106:10: warning: \xe2\x80\x98__builtin_strncpy\xe2\x80\x99 specified bound 16 equals destination size [-Wstringop-truncation]\n  106 |   return __builtin___strncpy_chk (__dest, __src, __len, __bos (__dest));\n      |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\nIn function \xe2\x80\x98strncpy\xe2\x80\x99,\n    inlined from \xe2\x80\x98psutil_net_if_mtu\xe2\x80\x99 at psutil/_psutil_posix.c:362:5:\n/usr/include/bits/string_fortified.h:106:10: warning: \xe2\x80\x98__builtin_strncpy\xe2\x80\x99 specified bound 16 equals destination size [-Wstringop-truncation]\n  106 |   return __builtin___strncpy_chk (__dest, __src, __len, __bos (__dest));\n      |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\ngcc -pthread -Wno-unused-result -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_SIZEOF_PID_T=4 -DPSUTIL_VERSION=570 -DPSUTIL_LINUX=1 -I/usr/include/python3.8 -c psutil/_psutil_linux.c -o build/temp.linux-x86_64-3.8/psutil/_psutil_linux.o\nIn file included from /usr/include/string.h:495,\n                 from /usr/include/python3.8/Python.h:30,\n                 from psutil/_psutil_linux.c:12:\nIn function \xe2\x80\x98strncpy\xe2\x80\x99,\n    inlined from \xe2\x80\x98psutil_net_if_duplex_speed\xe2\x80\x99 at psutil/_psutil_linux.c:504:5:\n/usr/include/bits/string_fortified.h:106:10: warning: \xe2\x80\x98__builtin_strncpy\xe2\x80\x99 specified bound 16 equals destination size [-Wstringop-truncation]\n  106 |   return __builtin___strncpy_chk (__dest, __src, __len, __bos (__dest));\n      |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\ncreating build/lib.linux-x86_64-3.8\ncreating build/lib.linux-x86_64-3.8/psutil\ngcc -pthread -shared -Wl,-z,relro -Wl,--as-needed -Wl,-z,now -g -Wl,-z,relro -Wl,--as-needed -Wl,-z,now -g build/temp.linux-x86_64-3.8/psutil/_psutil_common.o build/temp.linux-x86_64-3.8/psutil/_psutil_posix.o build/temp.linux-x86_64-3.8/psutil/_psutil_linux.o -L/usr/lib64 -o build/lib.linux-x86_64-3.8/psutil/_psutil_linux.cpython-38-x86_64-linux-gnu.so\nbuilding 'psutil._psutil_posix' extension\ngcc -pthread -Wno-unused-result -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_SIZEOF_PID_T=4 -DPSUTIL_VERSION=570 -DPSUTIL_LINUX=1 -I/usr/include/python3.8 -c psutil/_psutil_common.c -o build/temp.linux-x86_64-3.8/psutil/_psutil_common.o\ngcc -pthread -Wno-unused-result -Wsign-compare -DDYNAMIC_ANNOTATIONS_ENABLED=1 -DNDEBUG -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection -D_GNU_SOURCE -fPIC -fwrapv -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_SIZEOF_PID_T=4 -DPSUTIL_VERSION=570 -DPSUTIL_LINUX=1 -I/usr/include/python3.8 -c psutil/_psutil_posix.c -o build/temp.linux-x86_64-3.8/psutil/_psutil_posix.o\nIn file included from /usr/include/string.h:495,\n                 from /usr/include/python3.8/Python.h:30,\n                 from psutil/_psutil_posix.c:9:\nIn function \xe2\x80\x98strncpy\xe2\x80\x99,\n    inlined from \xe2\x80\x98psutil_net_if_flags\xe2\x80\x99 at psutil/_psutil_posix.c:401:5:\n/usr/include/bits/string_fortified.h:106:10: warning: \xe2\x80\x98__builtin_strncpy\xe2\x80\x99 specified bound 16 equals destination size [-Wstringop-truncation]\n  106 |   return __builtin___strncpy_chk (__dest, __src, __len, __bos (__dest));\n      |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\nIn function \xe2\x80\x98strncpy\xe2\x80\x99,\n    inlined from \xe2\x80\x98psutil_net_if_mtu\xe2\x80\x99 at psutil/_psutil_posix.c:362:5:\n/usr/include/bits/string_fortified.h:106:10: warning: \xe2\x80\x98__builtin_strncpy\xe2\x80\x99 specified bound 16 equals destination size [-Wstringop-truncation]\n  106 |   return __builtin___strncpy_chk (__dest, __src, __len, __bos (__dest));\n      |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\ngcc -pthread -shared -Wl,-z,relro -Wl,--as-needed -Wl,-z,now -g -Wl,-z,relro -Wl,--as-needed -Wl,-z,now -g build/temp.linux-x86_64-3.8/psutil/_psutil_common.o build/temp.linux-x86_64-3.8/psutil/_psutil_posix.o -L/usr/lib64 -o build/lib.linux-x86_64-3.8/psutil/_psutil_posix.cpython-38-x86_64-linux-gnu.so\ncopying build/lib.linux-x86_64-3.8/psutil/_psutil_linux.cpython-38-x86_64-linux-gnu.so -> psutil\ncopying build/lib.linux-x86_64-3.8/psutil/_psutil_posix.cpython-38-x86_64-linux-gnu.so -> psutil\n"
 0:02.46 Error processing command. Ignoring because optional. (optional:packages.txt:comm/build/virtualenv_packages.txt)
 0:02.46 Re-executing in the virtualenv
 0:02.60 Creating Python 3 environment
 0:02.60 Traceback (most recent call last):
 0:02.60   File "/home/emilio/src/moz/gecko/configure.py", line 181, in <module>
 0:02.60     sys.exit(main(sys.argv))
 0:02.60   File "/home/emilio/src/moz/gecko/configure.py", line 52, in main
 0:02.60     sandbox.run(os.path.join(os.path.dirname(__file__), 'moz.configure'))
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/configure/__init__.py", line 445, in run
 0:02.60     self.include_file(path)
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/configure/__init__.py", line 436, in include_file
 0:02.60     exec_(code, self)
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/util.py", line 53, in exec_
 0:02.60     exec(object, globals, locals)
 0:02.60   File "/home/emilio/src/moz/gecko/moz.configure", line 7, in <module>
 0:02.60     include('build/moz.configure/init.configure')
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/configure/__init__.py", line 773, in include_impl
 0:02.60     self.include_file(what)
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/configure/__init__.py", line 436, in include_file
 0:02.60     exec_(code, self)
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/util.py", line 53, in exec_
 0:02.60     exec(object, globals, locals)
 0:02.60   File "/home/emilio/src/moz/gecko/build/moz.configure/init.configure", line 254, in <module>
 0:02.60     def virtualenv_python3(env_python, build_env, mozconfig, help):
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/configure/__init__.py", line 756, in decorator
 0:02.60     depends = DependsFunction(self, func, dependencies, when=when)
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/configure/__init__.py", line 129, in __init__
 0:02.60     sandbox._value_for(self)
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/configure/__init__.py", line 542, in _value_for
 0:02.60     return self._value_for_depends(obj)
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/util.py", line 1018, in method_call
 0:02.60     cache[args] = self.func(instance, *args)
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/configure/__init__.py", line 551, in _value_for_depends
 0:02.60     value = obj.result()
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/util.py", line 1018, in method_call
 0:02.60     cache[args] = self.func(instance, *args)
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/configure/__init__.py", line 155, in result
 0:02.60     return self._func(*resolved_args)
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/configure/__init__.py", line 1161, in wrapped
 0:02.60     return new_func(*args, **kwargs)
 0:02.60   File "/home/emilio/src/moz/gecko/build/moz.configure/init.configure", line 357, in virtualenv_python3
 0:02.60     manager.build(python)
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/virtualenv.py", line 492, in build
 0:02.60     self.create(python)
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/virtualenv.py", line 254, in create
 0:02.60     result = self._log_process_output(args)
 0:02.60   File "/home/emilio/src/moz/gecko/python/mozbuild/mozbuild/virtualenv.py", line 206, in _log_process_output
 0:02.60     proc = subprocess.Popen(*args, stdout=subprocess.PIPE,
 0:02.60   File "/usr/lib64/python3.8/subprocess.py", line 854, in __init__
 0:02.60     self._execute_child(args, executable, preexec_fn, close_fds,
 0:02.60   File "/usr/lib64/python3.8/subprocess.py", line 1702, in _execute_child
 0:02.60     raise child_exception_type(errno_num, err_msg, err_filename)
 0:02.60 FileNotFoundError: [Errno 2] No such file or directory: '/home/emilio/src/moz/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/init_py3/bin/python'
 0:02.62 *** Fix above errors and then restart with\
 0:02.62                "./mach build"
 0:02.62 gmake: *** [client.mk:115: configure] Error 1

That directory exists, and has a lot of stuff, but not a python file:

$ ls -la /home/emilio/src/moz/gecko/obj-x86_64-pc-linux-gnu/_virtualenvs/init_py3/bin/                                                                                                     
total 76
drwxr-xr-x. 2 emilio emilio  4096 May 27 12:22 .
drwxr-xr-x. 5 emilio emilio  4096 May 27 12:22 ..
-rw-r--r--. 1 emilio emilio  2261 May 27 12:22 activate
-rw-r--r--. 1 emilio emilio  1480 May 27 12:22 activate.csh
-rw-r--r--. 1 emilio emilio  3145 May 27 12:22 activate.fish
-rw-r--r--. 1 emilio emilio  1751 May 27 12:22 activate.ps1
-rw-r--r--. 1 emilio emilio  1517 May 27 12:22 activate_this.py
-rw-r--r--. 1 emilio emilio  1202 May 27 12:22 activate.xsh
-rwxr-xr-x. 1 emilio emilio   298 May 27 12:22 easy_install
-rwxr-xr-x. 1 emilio emilio   298 May 27 12:22 easy_install-3.8
-rwxr-xr-x. 1 emilio emilio   285 May 27 12:22 pip
-rwxr-xr-x. 1 emilio emilio   285 May 27 12:22 pip3
-rwxr-xr-x. 1 emilio emilio   285 May 27 12:22 pip3.8
-rwxr-xr-x. 1 emilio emilio 15408 May 27 12:22 python3
lrwxrwxrwx. 1 emilio emilio     7 May 27 12:22 python3.8 -> python3
-rwxr-xr-x. 1 emilio emilio  2390 May 27 12:22 python-config
-rwxr-xr-x. 1 emilio emilio   276 May 27 12:22 wheel

I built fine on this machine less than a week ago.

Trying to symlink my way to victory doesn't quite work :(

I think this was due to a date change in my system...

No, it's not... I was confused because ./mach artifact toolchain / bootstrap did work and that also does python shenanigans...

Re-executing in the virtualenv
 0:02.77 python3: running with pid 16506
 0:02.77 python3: sys.executable: '/home/emilio/src/moz/gecko/obj-debug/_virtualenvs/init_py3/bin/python'
 0:02.77 python3: executable from configuration: None

That doesn't make sense to me, how can sys.executable not exist? :/

This was in fact due to a time change in my system ugh. Sorry for the noise.

find . -exec touch -a -m {} \;

fixed it.

Status: NEW → RESOLVED
Closed: 4 years ago
Resolution: --- → INVALID
You need to log in before you can comment on or make changes to this bug.