991769 - Intermittent IOError: [Errno 2] No such file or directory: '.deps/libxul.so.pp' in link_deps.py's linker.add_dependencies(open(f))

Status: RESOLVED FIXED

(Firefox Build System :: General, defect)

Description

[Ed Morley [:emorley]]

Linux x86-64 mozilla-inbound pgo-build on 2014-04-03 05:31:18 PDT for push 9517fe15e2c2

slave: bld-linux64-ix-033

https://tbpl.mozilla.org/php/getParsedLog.php?id=37217953&tree=Mozilla-Inbound

{
make[1]: Nothing to be done for `check'.
make[1]: Leaving directory `/builds/slave/m-in-l64-pgo-00000000000000000/build/obj-firefox/testing/specialpowers'
make -C testing/gtest check
make[1]: Entering directory `/builds/slave/m-in-l64-pgo-00000000000000000/build/obj-firefox/testing/gtest'
make -C ../../toolkit/library gtestxul
make[2]: Entering directory `/builds/slave/m-in-l64-pgo-00000000000000000/build/obj-firefox/toolkit/library'
make -C gtest libs LINK_GTEST=1
make[3]: Entering directory `/builds/slave/m-in-l64-pgo-00000000000000000/build/obj-firefox/toolkit/library/gtest'
sed -e 's|libxul.so|gtest/libxul.so|' ../../../dist/bin/dependentlibs.list > ../../../dist/bin/dependentlibs.list.gtest
../../../dist/bin/nsinstall -R -m 644 'libxul.so' '../../../dist/bin/gtest'
rm -f '/builds/slave/m-in-l64-pgo-00000000000000000/build/obj-firefox/toolkit/library/gtest/libxul.so-gdb.py'
/builds/slave/m-in-l64-pgo-00000000000000000/build/obj-firefox/_virtualenv/bin/python -m mozbuild.action.preprocessor --depend .deps/libxul.so-gdb.py.pp -Dtopsrcdir=/builds/slave/m-in-l64-pgo-00000000000000000/build -DMOZ_GLUE_IN_PROGRAM -DMOZILLA_INTERNAL_API -DIMPL_LIBXUL  -DSTATIC_EXPORTABLE_JS_API -DNO_NSPR_10_SUPPORT -DHAVE_X86_AVX2='1' -DHAVE_64BIT_OS='1' -DMOZ_ENABLE_PROFILER_SPS='1' -DMOZ_PROFILING='1' -DMOZILLA_VERSION='"31.0a1"' -DMOZILLA_VERSION_U='31.0a1' -DMOZILLA_UAVERSION='"31.0"' -DXP_LINUX='1' -DD_INO='d_ino' -DMOZ_DEBUG_SYMBOLS='1' -DSTDC_HEADERS='1' -DHAVE_SSIZE_T='1' -DHAVE_ST_BLKSIZE='1' -DHAVE_SIGINFO_T='1' -DHAVE_VISIBILITY_HIDDEN_ATTRIBUTE='1' -DHAVE_VISIBILITY_ATTRIBUTE='1' -DHAVE_DIRENT_H='1' -DHAVE_GETOPT_H='1' -DHAVE_SYS_BITYPES_H='1' -DHAVE_MEMORY_H='1' -DHAVE_UNISTD_H='1' -DHAVE_GNU_LIBC_VERSION_H='1' -DHAVE_NL_TYPES_H='1' -DHAVE_MALLOC_H='1' -DHAVE_X11_XKBLIB_H='1' -DHAVE_CPUID_H='1' -DHAVE_SYS_QUOTA_H='1' -DHAVE_SYS_SYSMACROS_H='1' -DHAVE_LINUX_QUOTA_H='1' -DHAVE_LINUX_IF_ADDR_H='1' -DHAVE_LINUX_RTNETLINK_H='1' -DHAVE_SYS_TYPES_H='1' -DHAVE_NETINET_IN_H='1' -DHAVE_BYTESWAP_H='1' -DHAVE_SYS_CDEFS_H='1' -DHAVE_DLOPEN='1' -DHAVE_DLADDR='1' -DHAVE_MEMMEM='1' -DFUNCPROTO='15' -D_REENTRANT='1' -DHAVE_STAT64='1' -DHAVE_LSTAT64='1' -DHAVE_TRUNCATE64='1' -DHAVE_LOCALTIME_R='1' -DHAVE_CLOCK_MONOTONIC='1' -DHAVE_RES_NINIT='1' -DHAVE_LANGINFO_CODESET='1' -DVA_COPY='va_copy' -DHAVE_VA_COPY='1' -DHAVE_VA_LIST_AS_ARRAY='1' -DHAVE_THREAD_TLS_KEYWORD='1' -DMALLOC_H='<malloc.h>' -DHAVE_STRNDUP='1' -DHAVE_POSIX_MEMALIGN='1' -DHAVE_MEMALIGN='1' -DHAVE_VALLOC='1' -DHAVE_MALLOC_USABLE_SIZE='1' -DHAVE_I18N_LC_MESSAGES='1' -DHAVE_LOCALECONV='1' -DNS_ATTR_MALLOC='__attribute__((malloc))' -DNS_WARN_UNUSED_RESULT='__attribute__((warn_unused_result))' -DNIGHTLY_BUILD='1' -DMOZ_UPDATE_CHANNEL='default' -DEARLY_BETA_OR_EARLIER='1' -DMOZ_PHOENIX='1' -DMOZ_BUILD_APP='browser' -DMOZ_X11='1' -DMOZ_WIDGET_GTK2='1' -DMOZ_WIDGET_GTK='2' -DMOZ_PDF_PRINTING='1' -DMOZ_ENABLE_XREMOTE='1' -DMOZ_INSTRUMENT_EVENT_LOOP='1' -DNS_PRINTING='1' -DNS_PRINT_PREVIEW='1' -DMOZ_DISTRIBUTION_ID='"org.mozilla"' -DMOZ_ENABLE_GIO='1' -DMOZ_ENABLE_GCONF='1' -DMOZ_ENABLE_DBUS='1' -DIBMBIDI='1' -DACCESSIBILITY='1' -DMOZ_WEBRTC='1' -DMOZ_WEBRTC_ASSERT_ALWAYS='1' -DMOZ_WEBRTC_SIGNALING='1' -DMOZ_PEERCONNECTION='1' -DMOZ_SCTP='1' -DMOZ_SRTP='1' -DMOZ_SAMPLE_TYPE_FLOAT32='1' -DMOZ_WEBSPEECH='1' -DMOZ_RAW='1' -DATTRIBUTE_ALIGNED_MAX='64' -DMOZ_WEBM='1' -DMOZ_FFMPEG='1' -DMOZ_FMP4='1' -DMOZ_MEDIA_NAVIGATOR='1' -DMOZ_VPX='1' -DMOZ_VPX_ERROR_CONCEALMENT='1' -DVPX_X86_ASM='1' -DMOZ_WAVE='1' -DMOZ_VORBIS='1' -DMOZ_OPUS='1' -DMOZ_WEBM_ENCODER='1' -DMOZ_GSTREAMER='1' -DGST_API_VERSION='"0.10"' -DENABLE_SYSTEM_EXTENSION_DIRS='1' -DMOZ_WEBGL='1' -DMOZ_WEBGL_CONFORMANT='1' -DMOZ_GAMEPAD='1' -DMOZ_CRASHREPORTER='1' -DMOZ_CRASHREPORTER_ENABLE_PERCENT='100' -DLIBJPEG_TURBO_X64_ASM='1' -DMOZ_WEBAPP_RUNTIME='1' -DMOZ_SIGNING='1' -DMOZ_ENABLE_SIGNMAR='1' -DMOZ_UPDATER='1' -DGTEST_HAS_RTTI='0' -DMOZ_CONTENT_SANDBOX_REPORTER='1' -DMOZ_FEEDS='1' -DMOZ_SAFE_BROWSING='1' -DMOZ_URL_CLASSIFIER='1' -DGL_PROVIDER_GLX='1' -DMOZ_LOGGING='1' -DMOZ_MEMORY='1' -DMOZ_MEMORY_LINUX='1' -DJS_CRASH_DIAGNOSTICS='1' -DJSGC_INCREMENTAL='1' -DJSGC_USE_EXACT_ROOTING='1' -DJSGC_GENERATIONAL='1' -DMOZ_PAY='1' -DMOZ_ACTIVITIES='1' -DMOZ_SERVICES_FXACCOUNTS='1' -DHAVE___CXA_DEMANGLE='1' -DHAVE__UNWIND_BACKTRACE='1' -DJS_DEFAULT_JITREPORT_GRANULARITY='3' -DMOZ_OMNIJAR='1' -DMOZ_USER_DIR='".mozilla"' -DHAVE_FT_BITMAP_SIZE_Y_PPEM='1' -DHAVE_FT_GLYPHSLOT_EMBOLDEN='1' -DHAVE_FT_LOAD_SFNT_TABLE='1' -DHAVE_FONTCONFIG_FCFREETYPE_H='1' -DMOZ_TREE_PIXMAN='1' -DHAVE_STDINT_H='1' -DHAVE_INTTYPES_H='1' -DMOZ_TREE_CAIRO='1' -DMOZ_ENABLE_SKIA='1' -DUSE_SKIA='1' -DUSE_SKIA_GPU='1' -DMOZ_XUL='1' -DMOZ_PROFILELOCKING='1' -DENABLE_MARIONETTE='1' -DBUILD_CTYPES='1' -DMOZ_PLACES='1' -DMOZ_SOCIAL='1' -DMOZ_SERVICES_COMMON='1' -DMOZ_SERVICES_CRYPTO='1' -DMOZ_SERVICES_HEALTHREPORT='1' -DMOZ_SERVICES_METRICS='1' -DMOZ_SERVICES_SYNC='1' -DMOZ_JSDOWNLOADS='1' -DMOZ_MACBUNDLE_ID='org.mozilla.nightly' -DMOZ_B2G_VERSION='"1.0.0"' -DMOZ_B2G_OS_NAME='""' -DMOZ_APP_UA_NAME='""' -DMOZ_APP_UA_VERSION='"31.0a1"' -DFIREFOX_VERSION='31.0a1' -DMOZ_TELEMETRY_DISPLAY_REV='2' -DMOZ_TELEMETRY_REPORTING='1' -DMOZ_TELEMETRY_ON_BY_DEFAULT='1' -DMOZ_DATA_REPORTING='1' -DMOZ_DLL_SUFFIX='".so"' -DHAVE_POSIX_FADVISE='1' -DHAVE_POSIX_FALLOCATE='1' -DXP_UNIX='1' -DMOZ_ACCESSIBILITY_ATK='1' -DATK_MAJOR_VERSION='1' -DATK_MINOR_VERSION='28' -DATK_REV_VERSION='0' -DA11Y_LOG='1' -DEXPOSE_INTL_API='1' -DENABLE_INTL_API='1' -DU_STATIC_IMPLEMENTATION='1' -DU_USING_ICU_NAMESPACE='0' -DMOZ_STATIC_JS='1' -DNDEBUG -DTRIMMED '/builds/slave/m-in-l64-pgo-00000000000000000/build/toolkit/library/libxul.so-gdb.py.in' -o '/builds/slave/m-in-l64-pgo-00000000000000000/build/obj-firefox/toolkit/library/gtest/libxul.so-gdb.py'
mkdir -p '.deps/'
Traceback (most recent call last):
  File "/tools/python27/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/tools/python27/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/builds/slave/m-in-l64-pgo-00000000000000000/build/python/mozbuild/mozbuild/action/link_deps.py", line 229, in <module>
    main(sys.argv[1:])
  File "/builds/slave/m-in-l64-pgo-00000000000000000/build/python/mozbuild/mozbuild/action/link_deps.py", line 219, in main
    linker.add_dependencies(open(f))
IOError: [Errno 2] No such file or directory: '.deps/libxul.so.pp'
make[3]: *** [libs] Error 255
make[3]: Leaving directory `/builds/slave/m-in-l64-pgo-00000000000000000/build/obj-firefox/toolkit/library/gtest'
}

Comment 1

[Ed Morley [:emorley]]

https://tbpl.mozilla.org/php/getParsedLog.php?id=37219305&tree=Fx-Team

Comment 2

[Mike Hommey [:glandium]]

I bet the failing builds are not clobbers, and the successful ones are.

Comment 3

[Legacy TBPL/Treeherder Robot]

KWierso
https://tbpl.mozilla.org/php/getParsedLog.php?id=37248019&tree=B2g-Inbound
Linux b2g-inbound pgo-build on 2014-04-03 15:01:06
revision: 0f094619524f
slave: bld-linux64-spot-407

rm: cannot remove directory: `.'
rm: cannot remove directory: `.'
IOError: [Errno 2] No such file or directory: '.deps/libxul.so.pp'
make[3]: *** [libs] Error 255
make[2]: *** [gtestxul] Error 2
make[1]: *** [check] Error 2
make: *** [check] Error 2

Comment 4

[Mike Hommey [:glandium]]

Attachment: Cleanup gtest libxul when doing make clean or distclean

Comment 5

[Mike Hommey [:glandium]]

https://hg.mozilla.org/integration/mozilla-inbound/rev/937b426e4651

Comment 6

[Mike Hommey [:glandium]]

And a fixup:
https://hg.mozilla.org/integration/mozilla-inbound/rev/386862bbda8d

Comment 7

[Legacy TBPL/Treeherder Robot]

philor
https://tbpl.mozilla.org/php/getParsedLog.php?id=37259491&tree=B2g-Inbound
Linux x86-64 b2g-inbound pgo-build on 2014-04-03 21:01:06
revision: aab1ee812cb4
slave: bld-linux64-spot-337

rm: cannot remove directory: `.'
rm: cannot remove directory: `.'
IOError: [Errno 2] No such file or directory: '.deps/libxul.so.pp'
make[3]: *** [libs] Error 255
make[2]: *** [gtestxul] Error 2
make[1]: *** [check] Error 2
make: *** [check] Error 2

Comment 8

[Legacy TBPL/Treeherder Robot]

RyanVM
https://tbpl.mozilla.org/php/getParsedLog.php?id=37287844&tree=B2g-Inbound
Linux x86-64 b2g-inbound pgo-build on 2014-04-04 09:01:03
revision: a4ac15d6912d
slave: bld-linux64-spot-437

rm: cannot remove directory: `.'
rm: cannot remove directory: `.'
IOError: [Errno 2] No such file or directory: '.deps/libxul.so.pp'
make[3]: *** [libs] Error 255
make[2]: *** [gtestxul] Error 2
make[1]: *** [check] Error 2
make: *** [check] Error 2

Comment 9

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/mozilla-central/rev/937b426e4651
https://hg.mozilla.org/mozilla-central/rev/386862bbda8d