934352 - Lightning repackaging build step broken for several locales due to missing 'lightning-l10n.js'

Status: RESOLVED INCOMPLETE

(Thunderbird :: Build Config, defect)

Description

[Henrik Skupin [:whimboo][⌚️UTC+2]]

Mostly all of the failures for comm-aurora, which can be seen under the following URL, show a build process failure during the repackaging step for Lightning:

https://secure.pub.build.mozilla.org/builddata/buildjson/l10n_reports/latest.txt

Last lines of build step:

make -C ../../calendar/lightning langpack-ar
make[1]: Entering directory `/builds/slave/tb-c-aurora-lx-l10n-ntly-00000/build/comm-aurora/objdir-tb/calendar/lightning'
make L10N_XPI_NAME=lightning-ar L10N_XPI_PKGNAME=lightning-2.9a2.ar.linux-i686 AB_CD=ar \
	  recreate-platformini repack-stage repack-process-extrafiles libs-ar
make[2]: Entering directory `/builds/slave/tb-c-aurora-lx-l10n-ntly-00000/build/comm-aurora/objdir-tb/calendar/lightning'
make[2]: Nothing to be done for `recreate-platformini'.
Repackaging lightning-2.9a2.ar.linux-i686 locale for Language ar
rm -f -rf ../../mozilla/dist/xpi-stage/lightning-ar
cp -R ../../mozilla/dist/xpi-stage/lightning ../../mozilla/dist/xpi-stage/lightning-ar
grep -v 'locale \w\+ en-US' ../../mozilla/dist/xpi-stage/lightning-ar/chrome.manifest > ../../mozilla/dist/xpi-stage/lightning-ar/chrome.manifest~ && \
	  mv ../../mozilla/dist/xpi-stage/lightning-ar/chrome.manifest~ ../../mozilla/dist/xpi-stage/lightning-ar/chrome.manifest
find /builds/slave/tb-c-aurora-lx-l10n-ntly-00000/build/comm-aurora/objdir-tb/mozilla/dist/xpi-stage/lightning-ar -name '*en-US*' -print0 | xargs -0 rm -rf
/builds/slave/tb-c-aurora-lx-l10n-ntly-00000/build/comm-aurora/objdir-tb/mozilla/_virtualenv/bin/python /builds/slave/tb-c-aurora-lx-l10n-ntly-00000/build/comm-aurora/mozilla/config/Preprocessor.py  -DLIGHTNING_PRERELEASE_VERSION=1 -DLIGHTNING_UPDATE_LOCATION=https://calendar.mozilla.org/update.php -DGRE_MILESTONE=27.0a2 -DSOURCE_STAMP="2a50fe892e2f" -DSOURCE_REPO="http://hg.mozilla.org/releases/comm-aurora" -DMOZ_SOURCE_STAMP="58108b9b3152" -DMOZ_SOURCE_REPO="http://hg.mozilla.org/releases/mozilla-aurora" -DXPI_NAME=lightning -DMOZ_GLUE_IN_PROGRAM -DOSTYPE=\"Linux2.6.32-220.el6\" -DOSARCH=Linux -DNO_NSPR_10_SUPPORT -DTHUNDERBIRD_VERSION=27.0a2 -DTHUNDERBIRD_MAXVERSION=27.0a2 -DAB_CD=ar -DSEAMONKEY_VERSION=2.24a2 -DSEAMONKEY_MAXVERSION=2.24a2 -DLIGHTNING_VERSION=2.9a2 -DTARGET_PLATFORM=Linux_x86-gcc3 -DXPI_EM_ID={e2fda1a4-762b-4020-b5ad-a41df1933103} -DTHEME=linux  -DGRE_BUILDID=20131030004004 -DJSGC_INCREMENTAL=1 -DMOZ_ENABLE_PROFILER_SPS=1 -DMOZILLA_VERSION=\"27.0a2\" -DMOZILLA_VERSION_U=27.0a2 -DMOZILLA_UAVERSION=\"27.0\" -DXP_LINUX=1 -DD_INO=d_ino -DMOZ_DEBUG_SYMBOLS=1 -DSTDC_HEADERS=1 -DHAVE_SSIZE_T=1 -DHAVE_ST_BLKSIZE=1 -DHAVE_SIGINFO_T=1 -DHAVE_VISIBILITY_HIDDEN_ATTRIBUTE=1 -DHAVE_VISIBILITY_ATTRIBUTE=1 -DHAVE_DIRENT_H=1 -DHAVE_GETOPT_H=1 -DHAVE_SYS_BITYPES_H=1 -DHAVE_MEMORY_H=1 -DHAVE_UNISTD_H=1 -DHAVE_GNU_LIBC_VERSION_H=1 -DHAVE_NL_TYPES_H=1 -DHAVE_MALLOC_H=1 -DHAVE_X11_XKBLIB_H=1 -DHAVE_CPUID_H=1 -DHAVE_SYS_QUOTA_H=1 -DHAVE_SYS_SYSMACROS_H=1 -DHAVE_LINUX_QUOTA_H=1 -DHAVE_LINUX_IF_ADDR_H=1 -DHAVE_LINUX_RTNETLINK_H=1 -DHAVE_SYS_TYPES_H=1 -DHAVE_NETINET_IN_H=1 -DHAVE_BYTESWAP_H=1 -DHAVE_SYS_CDEFS_H=1 -DHAVE_DLOPEN=1 -DHAVE_DLADDR=1 -DHAVE_MEMMEM=1 -DFUNCPROTO=15 -D_REENTRANT=1 -DHAVE_RANDOM=1 -DHAVE_STRERROR=1 -DHAVE_LCHOWN=1 -DHAVE_FCHMOD=1 -DHAVE_SNPRINTF=1 -DHAVE_MEMMOVE=1 -DHAVE_STAT64=1 -DHAVE_LSTAT64=1 -DHAVE_TRUNCATE64=1 -DHAVE_SETBUF=1 -DHAVE_ISATTY=1 -DHAVE_FLOCKFILE=1 -DHAVE_LOCALTIME_R=1 -DHAVE_STRTOK_R=1 -DHAVE_CLOCK_MONOTONIC=1 -DHAVE_RES_NINIT=1 -DHAVE_LANGINFO_CODESET=1 -DVA_COPY=va_copy -DHAVE_VA_COPY=1 -DHAVE_THREAD_TLS_KEYWORD=1 -DMALLOC_H=\<malloc.h\> -DHAVE_STRNDUP=1 -DHAVE_POSIX_MEMALIGN=1 -DHAVE_MEMALIGN=1 -DHAVE_VALLOC=1 -DHAVE_MALLOC_USABLE_SIZE=1 -DHAVE_I18N_LC_MESSAGES=1 -DHAVE_LOCALECONV=1 -DNS_ATTR_MALLOC=__attribute__\(\(malloc\)\) -DNS_WARN_UNUSED_RESULT=__attribute__\(\(warn_unused_result\)\) -DMOZ_UPDATE_CHANNEL=aurora -DEARLY_BETA_OR_EARLIER=1 -DMOZ_THUNDERBIRD=1 -DMOZ_MORK=1 -DHAVE_MOVEMAIL=1 -DMOZ_BUILD_APP=../mail -DMOZ_X11=1 -DMOZ_WIDGET_GTK2=1 -DMOZ_WIDGET_GTK=2 -DMOZ_PDF_PRINTING=1 -DMOZ_ENABLE_XREMOTE=1 -DMOZ_INSTRUMENT_EVENT_LOOP=1 -DMOZ_DISTRIBUTION_ID=\"org.mozilla\" -DMOZ_PANGO=1 -DMOZ_ENABLE_GNOMEVFS=1 -DMOZ_ENABLE_GCONF=1 -DMOZ_ENABLE_DBUS=1 -DIBMBIDI=1 -DACCESSIBILITY=1 -DNS_PRINTING=1 -DNS_PRINT_PREVIEW=1 -DMOZ_WEBRTC=1 -DMOZ_WEBRTC_ASSERT_ALWAYS=1 -DMOZ_WEBRTC_SIGNALING=1 -DMOZ_PEERCONNECTION=1 -DMOZ_SCTP=1 -DMOZ_SRTP=1 -DMOZ_SAMPLE_TYPE_FLOAT32=1 -DMOZ_WEBSPEECH=1 -DMOZ_RAW=1 -DMOZ_OGG=1 -DATTRIBUTE_ALIGNED_MAX=64 -DMOZ_WEBM=1 -DMOZ_MEDIA_NAVIGATOR=1 -DMOZ_VP8=1 -DMOZ_VP8_ERROR_CONCEALMENT=1 -DMOZ_VP8_ENCODER=1 -DVPX_X86_ASM=1 -DMOZ_WAVE=1 -DMOZ_SPEEX_RESAMPLER=1 -DMOZ_SOUNDTOUCH=1 -DMOZ_CUBEB=1 -DMOZ_VORBIS=1 -DMOZ_OPUS=1 -DMOZ_CUBEB=1 -DMOZ_GSTREAMER=1 -DENABLE_SYSTEM_EXTENSION_DIRS=1 -DMOZ_WEBGL=1 -DMOZ_GAMEPAD=1 -DMOZ_CRASHREPORTER=1 -DMOZ_CRASHREPORTER_ENABLE_PERCENT=100 -DLIBJPEG_TURBO_X86_ASM=1 -DMOZ_SIGNING=1 -DMOZ_UPDATER=1 -DMOZ_ENABLE_GTEST=1 -DGTEST_HAS_RTTI=0 -DMOZ_FEEDS=1 -DMOZ_SAFE_BROWSING=1 -DMOZ_URL_CLASSIFIER=1 -DGL_PROVIDER_GLX=1 -DMOZ_LOGGING=1 -DMOZ_MEMORY=1 -DMOZ_MEMORY_LINUX=1 -DJSGC_INCREMENTAL=1 -DHAVE___CXA_DEMANGLE=1 -DHAVE__UNWIND_BACKTRACE=1 -DJS_DEFAULT_JITREPORT_GRANULARITY=3 -DMOZ_OMNIJAR=1 -DMOZ_USER_DIR=\".mozilla\" -DMOZ_STATIC_JS=1 -DHAVE_FT_BITMAP_SIZE_Y_PPEM=1 -DHAVE_FT_GLYPHSLOT_EMBOLDEN=1 -DHAVE_FT_LOAD_SFNT_TABLE=1 -DHAVE_FT_SELECT_SIZE=1 -DHAVE_FONTCONFIG_FCFREETYPE_H=1 -DMOZ_TREE_PIXMAN=1 -DHAVE_STDINT_H=1 -DHAVE_INTTYPES_H=1 -DMOZ_TREE_CAIRO=1 -DHAVE_UINT64_T=1 -DMOZ_ENABLE_SKIA=1 -DUSE_SKIA=1 -DUSE_SKIA_GPU=1 -DMOZ_XUL=1 -DMOZ_PROFILELOCKING=1 -DBUILD_CTYPES=1 -DMOZ_PLACES=1 -DMOZ_SOCIAL=1 -DMOZ_APP_COMPONENT_MODULES=MODULE\(nsMailCompsModule\)\ MODULE\(nsMailModule\)\ MODULE\(nsImportServiceModule\)\ MODULE\(nsLDAPProtocolModule\)\ MODULE\(nsMorkModule\) -DMOZ_MACBUNDLE_ID=org.mozilla.earlybird -DMOZ_B2G_VERSION=\"1.0.0\" -DMOZ_B2G_OS_NAME=\"\" -DMOZ_APP_UA_NAME=\"\" -DMOZ_APP_UA_VERSION=\"27.0a2\" -DFIREFOX_VERSION=27.0a2 -DMOZ_TELEMETRY_DISPLAY_REV=2 -DMOZ_DATA_REPORTING=1 -DMOZ_DLL_SUFFIX=\".so\" -DHAVE_POSIX_FALLOCATE=1 -DXP_UNIX=1 -DMOZ_ACCESSIBILITY_ATK=1 -DATK_MAJOR_VERSION=1 -DATK_MINOR_VERSION=28 -DATK_REV_VERSION=0 -DNDEBUG -DTRIMMED /builds/slave/tb-c-aurora-lx-l10n-ntly-00000/build/l10n/ar/calendar/lightning-l10n.js  > ../../mozilla/dist/xpi-stage/lightning-ar/defaults/preferences/lightning-l10n.js
Traceback (most recent call last):
  File "/builds/slave/tb-c-aurora-lx-l10n-ntly-00000/build/comm-aurora/mozilla/config/Preprocessor.py", line 492, in <module>
    main()
  File "/builds/slave/tb-c-aurora-lx-l10n-ntly-00000/build/comm-aurora/mozilla/config/Preprocessor.py", line 477, in main
    pp.handleCommandLine(None, True)
  File "/builds/slave/tb-c-aurora-lx-l10n-ntly-00000/build/comm-aurora/mozilla/config/Preprocessor.py", line 169, in handleCommandLine
    self.do_include(f, False)
  File "/builds/slave/tb-c-aurora-lx-l10n-ntly-00000/build/comm-aurora/mozilla/config/Preprocessor.py", line 445, in do_include
    raise Preprocessor.Error(self, 'FILE_NOT_FOUND', str(args))
__main__.Error: ('', 0, 'FILE_NOT_FOUND', '/builds/slave/tb-c-aurora-lx-l10n-ntly-00000/build/l10n/ar/calendar/lightning-l10n.js')
make[2]: *** [lightning-extrafiles] Error 1
make[2]: Leaving directory `/builds/slave/tb-c-aurora-lx-l10n-ntly-00000/build/comm-aurora/objdir-tb/calendar/lightning'
make[1]: *** [langpack-ar] Error 2
make[1]: Leaving directory `/builds/slave/tb-c-aurora-lx-l10n-ntly-00000/build/comm-aurora/objdir-tb/calendar/lightning'
make: *** [calendar-langpack-ar] Error 2
State Changed: unlock buildroot
program finished with exit code 2

Comment 1

[Philipp Kewisch [:Fallen][📱📆]]

Two ways to fix this:

1) add an empty file in case it doesn't exist
2) fix it in the locales

Option 1 is probably easier.

Comment 2

[Stefan Sitter [:ssitter]]

How many / what locales are affected?

From the link above it seems that ar and xh are failing on all platforms because they don't provide translation for /calendar/ according to mxr.mozilla.org. 
In this case I would expect that no repack process is started in the first place.

bg and uk are only failing on macosx64 and they provide translation for /calendar/ according to mxr.mozilla.org. Maybe they have different problem? Could you check the build logs? Or are they available in public?

Comment 3

[Stefan Sitter [:ssitter]]

Is this still a problem with current build infrastructure? As there was no response for almost 2 years I would assume this is no problem anymore.

Comment 4

[Henrik Skupin [:whimboo][⌚️UTC+2]]

The latest log I was able to find was from March last year. Not sure where l10n logs are uploaded to those days. It may be best to ask someone from the TB team for more information, I actually don't know anything about the build process. I only filed this bug because I have seen the failure in the log files.

Comment 5

[Wayne Mery (:wsmwk)]

(In reply to Stefan Sitter from comment #3)
> Is this still a problem with current build infrastructure? As there was no
> response for almost 2 years I would assume this is no problem anymore.