689541 - Throws errors and stalls on installer packaging make

Status: RESOLVED WONTFIX

(Firefox Build System :: General, defect)

Description

[Brad Jackson]

Running make in mozilla/obj-i686-pc-linux-gnu/browser/installer/ to build an installer tarball throws errors and stalls:

resource:///modules/services-sync/engines/clients.js
Failed to import resource:///modules/services-sync/engines/clients.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/services-sync/ext/Preferences.js
resource:///modules/services-sync/rest.js
Failed to import resource:///modules/services-sync/rest.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/services-sync/engines/forms.js
Failed to import resource:///modules/services-sync/engines/forms.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/utils.js
resource:///modules/services-sync/async.js
resource:///modules/services-sync/log4moz.js
resource:///modules/services-sync/main.js
resource:///modules/distribution.js
resource:///modules/services-sync/engines/history.js
Failed to import resource:///modules/services-sync/engines/history.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/services-sync/engines/tabs.js
Failed to import resource:///modules/services-sync/engines/tabs.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/services-sync/engines/bookmarks.js
Failed to import resource:///modules/services-sync/engines/bookmarks.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/services-sync/policies.js
Failed to import resource:///modules/services-sync/policies.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/services-sync/notifications.js
Failed to import resource:///modules/services-sync/notifications.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/Microformats.js
resource:///modules/services-sync/ext/Observers.js
resource:///modules/services-crypto/WeaveCrypto.js
resource:///modules/services-sync/record.js
Failed to import resource:///modules/services-sync/record.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/services-sync/status.js
resource:///modules/services-sync/constants.js
resource:///modules/services-sync/engines/passwords.js
Failed to import resource:///modules/services-sync/engines/passwords.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/services-sync/util.js
Failed to import resource:///modules/services-sync/util.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/services-sync/engines/prefs.js
Failed to import resource:///modules/services-sync/engines/prefs.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/services-sync/jpakeclient.js
Failed to import resource:///modules/services-sync/jpakeclient.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/services-sync/engines.js
Failed to import resource:///modules/services-sync/engines.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/services-sync/service.js
Failed to import resource:///modules/services-sync/service.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/services-sync/resource.js
Failed to import resource:///modules/services-sync/resource.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/debug.js
resource:///modules/services-sync/identity.js
Failed to import resource:///modules/services-sync/identity.js:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/devtools/StyleInspector.jsm
resource:///modules/devtools/Templater.jsm
resource:///modules/NetworkPrioritizer.jsm
resource:///modules/ctypes.jsm
resource:///modules/InlineSpellChecker.jsm
resource:///modules/ConsoleAPIStorage.jsm
resource:///modules/AutocompletePopup.jsm
resource:///modules/CertUtils.jsm
resource:///modules/NetworkHelper.jsm
resource:///modules/DownloadLastDir.jsm
resource:///modules/LightweightThemeManager.jsm
resource:///modules/PopupNotifications.jsm
resource:///modules/PlacesUIUtils.jsm
resource:///modules/InsideOutBox.jsm
resource:///modules/Dict.jsm
resource:///modules/NetUtil.jsm
resource:///modules/AddonLogging.jsm
resource:///modules/source-editor-orion.jsm
resource:///modules/XPIProvider.jsm
resource:///modules/LightweightThemeConsumer.jsm
resource:///modules/OpenWebapps.jsm
Failed to import resource:///modules/OpenWebapps.jsm:[Exception... "Component returned failure code: 0x80520012 (NS_ERROR_FILE_NOT_FOUND) [nsIXPCComponents_Utils.import]"  nsresult: "0x80520012 (NS_ERROR_FILE_NOT_FOUND)"  location: "JS frame :: /home/bsjacks/mozilla/toolkit/mozapps/installer/precompile_cache.js :: load :: line 59"  data: no]
resource:///modules/Services.jsm
resource:///modules/FileUtils.jsm
resource:///modules/PlacesUtils.jsm
resource:///modules/AddonManager.jsm
resource:///modules/devtools/CssHtmlTree.jsm
resource:///modules/nsFormAutoCompleteResult.jsm
resource:///modules/tabview/utils.jsm
resource:///modules/gcli.jsm
error
  undefined Missing module: gcli/ui/start/firefox
resource:///modules/PropertyPanel.jsm
resource:///modules/openLocationLastURL.jsm
resource:///modules/devtools/CssLogic.jsm
resource:///modules/PerfMeasurement.jsm
resource:///modules/source-editor-textarea.jsm
resource:///modules/XPCOMUtils.jsm
resource:///modules/TreePanel.jsm
resource:///modules/AddonUpdateChecker.jsm
resource:///modules/PageMenu.jsm
resource:///modules/Geometry.jsm
resource:///modules/domplate.jsm
resource:///modules/jsdebugger.jsm
resource:///modules/PluginProvider.jsm
resource:///modules/DownloadPaths.jsm
resource:///modules/source-editor.jsm
resource:///modules/DownloadUtils.jsm
resource:///modules/CommonDialog.jsm
resource:///modules/PluralForm.jsm
resource:///modules/AddonRepository.jsm
resource:///modules/inspector.jsm
resource:///modules/PlacesDBUtils.jsm
resource:///modules/WindowDraggingUtils.jsm
resource:///modules/HUDService.jsm
resource:///modules/reflect.jsm
resource:///modules/CSPUtils.jsm

Comment 1

[Justin Wood (:Callek)]

Few Questions:

What mozilla code branch, What Mozconfig Options, What did you do compiling to get here, and what are you doing specifically to get these errors.

Is this the output you get from |make -C @objdir@/browser/installer| Or from running the resulting app?

Comment 2

[Brad Jackson]

I'm generating a tarball by running this:

make MOZ_PKG_FORMAT="TAR" PKG_BASENAME="firefox-i686-pc-linux.`date +%Y%m%d`
" MOZILLA_BIN="\$(DIST)/bin/firefox-bin"

in mozilla/obj-i686-pc-linux-gnu/browser/installer/

I had added an log attachment with the complete make output when I created the bug, but it seems so have been lost. This problem just started late in the day 9/26 or 9/27.

Comment 3

[Brad Jackson]

Attachment: Make output

This is the make output for x86_64 with the same problem. This is Firefox trunk BTW.

Comment 4

[Justin Wood (:Callek)]

Comment on attachment 562751 [details]
Make output

Based on this, it looks like you have a MozConfig/Configure/whatever trying to tell packager to use a profile from a PGO build.

Which in this case is part of optimizing Omnijar, can you please answer my other questions, like mozconfig etc.

Comment 5

[Brad Jackson]

Attachment: mozconfig

I am not doing a make profiledbuild, just make -f client.mk build. I do have the PROFILE_GEN_SCRIPT env variable set, but it shouldn't be used.

Comment 6

[Brad Jackson]

I removed the PROFILE_GEN_SCRIPT var and now it segfaults instead of stalling.

esource:///modules/PlacesDBUtils.jsm
resource:///modules/WindowDraggingUtils.jsm
resource:///modules/HUDService.jsm
resource:///modules/reflect.jsm
resource:///modules/CSPUtils.jsm
/bin/sh: line 1: 15804 Segmentation fault      /home/brad/projects/mozilla/obj-x86_64-unknown-linux-gnu/dist/bin/run-mozilla.sh /home/brad/projects/mozilla/obj-x86_64-unknown-linux-gnu/dist/bin/xpcshell -g "$PWD" -a "$PWD" -f /home/brad/projects/mozilla/toolkit/mozapps/installer/precompile_cache.js -e "populate_startupcache('GreD', 'omni.jar', 'startupCache.zip');"
make[1]: *** [make-package] Error 139
make[1]: Leaving directory `/home/brad/projects/mozilla/obj-x86_64-unknown-linux-gnu/browser/installer'
make: *** [default] Error 2

Comment 7

[Justin Wood (:Callek)]

Comment on attachment 562762 [details]
mozconfig

#1 you have mk_add_options PROFILE_GEN_SCRIPT=/home/brad/run-firefox.sh which should be removed, and a completely fresh/clean build done (rm -rf your objdir)

#2 HOLY CONFIGURE OPTIONS BATMAN!
You should not need many/most of these options, please use the bare minimum that you need, many of these are legacy and are not even known to work. We try hard to give you reasonable defaults.

#3 HOLY OPTIMIZE FLAG
ac_add_options --enable-optimize=...

Do You _really_ need that full string there, is it all OPTIMIZE flags or should some of that be CFLAGS/CXXFLAGS, etc? an optimize flag that long screams broken to me.

Lastly, in trunk we no longer use the sh wrapper script by default, iirc. So a lot of this bug seems bad, and this probably should instead be taken to newsgroups.

Comment 8

[Brad Jackson]

I commented mk_add_options PROFILE_GEN_SCRIPT and tried a generic "ac_add_options --enable-optimize" with no args, nuked objdir, cleared ccache, and still got the crash. I can try a minimal mozconfig.

I'm not executing the run-mozilla script, just running make in mozilla/obj-x86_64-unknown-linux-gnu/browser/installer/. If there is a newer way to generate a tarball from trunk build dir, I don't know what it is.

Comment 9

[(not currently active) Ted Mielczarek]

Simply running "make package" in the objdir will generate a tarball. (However it will run the same make command you did internally, so it doesn't matter much.)

Comment 10

[Brad Jackson]

I had no luck with a minimal mozconfig on 32-bit x86. I tried an older version of GCC (4.5.2 instead of 4.6.1) and also removed LDFLAGS and now the packager finishes. I figured out that this isn't a packaging problem, but a problem with the Firefox binary or libraries stalling or crashing during the packaging. Firefox also stalled when run directly from dist/bin. This appears to be a problem specific to GCC 4.6.1 for me.

I thought it might be the compatibility problem with jemalloc and LD_PRELOAD (bug 435683 that is not fixed for me) but removing LD_PRELOAD or compiling without jemalloc didn't fix the stalling.

Comment 11

[Wolfgang Rosenauer [:wolfiR]]

Have the same or similar issue with gcc 4.4.1.

[ 1535s] /bin/sh: line 1:  4172 Segmentation fault      /usr/src/packages/BUILD/obj/dist/bin/run-mozilla.sh /usr/src/packages/BUILD/obj/dist/bin/xpcshell -g "$PWD" -a "$PWD" -f /usr/src/packages/BUILD/mozilla/toolkit/mozapps/installer/precompile_cache.js -e "populate_startupcache('GreD', 'omni.ja', 'startupCache.zip');"

Works fine on x86-64 but not i586 here.

Comment 12

[(not currently active) Ted Mielczarek]

Your error and comment 0 don't look anything alike. comment 0 shows a number of JavaScript errors and says the packaging hangs. Your comment says xpcshell is simply crashing during packaging.

Comment 13

[Wolfgang Rosenauer [:wolfiR]]

comments 6, 8 and 10 are talking about crashes as well

Comment 14

[Kim Moir [:kmoir] ET]

triaging, closing old bug