1232887 - "make package MOZ_PKG_PRETTYNAMES=1" is busted

Status: RESOLVED FIXED

(Firefox Build System :: General, defect)

Description

[Rail Aliiev [:rail]]

Attachment: mozhareness_package_mkdir.diff

Sorry, no mozreview setup on this laptop yet. :(

make package MOZ_PKG_PRETTYNAMES=1
 in dir /builds/slave/m-beta-m64-0000000000000000000/build/obj-firefox/x86_64 (timeout 1200 secs)
 watching logfiles {}
 argv: ['make', 'package', 'MOZ_PKG_PRETTYNAMES=1']
 environment:
  Apple_PubSub_Socket_Render=/tmp/launch-gvqrIj/Render
  CCACHE_COMPRESS=1
  CCACHE_DIR=/builds/ccache
  CCACHE_UMASK=002
  CHOWN_REVERT=~/bin/chown_revert
  CHOWN_ROOT=~/bin/chown_root
  DISPLAY=/tmp/launch-gsOtV3/org.x:0
  GIT_SHARE_BASE_DIR=/builds/git-shared
  HG_SHARE_BASE_DIR=/builds/hg-shared
  HOME=/Users/cltbld
  IDLEIZER_DISABLE_SHUTDOWN=true
  LC_ALL=C
  LOGNAME=cltbld
  MOZ_AUTOMATION=1
  MOZ_CRASHREPORTER_NO_REPORT=1
  MOZ_CURRENT_PROJECT=x86_64
  MOZ_OBJDIR=/builds/slave/m-beta-m64-0000000000000000000/build/obj-firefox
  MOZ_SYMBOLS_EXTRA_BUILDID=macosx64
  PATH=/tools/python/bin:/tools/buildbot/bin:/opt/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin:/usr/X11/bin
  POST_SYMBOL_UPLOAD_CMD=/usr/local/bin/post-symbol-upload.py
  PWD=/builds/slave/m-beta-m64-0000000000000000000/build/obj-firefox/x86_64
  RUNNER_CONFIG_CMD=/opt/runner/bin/python2.7 /opt/runner/bin/runner -c /opt/runner/runner.cfg
  SHELL=/bin/bash
  SSH_AUTH_SOCK=/tmp/launch-t1bPN7/Listeners
  SYMBOL_SERVER_HOST=symbolpush.mozilla.org
  SYMBOL_SERVER_PATH=/mnt/netapp/breakpad/symbols_ffx/
  SYMBOL_SERVER_SSH_KEY=/Users/cltbld/.ssh/ffxbld_rsa
  SYMBOL_SERVER_USER=ffxbld
  TINDERBOX_OUTPUT=1
  TMPDIR=/var/folders/4p/y5vzlw0d3d1fw9c3x8dbqg3r00000w/T/
  TOOLTOOL_CACHE=/builds/tooltool_cache
  TOOLTOOL_HOME=/builds
  TWISTD_LOG_PATH=/builds/slave/twistd.log
  USER=cltbld
  VERSIONER_PYTHON_PREFER_32_BIT=no
  VERSIONER_PYTHON_VERSION=2.7
  __CF_USER_TEXT_ENCODING=0x1C:0:0
 using PTY: False

make[2]: Nothing to be done for `export'.
make[2]: Nothing to be done for `compile'.
make[2]: Nothing to be done for `misc'.
make make-package-internal
OMNIJAR_NAME=omni.ja \
	NO_PKG_FILES="core bsdecho js js-config jscpucfg nsinstall viewer TestGtkEmbed elf-dynstr-gc mangle* maptsv* mfc* msdump* msmap* nm2tsv* nsinstall* res/samples res/throbber shlibsign* certutil* pk12util* BadCertServer* OCSPStaplingServer* GenerateOCSPResponse* chrome/chrome.rdf chrome/app-chrome.manifest chrome/overlayinfo components/compreg.dat components/xpti.dat content_unit_tests necko_unit_tests *.dSYM " \
	/builds/slave/m-beta-m64-0000000000000000000/build/obj-firefox/x86_64/_virtualenv/bin/python /builds/slave/m-beta-m64-0000000000000000000/build/toolkit/mozapps/installer/packager.py -DAB_CD=en-US -DNO_NSPR_10_SUPPORT -DMOZ_APP_NAME=firefox -DPREF_DIR=defaults/preferences -DJAREXT= -DMOZ_CHILD_PROCESS_NAME=plugin-container -DMOZ_SHARED_MOZGLUE=1 -DNECKO_WIFI -DDLL_PREFIX=lib -DDLL_SUFFIX=.dylib -DBIN_SUFFIX= -DDIR_MACOS=Contents/MacOS/ -DDIR_RESOURCES=Contents/Resources/ -DMOZ_FOLD_LIBS=1 -DAPPNAME=Nightly.app -DBINPATH=/Nightly.app/Contents/MacOS -DRESPATH=Nightly.app/Contents/Resources -DLPROJ_ROOT=en -DMOZ_ICU_VERSION=55 -DMOZ_ICU_DBG_SUFFIX= -DCLANG_CXX \
		--format omni \
		--removals /builds/slave/m-beta-m64-0000000000000000000/build/browser/installer/removed-files.in \
		 \
		 \
		 \
		 \
		--optimizejars \
		--unify /builds/slave/m-beta-m64-0000000000000000000/build/obj-firefox/x86_64/../i386/dist \
		/builds/slave/m-beta-m64-0000000000000000000/build/browser/installer/package-manifest.in ../../dist ../../dist/universal/firefox \
		
Executing ../../dist/bin/xpcshell -g /builds/slave/m-beta-m64-0000000000000000000/build/obj-firefox/x86_64/dist/Nightly.app/Contents/Resources -a /builds/slave/m-beta-m64-0000000000000000000/build/obj-firefox/x86_64/dist/Nightly.app/Contents/Resources -f /builds/slave/m-beta-m64-0000000000000000000/build/toolkit/mozapps/installer/precompile_cache.js -e precompile_startupcache("resource://gre/");
resource://gre/components/ActivityMessageConfigurator.js

.....

Duplicates 841 bytes:
  Nightly.app/Contents/Resources/res/table-remove-column.gif
  Nightly.app/Contents/Resources/res/table-remove-row.gif

WARNING: Found 41 duplicated files taking 238302 bytes (uncompressed)
# Package mozharness
/builds/slave/m-beta-m64-0000000000000000000/build/obj-firefox/x86_64/_virtualenv/bin/python -m mozbuild.action.test_archive  mozharness /builds/slave/m-beta-m64-0000000000000000000/build/obj-firefox/x86_64/dist/mac/en-US/mozharness.zip
Traceback (most recent call last):
  File "/tools/python/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/tools/python/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/builds/slave/m-beta-m64-0000000000000000000/build/python/mozbuild/mozbuild/action/test_archive.py", line 332, in <module>
    sys.exit(main(sys.argv[1:]))
  File "/builds/slave/m-beta-m64-0000000000000000000/build/python/mozbuild/mozbuild/action/test_archive.py", line 313, in main
    with open(args.outputfile, 'wb') as fh:
IOError: [Errno 2] No such file or directory: '/builds/slave/m-beta-m64-0000000000000000000/build/obj-firefox/x86_64/dist/mac/en-US/mozharness.zip'
make[3]: *** [stage-package] Error 255
make[2]: *** [make-package] Error 2
make[1]: *** [default] Error 2
make: *** [package] Error 2

Comment 1

[Rail Aliiev [:rail]]

Comment on attachment 8698771 [details] [diff] [review]
mozhareness_package_mkdir.diff

in case if glandium can look at this earlier.

Comment 2

[Mike Hommey [:glandium]]

Comment on attachment 8698771 [details] [diff] [review]
mozhareness_package_mkdir.diff

Review of attachment 8698771 [details] [diff] [review]:
-----------------------------------------------------------------

::: toolkit/mozapps/installer/packager.mk
@@ +55,5 @@
>  		$(if $(filter omni,$(MOZ_PACKAGER_FORMAT)),$(if $(NON_OMNIJAR_FILES),--non-resource $(NON_OMNIJAR_FILES)))
>  	$(PYTHON) $(MOZILLA_DIR)/toolkit/mozapps/installer/find-dupes.py $(DIST)/$(STAGEPATH)$(MOZ_PKG_DIR)
>  ifndef MOZ_THUNDERBIRD
>  	# Package mozharness
> +	$(NSINSTALL) -D $(DIST)/$(PKG_PATH)

I'd rather add an ensureParentDirectory in python/mozbuild/mozbuild/action/test_archive.py instead.

Comment 3

[Rail Aliiev [:rail]]

Attachment: mozhareness_package_ensureParentDir.diff

testing this...

Comment 4

[Rail Aliiev [:rail]]

Comment on attachment 8698784 [details] [diff] [review]
mozhareness_package_ensureParentDir.diff

take 2

Comment 5

[Rail Aliiev [:rail]]

Comment on attachment 8698784 [details] [diff] [review]
mozhareness_package_ensureParentDir.diff

https://hg.mozilla.org/integration/mozilla-inbound/rev/b9e20e475147

Comment 6

[Rail Aliiev [:rail]]

Comment on attachment 8698784 [details] [diff] [review]
mozhareness_package_ensureParentDir.diff

This is blocking beta 1 at the moment. It looks trivial enough to me.

Comment 7

[Phil Ringnalda (:philor)]

https://hg.mozilla.org/releases/mozilla-beta/rev/48a7f4361f2f

Comment 8

[Phil Ringnalda (:philor)]

Arguably I should have landed it with a=rituwantedtowakeuptoagreentree, but then I would have had to stare at that to determine whether or not the word-breaks were unambiguous, and anyway I like to preserve our right to land anything we want as a=bustage during the interregnum on aurora and beta.

Comment 9

[Ritu Kothari (:ritu) (Inactive, please n-i to RyanVM, jcristau, or pascal)]

(In reply to Phil Ringnalda (:philor) from comment #8)
> Arguably I should have landed it with a=rituwantedtowakeuptoagreentree, but
> then I would have had to stare at that to determine whether or not the
> word-breaks were unambiguous, and anyway I like to preserve our right to
> land anything we want as a=bustage during the interregnum on aurora and beta.

LOL, you should have done it! :) Will rubberstamp as it did make the tree significantly green.

Comment 10

[Ritu Kothari (:ritu) (Inactive, please n-i to RyanVM, jcristau, or pascal)]

Comment on attachment 8698784 [details] [diff] [review]
mozhareness_package_ensureParentDir.diff

Rail said this is needed on Aurora too, a+

Comment 11

[Carsten Book [:Tomcat]]

https://hg.mozilla.org/mozilla-central/rev/b9e20e475147

Comment 12

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/releases/mozilla-aurora/rev/20e69b35c57e