869659 - Cross-compiling JS shell broken since ICU landing

Status: RESOLVED FIXED

(Firefox Build System :: General, defect)

Description

[Christian Holler (:decoder)]

It seems that since ICU landed, I cannot cross-compile JS shells for ARM anymore. I am using this script:


#! /bin/sh
if [ -z $1 ] ; then
    echo "usage: $0 <dirname>"
elif [ -d $1 ] ; then
    echo "directory $1 already exists"
else
    autoconf2.13
    mkdir $1
    cd $1
    ../configure --enable-debug --enable-optimize --with-arch=armv7-a --target=arm-linux-gnueabi
    make --quiet -j 2
fi


When trying to build I get:

intl/icu/lib/libicui18n.a: could not read symbols: File format not recognized
collect2: ld returned 1 exit status
make[1]: *** [libmozjs-23.0a.so] Error 1
make: *** [default] Error 2


I also tried exporting CROSS_COMPILE=1 and setting CC/CXX to the arm variants, but then I'm getting this:


    checking for suffix of executables...
    checking whether we are cross compiling... configure: error: in `/srv/repos/mozilla-central/js/src/dbgarm/intl/icu':
    configure: error: cannot run C compiled programs.
    If you meant to cross compile, use `--host'.
    See `config.log' for more details
    /srv/repos/mozilla-central/js/src/../../intl/icu/source/runConfigureICU: ./configure failed
    ------ config.log ------
    configure:14098: arm-linux-gnueabi-gcc -c  -march=armv7-a -std=gnu99 -fgnu89-inline -ffunction-sections -fdata-sections -pthread -pipe -fprofile-generate -fprofile-correction  conftest.c 1>&5
    configure:14149: checking for correct overload resolution with const and templates
    configure:14184: arm-linux-gnueabi-g++ -c  -march=armv7-a -fno-rtti -ffunction-sections -fdata-sections -fno-exceptions -pthread -pipe  -Wall -Wpointer-arith -Woverloaded-virtual -Werror=return-type -Wtype-limits -Wempty-body -Werror=conversion-null -Wsign-compare -Wno-invalid-offsetof  conftest.C 1>&5
    configure: In function 'int main()':
    configure:14179:37: warning: 'bar' is used uninitialized in this function [-Wuninitialized]
    configure:14210: checking for tm_zone tm_gmtoff in struct tm
    configure:14222: arm-linux-gnueabi-g++ -c  -march=armv7-a -fno-rtti -ffunction-sections -fdata-sections -fno-exceptions -pthread -pipe  conftest.C 1>&5
    configure:14264: checking what kind of list files are supported by the linker
    configure:14269: arm-linux-gnueabi-gcc -o conftest.o -c  -march=armv7-a -std=gnu99 -fgnu89-inline -ffunction-sections -fdata-sections -pthread -pipe  conftest.c 1>&5
    configure:14271: arm-linux-gnueabi-gcc -o conftest -lpthread  -Wl,--build-id conftest.list -ldl  1>&5
    configure:14297: checking what kind of ordering can be done with the linker
    configure:14312: arm-linux-gnueabi-gcc -o conftest  -march=armv7-a -std=gnu99 -fgnu89-inline -ffunction-sections -fdata-sections -pthread -pipe  -lpthread  -Wl,--build-id -Wl,--section-ordering-file,conftest.order conftest.c -ldl  1>&5
    /usr/lib/gcc/arm-linux-gnueabi/4.6/../../../../arm-linux-gnueabi/bin/ld: unrecognized option '--section-ordering-file'
    /usr/lib/gcc/arm-linux-gnueabi/4.6/../../../../arm-linux-gnueabi/bin/ld: use the --help option for usage information
    collect2: ld returned 1 exit status
    configure: failed program was:
    #line 14305 "configure"
    #include "confdefs.h"
     
    int main() {
     
    ; return 0; }
    configure:14324: arm-linux-gnueabi-gcc -shared -Wl,-z,defs -Wl,--gc-sections -lpthread  -Wl,--build-id -o libconftest.so -Wl
    configure:14661: checking for posix_fallocate
    configure:14671: arm-linux-gnueabi-gcc -o conftest -Wall -Wpointer-arith -Wdeclaration-after-statement -Werror=return-type -Wtype-limits -Wempty-body -Wsign-compare -Wno-unused -march=armv7-a -std=gnu99 -fgnu89-inline -ffunction-sections -fdata-sections -pthread -pipe  -lpthread  -Wl,--build-id conftest.c -ldl  1>&5
    make: *** No targets specified and no makefile found.  Stop.

Comment 1

[Mike Hommey [:glandium]]

Quick notes from what I saw at quick glance:
- runConfigureICU doesn't support cross-compilation
- ICU's configure does support it, but you have to pass it a directory containing a native build (--with-cross-build=...), which means we have to do a manual native build first.

Comment 2

[Mike Hommey [:glandium]]

And building with CC="gcc -m32" is broken, too. In fact runConfigureICU sets its own CC, so even building with CC="clang" is broken if you don't have gcc. Interestingly, it doesn't set its own CC on OSX...

https://tbpl.mozilla.org/php/getParsedLog.php?id=22721722&tree=Date

Comment 3

[Ryan VanderMeulen [:RyanVM]]

Bug 853301 backed out on inbound.
https://hg.mozilla.org/integration/mozilla-inbound/rev/97e73b69c279

Comment 4

[Norbert Lindenberg]

For which Mozilla product do you need to cross-compile the JS shell to ARM? Firefox on Android? Firefox OS? If it's just these two, you can use --disable-intl-api for now, and make this bug a blocker for bug 864843 and/or bug 866301.

Comment 5

[Mike Hommey [:glandium]]

(In reply to Norbert Lindenberg from comment #4)
> For which Mozilla product do you need to cross-compile the JS shell to ARM?
> Firefox on Android? Firefox OS? If it's just these two, you can use
> --disable-intl-api for now, and make this bug a blocker for bug 864843
> and/or bug 866301.

See bug 853301 comment 13.

Comment 6

[Mike Hommey [:glandium]]

Essentially, we need to stop using runConfigureICU and manually call configure with the right variables and arguments for our build. That's the first thing that would solve the 32-bits build on 64-bits toolchain problem. Then there's cross compilation, which requires a double configure-double build setup.

Comment 7

[Christian Holler (:decoder)]

(In reply to Norbert Lindenberg from comment #4)
> For which Mozilla product do you need to cross-compile the JS shell to ARM?

It's not a specific Mozilla product, we're just using the JS shell on ARM to test ARM-specific parts of the JS engine more easily. But you're right, we could disable ICU for that purpose.

From comment 6 it sounds like 32 vs. 64 bit is also affected here? We're also building 32 bit shells on our 64 bit servers.

Comment 8

[Matt Brubeck (:mbrubeck)]

(In reply to Christian Holler (:decoder) from comment #7)
> From comment 6 it sounds like 32 vs. 64 bit is also affected here? We're
> also building 32 bit shells on our 64 bit servers.

And we plan to switch to building Desktop Firefox for 32-bit Linux on 64-bit builders soon (bug 857697).  This may become urgent if memory to link libxul on Linux keeps rising.

Comment 9

[Jeff Walden [:Waldo]]

I guess I'll take this, although if the going gets too interesting I may punt to someone who actually understands our build and cross-compilation code.

Comment 10

[Mike Hommey [:glandium]]

So in fact, for the 32-bits build on 64-bits toolchain problem, adding CC="$CC" CXX="$CXX" to the runConfigureICU command should be enough, because I misread, it's not overriding CC/CXX, it's just not inheriting it (and ends up using clang if it's installed, even when the rest uses gcc...).

Arguably, we may want to add some or all of our build flags, too (like, optimization, pgo, -ffunction-section -fdata-section, etc.).

Comment 11

[Gregory Szorc [:gps]]

Are we going to let ICU slip to 24 because of this? ICU blew up the weekend before the 22 train and I don't want to see a repeat.

What are we going to do about this?

Comment 12

[Jeff Walden [:Waldo]]

Norbert was contracting, and his contract ended, so you want me now for this.  :-)

I was working on importing test262 into the tree to get more JS test coverage as my biggest priority.  But the clock does argue for dropping that for at least a few days to pick this up.  I'll see what I can do before uplift.

Comment 13

[Jeff Walden [:Waldo]]

Attachment: Compile ICU using the CC/CXX determined by Mozilla, not as selected by ICU

The 64-to-32 Linux compilation steps on https://developer.mozilla.org/en-US/docs/SpiderMonkey/Build_Documentation work with this, so this is at least a partial improvement.  Is more needed?

Comment 14

[Jeff Walden [:Waldo]]

Comment on attachment 748125 [details] [diff] [review]
Compile ICU using the CC/CXX determined by Mozilla, not as selected by ICU

Does this work for the fuzzers, or is more needed?

Comment 15

[Christian Holler (:decoder)]

(In reply to Jeff Walden [:Waldo] (remove +bmo to email) from comment #14)

> Does this work for the fuzzers, or is more needed?

I really need cross compiling to ARM, otherwise it's going to get really hard to keep fuzzing the JS shell in my qemu instances. Compiling in the qemu instance natively is going to be extremely slow.

Comment 16

[Jeff Walden [:Waldo]]

(In reply to Christian Holler (:decoder) from comment #15)
> I really need cross compiling to ARM

Sure.  Does this patch work for that?  I only mentioned 64-to-32 because that's the easiest cross-compiling setup for me to test -- I'd naively expect that would also fix ARM cross-compiling, but I really don't know.  :-)  Ergo the request to try and see if it does.

Comment 17

[Jeff Walden [:Waldo]]

Apparently not.  And apparently 64-to-32 ain't really cross-compiling, either.  Working on setting up an ARM toolchain now to debug here, but anyone who knows anything about cross-compiling will probably make faster progress than I will.  :-)

Comment 18

[Jeff Walden [:Waldo]]

Or, no.  ICU apparently has to be built for the host system, then built for the target system, to cross-compile.  Looking into this now:

http://source.icu-project.org/repos/icu/icu/trunk/readme.html#HowToCrossCompileICU

Comment 19

[Christian Holler (:decoder)]

I figured out that with --disable-intl-api I'm able to cross-compile for ARM, so that's at least a way to make this less of a blocker for now :) It would still be good to resolve it, but for now it should be good with that option for ARM testing.

Comment 20

[Mike Hommey [:glandium]]

Comment on attachment 748125 [details] [diff] [review]
Compile ICU using the CC/CXX determined by Mozilla, not as selected by ICU

Review of attachment 748125 [details] [diff] [review]:
-----------------------------------------------------------------

This should enough for 32-on-64 builds as mentioned in comment 10. You can test by relanding bug 853301 along with this patch on the "date" project branch.

Comment 21

[Mike Hommey [:glandium]]

(In reply to Jeff Walden [:Waldo] (remove +bmo to email) from comment #18)
> Or, no.  ICU apparently has to be built for the host system, then built for
> the target system, to cross-compile.  Looking into this now:
> 
> http://source.icu-project.org/repos/icu/icu/trunk/readme.
> html#HowToCrossCompileICU

See comment 6.

(In reply to Mike Hommey [:glandium] from comment #20)
> This should enough for 32-on-64 builds as mentioned in comment 10. You can
> test by relanding bug 853301 along with this patch on the "date" project
> branch.

That being said, bug 853301 can't reland as-is. A new patch will have to be written to make the change in configure instead of mozconfig.

Comment 22

[Christian Holler (:decoder)]

Comment on attachment 748125 [details] [diff] [review]
Compile ICU using the CC/CXX determined by Mozilla, not as selected by ICU

Canceling feedback here, as this doesn't resolve the cross-compilation issues.

Comment 23

[Jeff Walden [:Waldo]]

Landed the use-CC/CXX patch, spinning up a mobile build environment now to continue work here:

https://hg.mozilla.org/integration/mozilla-inbound/rev/ddccec687149

Comment 24

[Ed Morley [:emorley]]

https://hg.mozilla.org/mozilla-central/rev/ddccec687149

Comment 25

[Ryan VanderMeulen [:RyanVM]]

https://hg.mozilla.org/mozilla-central/rev/ecdfb39891a7

Comment 26

[Jan Beich]

Comment on attachment 748125 [details] [diff] [review]
Compile ICU using the CC/CXX determined by Mozilla, not as selected by ICU

Doesn't help on a system without gcc.

$ /m/js/src/configure
...
export CPP= CC=gcc CXX=g++ CPPFLAGS= -DU_USING_ICU_NAMESPACE=0 -DU_NO_DEFAULT_INCLUDE_UTF_HEADERS=1 -DUCONFIG_NO_LEGACY_CONVERSION -DUCONFIG_NO_TRANSLITERATION -DUCONFIG_NO_REGULAR_EXPRESSIONS -DUCONFIG_NO_BREAK_ITERATION CFLAGS=-fPIC -O3 CXXFLAGS=-fPIC -O3 LDFLAGS= MAKE=
Running ./configure  --enable-static --disable-shared --enable-extras=no --enable-icuio=no --enable-layout=no --enable-tests=no --enable-samples=no for BSD using the GNU C++ compiler

checking for ICU version numbers... release 50.1.2, library 50.1.2, unicode version 6.2
checking build system type... x86_64-unknown-freebsd10.0
checking host system type... x86_64-unknown-freebsd10.0
checking whether to build debug libraries... no
checking whether to build release libraries... yes
checking whether the C compiler works... no
configure: error: in `/cache/m/js/src/intl/icu':
configure: error: C compiler cannot create executables
See `config.log' for more details
/m/js/src/../../intl/icu/source/runConfigureICU: ./configure failed
------ config.log ------
configure:14348:37: note: initialize the variable 'bar' to silence this warning
                      const int* bar;
                                    ^
                                     = nullptr
1 warning generated.
configure:14380: checking for tm_zone tm_gmtoff in struct tm
configure:14392: c++ -c  -fno-rtti -ffunction-sections -fdata-sections -fno-exceptions -std=gnu++0x -pipe -Qunused-arguments   -I/usr/local/include conftest.C 1>&5
configure:14434: checking what kind of list files are supported by the linker
configure:14439: cc -o conftest.o -c  -std=gnu99 -fgnu89-inline -ffunction-sections -fdata-sections -pipe -Qunused-arguments   -I/usr/local/include conftest.c 1>&5
configure:14441: cc -o conftest -pthread  -Wl,-z,noexecstack -Wl,-z,text -Wl,--build-id conftest.list  1>&5
configure:14467: checking what kind of ordering can be done with the linker
configure:14482: cc -o conftest  -std=gnu99 -fgnu89-inline -ffunction-sections -fdata-sections -pipe -Qunused-arguments   -I/usr/local/include -pthread  -Wl,-z,noexecstack -Wl,-z,text -Wl,--build-id -Wl,--section-ordering-file,conftest.order conftest.c  1>&5
/usr/local/bin/ld: unrecognized option '--section-ordering-file'
/usr/local/bin/ld: use the --help option for usage information
cc: error: linker command failed with exit code 1 (use -v to see invocation)
configure: failed program was:
#line 14475 "configure"
#include "confdefs.h"

int main() {

; return 0; }
configure:14494: cc -shared -Wl,-z,defs -pthread  -Wl,-z,noexecstack -Wl,-z,text -Wl,--build-id -o libconftest.so -Wl
configure:14831: checking for posix_fallocate
configure:14841: cc -o conftest -Qunused-arguments -Wall -Wpointer-arith -Wdeclaration-after-statement -Werror=return-type -Werror=implicit-function-declaration -Wtype-limits -Wempty-body -Wsign-compare -Wno-unused -std=gnu99 -fgnu89-inline -ffunction-sections -fdata-sections -pipe -Qunused-arguments   -I/usr/local/include -pthread  -Wl,-z,noexecstack -Wl,-z,text -Wl,--build-id conftest.c  1>&5
zsh: exit 1

Comment 27

[Jan Beich]

Nevermind. A few platforms in runConfigureICU don't inherit CC/CXX
from js/src/configure. I've solved my error with attachment 790417 [details] [diff] [review].

Comment 28

[Makoto Kato [:m_kato]]

decoder, although I think that this is fixed by bug 912371 except to Android and Gonk, does this bug still occur?

Comment 29

[(not currently active) Ted Mielczarek]

I believe bug 1036645 fixed this.