775539 - Build SeaMonkey using clang

Status: RESOLVED FIXED

(SeaMonkey :: Release Engineering, defect)

Description

[Edmund Wong (:ewong)]

Mozilla-central has changed their OSX build to use clang, and with
that the mozilla/build/macosx/common was changed which our buildslaves
complained about: 

TEST-UNEXPECTED-FAIL | check-sync-dirs.py | build file copies are not in sync
TEST-INFO | check-sync-dirs.py | file(s) found in:               /builds/slave/comm-cen-trunk-osx-dbg/build/build
TEST-INFO | check-sync-dirs.py | differ from their originals in: /builds/slave/comm-cen-trunk-osx-dbg/build/mozilla/build
TEST-INFO | check-sync-dirs.py | differing file:                 ./macosx/common

while changing the macosx/common file is simple,  clang needs to be installed.

Comment 1

[Edmund Wong (:ewong)]

Attachment: Workaround to unbust OSX builds until clang is installed.

My comments on this patch:
https://wiki.mozilla.org/User:Ewong/osxbustagereport

Comment 2

[Edmund Wong (:ewong)]

(In reply to Edmund Wong (:ewong) from comment #1)
> Created attachment 644200 [details] [diff] [review]
> Workaround to unbust OSX builds until clang is installed.
> 
> My comments on this patch:
> https://wiki.mozilla.org/User:Ewong/osxbustagereport

Pushed to comm-central:
http://hg.mozilla.org/comm-central/rev/ecf5155354d8

Comment 3

[Philip Chee]

Backed out. rs=me:
http://hg.mozilla.org/comm-central/rev/1483b2b4ed8c

Comment 4

[Edmund Wong (:ewong)]

Attachment: suite/ changes to enable clang on macosx and linux. (v1)

Comment 5

[Edmund Wong (:ewong)]

Attachment: buildbot-config/ changes to enable builds with clang on macosx and linux. (v1)

Comment 6

[Rail Aliiev [:rail]]

Comment on attachment 644568 [details] [diff] [review]
buildbot-config/ changes to enable builds with clang on macosx and linux. (v1)

In overall it looks good, but missing one mandatory variable: tooltool_url_list. See http://hg.mozilla.org/build/buildbot-configs/file/668ac0e7b1a3/mozilla/production_config.py#l83

BTW, since you're going to use tooltool, you'll need either have access to http://runtime-binaries.pvt.build.mozilla.org or have your own copy of those files. What's your plan here?

Comment 7

[Rail Aliiev [:rail]]

Comment on attachment 644566 [details] [diff] [review]
suite/ changes to enable clang on macosx and linux. (v1)

I haven't checked the values, but lgtm.

Comment 8

[Rail Aliiev [:rail]]

BTW, Firefox still uses gcc to build linux/linux64. Do you really want to use calng for these platforms?

Comment 9

[Edmund Wong (:ewong)]

(In reply to Rail Aliiev [:rail] from comment #8)
> BTW, Firefox still uses gcc to build linux/linux64. Do you really want to
> use calng for these platforms?

Oh.. my over-ambitious c&p..  so I just basically remove the linux/linux64 lines
and it's still good to go?

Comment 10

[Rail Aliiev [:rail]]

(In reply to Edmund Wong (:ewong) from comment #9)
> (In reply to Rail Aliiev [:rail] from comment #8)
> > BTW, Firefox still uses gcc to build linux/linux64. Do you really want to
> > use calng for these platforms?
> 
> Oh.. my over-ambitious c&p..  so I just basically remove the linux/linux64
> lines
> and it's still good to go?

Yeah, it should just work.

Comment 11

[Edmund Wong (:ewong)]

Attachment: buildbot-config/ changes to enable builds with clang on macosx(v2)

Comment 12

[Justin Wood (:Callek)]

Comment on attachment 644566 [details] [diff] [review]
suite/ changes to enable clang on macosx and linux. (v1)

Review of attachment 644566 [details] [diff] [review]:
-----------------------------------------------------------------

r- for two reasons,

#1 we can't do this until we can use a tooltool server that has clang (I'm working on that)
#2 lets make the mac ones like the Firefox setup, and bump the clang version we use to match that of Firefox http://mxr.mozilla.org/comm-central/source/mozilla/browser/config/tooltool-manifests/

Comment 13

[Justin Wood (:Callek)]

Comment on attachment 644589 [details] [diff] [review]
buildbot-config/ changes to enable builds with clang on macosx(v2)

Review of attachment 644589 [details] [diff] [review]:
-----------------------------------------------------------------

We're now using tooltool on linux for Firefox, lets adjust this per my previous comments and do it for Linux as well... see- http://mxr.mozilla.org/build/search?string=tooltool_manifes&find=%2Fconfig.py&findi=&filter=^[^\0]*%24&hitlimit=&tree=build

We'll need a buildbotcustom patch as well, which I'll try to get complete ASAP, but it looks like it will slip past our "support gcc on mac" cutoff. A few days of bustage on trunk should be manageable though.

Comment 14

[Edmund Wong (:ewong)]

Attachment: Build SeaMonkey using clang (v2)

Comment 15

[Justin Wood (:Callek)]

Comment on attachment 655535 [details] [diff] [review]
Build SeaMonkey using clang (v2)

This needs to land before the stuff in Bug 785815 and looks good, but you're still behind on the mac clang versions.

I had r161022 up in our temp location, but I'm adding r161152 now, can you update the attachment to do the following:

* All clang versions updated to r161152 per current m-c http://hg.mozilla.org/mozilla-central/rev/a412d39f5526
* Don't add the clang.manifest files in mac*/ folders.

Comment 16

[Edmund Wong (:ewong)]

Attachment: tooltool manifests for SeaMonkey to build clang. (v3)

Comment 17

[Edmund Wong (:ewong)]

Attachment: buildbot-config/ changes to enable builds with clang on macosx and linux(v3

Comment 18

[Justin Wood (:Callek)]

Comment on attachment 657676 [details] [diff] [review]
buildbot-config/ changes to enable builds with clang on macosx and linux(v3

Review of attachment 657676 [details] [diff] [review]:
-----------------------------------------------------------------

r+ with nits below.

We'll need to land an *empty* releng.manifest (like the linux releng.manifest files in the other patch here) to *all* trees before this lands, comm-aurora, comm-beta and comm-release. Once we see good results on trunk, we can turn on clang on aurora for mac without any problems.

::: seamonkey/config.py
@@ +157,5 @@
>              'enable_opt_unittests': False,
>              'enable_checktests': True,
>              'talos_masters': GLOBAL_VARS['talos_masters'],
>              'stage_product': 'seamonkey',
> +            'tooltool_manifest_src': 'suite/config/tooltool-manifests/linux32/clang.manifest',

Since m-c doesn't build linux with clang by default yet, we want releng.manifest here

@@ +195,5 @@
>              'enable_opt_unittests': False,
>              'enable_checktests': True,
>              'talos_masters': GLOBAL_VARS['talos_masters'],
>              'stage_product': 'seamonkey',
> +            'tooltool_manifest_src': 'suite/config/tooltool-manifests/linux64/clang.manifest',

here too

Comment 19

[Justin Wood (:Callek)]

Comment on attachment 657676 [details] [diff] [review]
buildbot-config/ changes to enable builds with clang on macosx and linux(v3

Review of attachment 657676 [details] [diff] [review]:
-----------------------------------------------------------------

r- with nits below.

We'll need to land an *empty* releng.manifest (like the linux releng.manifest files in the other patch here) to *all* trees before this lands, comm-aurora, comm-beta and comm-release. Once we see good results on trunk, we can turn on clang on aurora for mac without any problems.

I might be confused, but looks like https://bugzilla.mozilla.org/attachment.cgi?id=657672&action=edit is what you meant to attach, so r- here I'll r+ that one.

::: seamonkey/config.py
@@ +157,5 @@
>              'enable_opt_unittests': False,
>              'enable_checktests': True,
>              'talos_masters': GLOBAL_VARS['talos_masters'],
>              'stage_product': 'seamonkey',
> +            'tooltool_manifest_src': 'suite/config/tooltool-manifests/linux32/clang.manifest',

Since m-c doesn't build linux with clang by default yet, we want releng.manifest here

@@ +195,5 @@
>              'enable_opt_unittests': False,
>              'enable_checktests': True,
>              'talos_masters': GLOBAL_VARS['talos_masters'],
>              'stage_product': 'seamonkey',
> +            'tooltool_manifest_src': 'suite/config/tooltool-manifests/linux64/clang.manifest',

here too

Comment 20

[Edmund Wong (:ewong)]

Attachment: buildbot-config/ changes to enable builds with clang on macosx & linux(v4)

Comment 21

[Edmund Wong (:ewong)]

Pushed to comm-central:
http://hg.mozilla.org/comm-central/rev/2d62b93d17cf

Comment 22

[Justin Wood (:Callek)]

So tooltool is installed, and seems to checkout/run clang/etc fine... however something is still not right, we're getting an error in configure,

espindola, any thoughts on what might be wrong on our end?  [I tried a manual run with the older clang as is in use with TB now, and no luck.]


configure:1477: checking whether the host c compiler (/builds/slave/comm-cen-trunk-osx64-ntly/build/mozilla/../cl
ang/bin/clang -gdwarf-2 ) works
configure:1486: /builds/slave/comm-cen-trunk-osx64-ntly/build/mozilla/../clang/bin/clang -c -gdwarf-2  conftest.c
 1>&5
configure:1501: checking whether the host c++ compiler (/builds/slave/comm-cen-trunk-osx64-ntly/build/mozilla/../
clang/bin/clang++ -gdwarf-2 ) works
configure:1510: /builds/slave/comm-cen-trunk-osx64-ntly/build/mozilla/../clang/bin/clang++ -c -gdwarf-2  conftest
.c 1>&5
clang: warning: treating 'c' input as 'c++' when in C++ mode, this behavior is deprecated
configure:1539: checking for /builds/slave/comm-cen-trunk-osx64-ntly/build/mozilla/../clang/bin/clang
configure:1573: checking for gcc
configure:1686: checking whether the C compiler (/builds/slave/comm-cen-trunk-osx64-ntly/build/mozilla/../clang/b
in/clang -arch i386 -gdwarf-2 ) works
configure:1702: /builds/slave/comm-cen-trunk-osx64-ntly/build/mozilla/../clang/bin/clang -arch i386 -o conftest -
gdwarf-2   conftest.c  1>&5
configure:1699:1: warning: type specifier missing, defaults to 'int' [-Wimplicit-int]
main(){return(0);}
^~~~
1 warning generated.
ld: unknown option: -demangle
clang: error: linker command failed with exit code 1 (use -v to see invocation)
configure: failed program was:

#line 1697 "configure"
#include "confdefs.h"

main(){return(0);}
cb-sea-miniosx64-01:i386 seabld$ ls

Comment 23

[Justin Wood (:Callek)]

Log of that failure is at http://tinderbox.mozilla.org/showlog.cgi?log=SeaMonkey/1346644206.1346644976.8079.gz&fulltext=1

Comment 24

[Justin Wood (:Callek)]

FYI cb-sea-miniosx64-01:build seabld$ /Developer/usr/bin/xcodebuild -version
Xcode 3.2.1
Component versions: DevToolsCore-1614.0; DevToolsSupport-1591.0
BuildVersion: 10M2003

Comment 25

[Justin Wood (:Callek)]

For comparison:

bld-lion-r5-070:~ cltbld$ ld -v
@(#)PROGRAM:ld  PROJECT:ld64-123.2.1
llvm version 3.0svn, from Apple Clang 2.1 (build 163.7.1)
bld-lion-r5-070:~ cltbld$ /Developer/usr/bin/xcodebuild -version
Xcode 4.1
Build version 4B110
bld-lion-r5-070:~ cltbld$

Would my guess be right that I need to update XCode version?