557715 - Enable Mac OS X 10.6 64-bit builds in production

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P2)

Description

[Chris Cooper [:coop] (he/him)]

After landing the changes in bug 557569, we're pretty close to being able to turn these builds on in production. There are a few things we need to do to make that happen:

* production config patch to match attachment 435204 [details] [diff] [review] (adding macosx64)
* moving the MAC_SNOW_MINIS from staging to production

Assigning directly to bear, but I fully intend to be helping him plow through it tomorrow morning.

Comment 1

[Mike Taylor [:bear]]

Attachment: add x86_64 os to config.py

adding snow leopard slave configurations to the production side

Comment 2

[Chris Cooper [:coop] (he/him)]

Comment on attachment 437577 [details] [diff] [review]
add x86_64 os to config.py

>+            'update_platform': 'Darwin_Universal-gcc3',

I think we've determined over in bug 552924 that this should be 'Darwin_x86_64-gcc3.' This should change in the staging config.py as well.

Comment 3

[Mike Taylor [:bear]]

Attachment: add x86_64 os to production config.py and associated files

fixed update target for production and also staging config.py

Comment 4

[Chris Cooper [:coop] (he/him)]

Comment on attachment 437628 [details] [diff] [review]
add x86_64 os to production config.py and associated files

http://hg.mozilla.org/build/buildbot-configs/rev/d3070df162e2

Comment 5

[Chris Cooper [:coop] (he/him)]

So I missed a couple of things in the reviews:
* mozconfigs for macosx64: 
http://hg.mozilla.org/build/buildbot-configs/rev/22c38ec1de67

* disabling unittests until we have symbols:
http://hg.mozilla.org/build/buildbot-configs/rev/27063cd480a7
http://hg.mozilla.org/build/buildbot-configs/rev/136bea326ee3

Incremental and nightly builds are working:
http://production-master.build.mozilla.org:8010/builders/OS%20X%2010.6.2%20mozilla-central%20build/builds/18
http://production-master.build.mozilla.org:8010/builders/OS%20X%2010.6.2%20mozilla-central%20nightly/builds/0

Shark build is failing in compile:
http://production-master.build.mozilla.org:8010/builders/OS%20X%2010.6.2%20mozilla-central%20shark/builds/0

The XR build is failing in packaging:
http://production-master.build.mozilla.org:8010/builders/OS%20X%2010.6.2%20mozilla-central%20leak%20test%20build/builds/15

The leaktest build is seeing an intermittent failure when running its Alive Test:
http://production-master.build.mozilla.org:8010/builders/OS%20X%2010.6.2%20mozilla-central%20leak%20test%20build/builds/15

Bear: can you make sure we have bugs on file for those 3 failures, please?

Comment 6

[Chris Cooper [:coop] (he/him)]

(In reply to comment #5)
> The XR build is failing in packaging:

That link should be:
http://production-master.build.mozilla.org:8010/builders/OS%20X%2010.6.2%20mozilla-central%20xulrunner/builds/0

Comment 7

[Armen [:armenzg]]

(In reply to comment #5)
> * disabling unittests until we have symbols:
NOTE that we will enable unit tests on talos snow leopard slaves.

Comment 8

[(not currently active) Ted Mielczarek]

(In reply to comment #5)
> Shark build is failing in compile:
> http://production-master.build.mozilla.org:8010/builders/OS%20X%2010.6.2%20mozilla-central%20shark/builds/0

g++-4.2 -o jsdbgapi.o -c -fvisibility=hidden  -DOSTYPE=\"Darwin10.2.0\" -DOSARCH=Darwin -DEXPORT_JS_API  -DJS_HAS_CTYPES -Ictypes/libffi/include  -I/builds/slave/mozilla-central-macosx64-shark/build/js/src -I. -I./../../dist/include -I./../../dist/include/nsprpub  -I/builds/slave/mozilla-central-macosx64-shark/build/obj-firefox/dist/include/nspr   -I/builds/slave/mozilla-central-macosx64-shark/build/js/src  -fPIC  -fno-rtti -fno-exceptions -Wall -Wpointer-arith -Woverloaded-virtual -Wsynth -Wno-ctor-dtor-privacy -Wno-non-virtual-dtor -Wcast-align -Wno-invalid-offsetof -Wno-variadic-macros -Wno-long-long -gdwarf-2 -isysroot /Developer/SDKs/MacOSX10.5.sdk -fno-strict-aliasing -fpascal-strings -fno-common -pthread -pipe  -DNDEBUG -DTRIMMED -gdwarf-2 -F/System/Library/PrivateFrameworks -O3 -fstrict-aliasing  -F/System/Library/PrivateFrameworks   -DMOZILLA_CLIENT -include ./js-confdefs.h -Wp,-MD,.deps/jsdbgapi.pp /builds/slave/mozilla-central-macosx64-shark/build/js/src/jsdbgapi.cpp
/builds/slave/mozilla-central-macosx64-shark/build/js/src/jsdbgapi.cpp:1842:23: error: CHUD/CHUD.h: No such file or directory

You appear to be missing the CHUD framework here.

Comment 9

[(not currently active) Ted Mielczarek]

(In reply to comment #5)
> The leaktest build is seeing an intermittent failure when running its Alive
> Test:
> http://production-master.build.mozilla.org:8010/builders/OS%20X%2010.6.2%20mozilla-central%20leak%20test%20build/builds/15

This is segfaulting (exit code -11), but we don't have crash reporting on OS X/x86-64 yet, so we don't get a stack. :-/

Comment 10

[Mike Taylor [:bear]]

(In reply to comment #8)
> (In reply to comment #5)
> > Shark build is failing in compile:
> > http://production-master.build.mozilla.org:8010/builders/OS%20X%2010.6.2%20mozilla-central%20shark/builds/0
> 
> g++-4.2 -o jsdbgapi.o -c -fvisibility=hidden  -DOSTYPE=\"Darwin10.2.0\"
> -DOSARCH=Darwin -DEXPORT_JS_API  -DJS_HAS_CTYPES -Ictypes/libffi/include 
> -I/builds/slave/mozilla-central-macosx64-shark/build/js/src -I.
> -I./../../dist/include -I./../../dist/include/nsprpub 
> -I/builds/slave/mozilla-central-macosx64-shark/build/obj-firefox/dist/include/nspr
>   -I/builds/slave/mozilla-central-macosx64-shark/build/js/src  -fPIC  -fno-rtti
> -fno-exceptions -Wall -Wpointer-arith -Woverloaded-virtual -Wsynth
> -Wno-ctor-dtor-privacy -Wno-non-virtual-dtor -Wcast-align -Wno-invalid-offsetof
> -Wno-variadic-macros -Wno-long-long -gdwarf-2 -isysroot
> /Developer/SDKs/MacOSX10.5.sdk -fno-strict-aliasing -fpascal-strings
> -fno-common -pthread -pipe  -DNDEBUG -DTRIMMED -gdwarf-2
> -F/System/Library/PrivateFrameworks -O3 -fstrict-aliasing 
> -F/System/Library/PrivateFrameworks   -DMOZILLA_CLIENT -include ./js-confdefs.h
> -Wp,-MD,.deps/jsdbgapi.pp
> /builds/slave/mozilla-central-macosx64-shark/build/js/src/jsdbgapi.cpp
> /builds/slave/mozilla-central-macosx64-shark/build/js/src/jsdbgapi.cpp:1842:23:
> error: CHUD/CHUD.h: No such file or directory
> 
> You appear to be missing the CHUD framework here.

There isn't a CHUD framework to install on Snow Leopard - see

http://lists.apple.com/archives/perfoptimization-dev/2009/Sep/msg00071.html

Comment 11

[Mike Taylor [:bear]]

bug 558094 filed to track shark issue

Comment 12

[Mike Taylor [:bear]]

bug 558097 filed to track Leak test Alive check failures

Comment 13

[Mike Taylor [:bear]]

bug 558098 filed to track the XR make package failure

Comment 14

[Armen [:armenzg]]

Attachment: bustage fix for Snow Leopard on talos-staging-pool

Let's remove this until it can actually reconfigure.

Comment 15

[Armen [:armenzg]]

Comment on attachment 437931 [details] [diff] [review]
bustage fix for Snow Leopard on talos-staging-pool

http://hg.mozilla.org/build/buildbot-configs/rev/aa154b46b277

Comment 16

[Mike Taylor [:bear]]

10.6 slaves are now active, buildbotcustom changes have landed and the reconfigure surived and talos update/changes have landed.

marking as resolved