658602 - Decreasing COMPILE phase time in buildbot by 50%

Status: VERIFIED FIXED

(Tamarin Graveyard :: Build Config, defect, P2)

Description

[Brent Baker]

I was thinking that we could lower the compile phase from 20 minutes down to 10 minutes if:

1) We accept the fact that SPARC is NOT a tier one platform and move it entirely to the deep phase of the build
2) We move the compilation of the test media off of the linux64 slave and put it onto the mac64 slave

Solaris Compile phase data:
  solaris.total -> 19:28
  This is the current long pole for the compile phase

Linux64 Compile phase data:
  linux64.total -> 14 mintues
  linux64.compileAS -> 3.5 mintues
  linux64.newTotal-> 10.5 minutes
  This is the second long pole in the compile phase, and will be the new long pole by just a couple of minutes if this work is done.

Mac64 Compile phase data:
  mac64.total -> 2:40
  mac64.compileAS -> 45 seconds
  mac64.newTotal -> 3:25

Comment 1

[Edwin Smith]

nice!

Comment 2

[Brent Baker]

If we completely drop solaris from the build system we could chop off 3 hours from the deep phase of the build. Solaris is currently the long pole there @ 10 hours, next builder is taking 7 hours.

Comment 3

[Edwin Smith]

will 7 vs 10 hours matter to anybody? ie. whats the benefit?

Comment 4

[Edwin Smith]

(not that 3h isn't good of course).  What configurations do we build on solaris?  i'd be in favor of paring it back, if we can, before dropping it entirely.

Is it possible for an external agent (oracle, maybe) to manage build slaves so we know when stuff breaks, even though we don't have the machines locally?

Comment 5

[Edwin Smith]

Can a solaris x86 vmware machine cross-compile to sparc?

Comment 6

[James Sudduth]

Attachment: Remove solaris from the build.

Removes solaris from the all phases of the buildbot builds. Does not touch any source code references.

Comment 7

[Tamarin Bot]

changeset: 6413:0ee1249729a3
user:      James Sudduth <[e-mail]>
summary:   Bug 658602 - Decreasing COMPILE phase time in buildbot by 50% r=cpeyer)

http://hg.mozilla.org/tamarin-redux/rev/0ee1249729a3

Comment 8

[Tamarin Bot]

changeset: 6416:fb5459b4763d
user:      James Sudduth <[e-mail]>
summary:   Bug 658602 - Decreasing COMPILE phase time in buildbot by 50% (r=cpeyer) - followup for upload test media failure

http://hg.mozilla.org/tamarin-redux/rev/fb5459b4763d

Comment 9

[James Sudduth]

Attachment: Fixes a problem with uploading compiled test media.

The linux64 machine needed to call util_upload_asteam instead of util_upload_asteam_local, and the mac64-intel box needed to do the opposite since it's compiling the test media now.

Comment 10

[Brent Baker]

Jim: As a follow up task can you clean up the linux64/scripts directory.

Remove the following dead scripts:
- upload-asteam.sh
- upload-mozilla.sh
- build-check.sh **

** I am not sure why this build slave is using a local script to do this check since it matches the common script. Would be best to change build step definition to call the common "build-check" and then remove this local script.

Comment 11

[James Sudduth]

Attachment: Remove unneeded scripts.

Comment 12

[Tamarin Bot]

changeset: 6422:51a682e946bd
user:      James Sudduth <[e-mail]>
summary:   Bug 658602 - Decreasing COMPILE phase time in buildbot by 50% (r=cpeyer) - remove unneeded scripts

http://hg.mozilla.org/tamarin-redux/rev/51a682e946bd