Decreasing COMPILE phase time in buildbot by 50%

VERIFIED FIXED in Q4 11 - Anza

Status

P2
normal
VERIFIED FIXED
8 years ago
7 years ago

People

(Reporter: brbaker, Assigned: jsudduth)

Tracking

unspecified
Q4 11 - Anza
Bug Flags:
flashplayer-injection -
flashplayer-qrb +
flashplayer-bug -
flashplayer-triage +

Details

(Whiteboard: buildbot build-speedup)

Attachments

(3 attachments)

(Reporter)

Description

8 years ago
I was thinking that we could lower the compile phase from 20 minutes down to 10 minutes if:

1) We accept the fact that SPARC is NOT a tier one platform and move it entirely to the deep phase of the build
2) We move the compilation of the test media off of the linux64 slave and put it onto the mac64 slave

Solaris Compile phase data:
  solaris.total -> 19:28
  This is the current long pole for the compile phase

Linux64 Compile phase data:
  linux64.total -> 14 mintues
  linux64.compileAS -> 3.5 mintues
  linux64.newTotal-> 10.5 minutes
  This is the second long pole in the compile phase, and will be the new long pole by just a couple of minutes if this work is done.

Mac64 Compile phase data:
  mac64.total -> 2:40
  mac64.compileAS -> 45 seconds
  mac64.newTotal -> 3:25
Flags: flashplayer-triage+
Flags: flashplayer-qrb?
Flags: flashplayer-bug-

Comment 1

8 years ago
nice!

Updated

8 years ago
Assignee: nobody → jsudduth
Status: NEW → ASSIGNED
Flags: flashplayer-qrb?
Flags: flashplayer-qrb+
Flags: flashplayer-injection-
Priority: -- → P3
Target Milestone: --- → Q4 11 - Anza
(Reporter)

Updated

8 years ago
Whiteboard: buildbot → buildbot build-speedup

Updated

8 years ago
Priority: P3 → P2
(Reporter)

Comment 2

8 years ago
If we completely drop solaris from the build system we could chop off 3 hours from the deep phase of the build. Solaris is currently the long pole there @ 10 hours, next builder is taking 7 hours.

Comment 3

8 years ago
will 7 vs 10 hours matter to anybody? ie. whats the benefit?

Comment 4

8 years ago
(not that 3h isn't good of course).  What configurations do we build on solaris?  i'd be in favor of paring it back, if we can, before dropping it entirely.

Is it possible for an external agent (oracle, maybe) to manage build slaves so we know when stuff breaks, even though we don't have the machines locally?

Comment 5

8 years ago
Can a solaris x86 vmware machine cross-compile to sparc?
(Assignee)

Comment 6

7 years ago
Created attachment 541181 [details] [diff] [review]
Remove solaris from the build.

Removes solaris from the all phases of the buildbot builds. Does not touch any source code references.
Attachment #541181 - Flags: review?(cpeyer)

Comment 7

7 years ago
changeset: 6413:0ee1249729a3
user:      James Sudduth <jsudduth@adobe.com>
summary:   Bug 658602 - Decreasing COMPILE phase time in buildbot by 50% r=cpeyer)

http://hg.mozilla.org/tamarin-redux/rev/0ee1249729a3

Comment 8

7 years ago
changeset: 6416:fb5459b4763d
user:      James Sudduth <jsudduth@adobe.com>
summary:   Bug 658602 - Decreasing COMPILE phase time in buildbot by 50% (r=cpeyer) - followup for upload test media failure

http://hg.mozilla.org/tamarin-redux/rev/fb5459b4763d

Updated

7 years ago
Attachment #541181 - Flags: review?(cpeyer) → review+
(Assignee)

Comment 9

7 years ago
Created attachment 541229 [details] [diff] [review]
Fixes a problem with uploading compiled test media.

The linux64 machine needed to call util_upload_asteam instead of util_upload_asteam_local, and the mac64-intel box needed to do the opposite since it's compiling the test media now.
(Reporter)

Comment 10

7 years ago
Jim: As a follow up task can you clean up the linux64/scripts directory.

Remove the following dead scripts:
- upload-asteam.sh
- upload-mozilla.sh
- build-check.sh **

** I am not sure why this build slave is using a local script to do this check since it matches the common script. Would be best to change build step definition to call the common "build-check" and then remove this local script.
(Assignee)

Comment 11

7 years ago
Created attachment 541409 [details] [diff] [review]
Remove unneeded scripts.

Comment 12

7 years ago
changeset: 6422:51a682e946bd
user:      James Sudduth <jsudduth@adobe.com>
summary:   Bug 658602 - Decreasing COMPILE phase time in buildbot by 50% (r=cpeyer) - remove unneeded scripts

http://hg.mozilla.org/tamarin-redux/rev/51a682e946bd
(Assignee)

Updated

7 years ago
Status: ASSIGNED → RESOLVED
Last Resolved: 7 years ago
Resolution: --- → FIXED
(Assignee)

Updated

7 years ago
Status: RESOLVED → VERIFIED

Updated

7 years ago
Blocks: 695150
No longer blocks: 695150
You need to log in before you can comment on or make changes to this bug.