1106922 - Stop using in-house linux machines for build and try

Status: RESOLVED FIXED

(Infrastructure & Operations Graveyard :: CIDuty, task)

Description

[Chris Cooper [:coop] (he/him)]

As part of pushing more into the cloud, we should stop running linux build and try jobs on in-house machines. Having a single, AWS-based platform will make management easier.

We preferentially run release builds on in-house hardware right now, but in conversation with catlee, we will use AWS slaves if no in-house machines are available.

Comment 1

[Rail Aliiev [:rail]]

Attachment: no_hw-buildbotcustom.diff

Let's use spot instances for all release builders?

Comment 2

[Rail Aliiev [:rail]]

Comment on attachment 8531605 [details] [diff] [review]
no_hw-buildbotcustom.diff

https://hg.mozilla.org/build/buildbotcustom/rev/6dd9c3cf24cb

Comment 3

[Jordan Lund (:jlund)]

In production: https://hg.mozilla.org/build/buildbotcustom/rev/6dd9c3cf24cb

Comment 4

[Phil Ringnalda (:philor)]

Can we go ahead and stop using them completely and decomm them, since we're now not using them for releases, which were the only reason we kept them around? After 5 hazard builds in a row on mozilla-beta on hp slaves died by exceeding their maxtime, I disabled all of them, but only one of the two I ran on ix slaves managed to finish, so now I disabled all of them, too.

Comment 5

[Chris AtLee [:catlee]]

Attachment: remove old hp/ix slave types from buildbot-configs

Comment 6

[Justin Wood (:Callek)]

Comment on attachment 8557950 [details] [diff] [review]
remove old hp/ix slave types from buildbot-configs

Review of attachment 8557950 [details] [diff] [review]:
-----------------------------------------------------------------

Should be noted, that we're switching Thunderbird jobs from in-house physical machines to EC2. Which could in theory cause is more cost. Its absolutely the right choice when we don't have anymore inhouse stuff to run them on though. :-)


We should also fix the following to account for this patch while we're at it:
http://mxr.mozilla.org/build/source/buildbot-configs/mozilla2-staging/config.py
http://mxr.mozilla.org/build/source/buildbot-configs/mozilla/BuildSlaves.py.template#15  (and puppet for this as a followup)

(neither need a review for buildbot-configs imho, so consider this comment your rubber stamp)

::: mozilla/thunderbird_production_config.py
@@ +3,5 @@
>  from localconfig import \
>      GLOBAL_VARS, MAC_LION_MINIS, \
> +    LINUX64_EC2, \
> +    WIN32_IXS, WIN64_IXS, \
> +    WIN64_IXS, \

while here, can you strip one of the "WIN64_IXS" defs?

Comment 7

[Chris AtLee [:catlee]]

Attachment: remove old hp/ix slave types from buildbot-configs

remove unused windows slave definitions too

Comment 8

[Justin Wood (:Callek)]

Comment on attachment 8557990 [details] [diff] [review]
remove old hp/ix slave types from buildbot-configs

Review of attachment 8557990 [details] [diff] [review]:
-----------------------------------------------------------------

for bug history, the mozilla2-staging dir is actually not in repo, despite mxr saying it is.

Comment 9

[Jordan Lund (:jlund)]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/b7cd8f9a8ec1