537752 - update buildbot configs + graph server db for 100 new machines

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[alice nodelman [:alice] [:anode]]

This is for doing the buildbot and graph server configuration changes necessary to get the rev3 talos machines up and running.

Comment 1

[alice nodelman [:alice] [:anode]]

Attachment: add new OSes to buildbotcustom

Comment 2

[alice nodelman [:alice] [:anode]]

Attachment: add new buildbot-config: talos-r3

Currently only supports leopard, winxp and win7.  Didn't want to confuse things by future proofing the patch in case we change our minds again about what platforms are coming up.

Comment 3

[alice nodelman [:alice] [:anode]]

Decided on naming new buildbot-configs directory 'talos-r3' - working from the assumption that in future we'll have talos-r4/etc.  This will set a pattern that we can follow in the future when updating our talos slaves.

Comment 4

[alice nodelman [:alice] [:anode]]

Attachment: add rev3 machines (leopard/xp/win7) to graph server

Comment 5

[[e-mail] (:bhearsum)]

Comment on attachment 422432 [details] [diff] [review]
add new OSes to buildbotcustom

I think you need to update the condition on line 5101 (in addDmgInstaller), too.

Comment 6

[[e-mail] (:bhearsum)]

Comment on attachment 422438 [details] [diff] [review]
add new buildbot-config: talos-r3

I'm sad that we don't have the time to do this right, and factor the talos-pool configs, but this looks OK. Don't you want to add Linux at the same time, though?

Comment 7

[[e-mail] (:bhearsum)]

Attachment: update pm sendchanges

Comment 8

[alice nodelman [:alice] [:anode]]

Attachment: [checked in]add rev3 machines (leopard/xp/win7/fedora/fedora64) to graph server

Comment 9

[alice nodelman [:alice] [:anode]]

Attachment: [checked in]add new buildbot-config: talos-r3 (now for winxp/win7/leopard/fed/fed64)

Comment 10

[alice nodelman [:alice] [:anode]]

Attachment: [checked in]add new OSes to buildbotcustom (take 2)

Comment 11

[[e-mail] (:bhearsum)]

Comment on attachment 422864 [details] [diff] [review]
[checked in]add new buildbot-config: talos-r3 (now for winxp/win7/leopard/fed/fed64)

>diff -r b360aa505a84 talos-r3/config.py

>+PLATFORMS['linux']['slave_platforms'] = ['fedora']
>+PLATFORMS['linux']['env_name'] = 'linux-perf'
>+PLATFORMS['linux']['fedora'] = {'name': "Fedora 12 - Constantine"}
>+
>+PLATFORMS['linux64']['slave_platforms'] = ['fedora64']
>+PLATFORMS['linux64']['env_name'] = 'linux-perf'
>+PLATFORMS['linux64']['fedora64'] = {'name': "Fedora 12 x64 - Constantine"}

The 'Constantine' part here seems a bit superfluous, is it necessary? I only mention it because it ends up on the Buildbot/Tinderbox waterfall, and tbpl.

Looks fine otherwise.

Comment 12

[alice nodelman [:alice] [:anode]]

Comment on attachment 422864 [details] [diff] [review]
[checked in]add new buildbot-config: talos-r3 (now for winxp/win7/leopard/fed/fed64)

changeset:   1993:9c6664c661fd

r+ over irc with shorter fedora pretty names.

Comment 13

[alice nodelman [:alice] [:anode]]

Attachment: sql update for production graph server db for r3 machines

Comment 14

[alice nodelman [:alice] [:anode]]

Comment on attachment 422867 [details] [diff] [review]
[checked in]add new OSes to buildbotcustom (take 2)

changeset:   588:3f9a3f5029e6

Comment 15

[Chris AtLee [:catlee]]

Comment on attachment 422533 [details] [diff] [review]
update pm sendchanges

changeset:   1994:c0740804e6c4

Comment 16

[alice nodelman [:alice] [:anode]]

Attachment: [checked in]don't download symbolds for fedora64 builds

Comment 17

[alice nodelman [:alice] [:anode]]

Comment on attachment 423449 [details] [diff] [review]
[checked in]don't download symbolds for fedora64 builds

changeset:   592:538cccb81a28

Comment 18

[alice nodelman [:alice] [:anode]]

Current status:

- xp, up and fine
- leopard, up and fine
- w7, up and fine with a tweak to scheduled task manager
- fedora, up and fine
- fedora64, weird sighups during cleanup of old dirs, investigating fixes

Comment 19

[alice nodelman [:alice] [:anode]]

Attachment: [checked in]fix for errors during cleanup on fedora64 boxes

Running cleanup with nohup on platforms that support nohup.

Comment 20

[alice nodelman [:alice] [:anode]]

Comment on attachment 424624 [details] [diff] [review]
[checked in]fix for errors during cleanup on fedora64 boxes

changeset:   593:a71c801aa558

Comment 21

[alice nodelman [:alice] [:anode]]

Attachment: [checked in]nohup for cleanup on all platforms

Turns out, we support nohup on our windows platforms as well.  Might as well run this consistently across the board.

Comment 22

[alice nodelman [:alice] [:anode]]

Comment on attachment 425075 [details] [diff] [review]
[checked in]nohup for cleanup on all platforms

changeset:   601:3bdb7f53d5c3

Comment 23

[alice nodelman [:alice] [:anode]]

Attachment: [checked in]add 'Rev3' to platform names

Comment 24

[alice nodelman [:alice] [:anode]]

Comment on attachment 425519 [details] [diff] [review]
[checked in]add 'Rev3' to platform names

changeset:   2058:f7900087db28

Comment 25

[alice nodelman [:alice] [:anode]]

Comment on attachment 422863 [details] [diff] [review]
[checked in]add rev3 machines (leopard/xp/win7/fedora/fedora64) to graph server

changeset:   265:bd211cf09b56

Comment 26

[alice nodelman [:alice] [:anode]]

These 100 machines are up and reporting to production graph server + appropriate tinderboxes.  They are monitored by nagios.

I think that that about covers it.