1217534 - linux64 talos is not running on mozilla-aurora or mozilla-beta

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

wlach pointed out that we don't run linux64 talos on aurora or beta.  This stopped on Oct 13th.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

:Callek, can you help us figure out what went wrong here.  I looked at a few things and couldn't determine the root cause.

Comment 2

[Armen [:armenzg]]

Last push with L64 talos: https://treeherder.mozilla.org/#/jobs?repo=mozilla-beta&revision=8974b3c15604
The next one does not have them anymore: https://treeherder.mozilla.org/#/jobs?repo=mozilla-beta&revision=7c95e499110e

The builders don't show up in here: http://people.mozilla.org/~armenzg/permanent/all_builders.txt

Comment 3

[Kim Moir [:kmoir] ET]

Attachment: bug1217534.patch

The problem is that 6b1e88013eba added gtests after the get_talos part due to an ordering issue which changed the talos platform to ubuntu64_vm instead of ubuntu64_hw and there weren't any builders associated with it.  In any case, I don't really to wrestle that ordering issue again so I'll just explicitly set the talos platform for m-a and m-b.  I didn't see that when I was testing the other bug because I was testing on a master configured for linux64 vms, not linux64 hw to match our production systems.

Comment 4

[Kim Moir [:kmoir] ET]

Attachment: builder.diff

Comment 5

[Kim Moir [:kmoir] ET]

Comment on attachment 8677679 [details] [diff] [review]
bug1217534.patch

That didn't work. Trying something different

Comment 6

[Armen [:armenzg]]

Would backing out the gtests patch be an option?
(and try re-landing it after using list_builder_differences.sh)

Comment 7

[Armen [:armenzg]]

I'm surprised your patch didn't work from looking at the builder.diff! Good luck!

Comment 8

[Kim Moir [:kmoir] ET]

The problem with the previous patch is that it added m-a and m-b talos builders to masters with only vms attached, not talos machines and thus it failed due to the lack of matching slaves.  Testing new patches to address this but no luck yet.

Comment 9

[Release Engineering SlaveAPI Service]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/2a071c368c01

Comment 10

[Release Engineering SlaveAPI Service]

In production: https://hg.mozilla.org/build/buildbot-configs/rev/ecac0ce8742a

Comment 11

[Kim Moir [:kmoir] ET]

Attachment: bug1217534-2.patch

Comment 12

[Kim Moir [:kmoir] ET]

Attachment: bug1217534builder.diff

builder diff for a master with ubuntu64_hw slaves

diff for a master w ubuntu64_vm slaves is a noop

./test-masters.sh runs green

Comment 13

[Kim Moir [:kmoir] ET]

Comment on attachment 8678303 [details] [diff] [review]
bug1217534-2.patch

and tests pass

Comment 14

[Kim Moir [:kmoir] ET]

I seen builder jobs on the appropriate masters after the reconfig.