1184122 - Run Mac opt test jobs from Taskcluster Mac builds via BBB in try

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[(not currently active) Ted Mielczarek]

Once we get bug 921040 fixed and we're producing builds we'll need to run tests on them. Since the tests are running on Mac hardware we might as well just run the existing buildbot test jobs.

Comment 1

[(not currently active) Ted Mielczarek]

bhearsum pointed me at https://bug1157242.bugzilla.mozilla.org/attachment.cgi?id=8606406 as an example of something similar.

Comment 3

[(not currently active) Ted Mielczarek]

I talked to armen about his work in bug 1209722, and how we could roll that out in production. He came up with three options:
1) the decision task includes mozci and appends Builbot builders to specify TC builds
2) we create the BBB yml files in tree and make it depend on your build
3) we create a pulse listener which appends the Buildbot jobs to certain builds

After discussion we agreed that #2 is the cleanest solution. #1 is appealing because it leverages buildbot as the source of truth, but it adds more complexity to the decision task which isn't great. #2 is a half-step towards our eventual goal of using Taskcluster for all scheduling (scheduling buildbot jobs via BBB until they can be migrated to TC).

I think we should try to make armen's mozci script generate the .yml task definition files that will go in-tree, so that the maintenance headache is minimal.

Comment 4

[Dustin J. Mitchell [:dustin] (he/him)]

We don't have the capacity to double our test load, so this will need to be done in try or on a project branch, so as to add minimal load while still getting things updated.  I'll count this as part of greening up OS X tests via BBB.

Comment 5

[Dustin J. Mitchell [:dustin] (he/him)]

This should include both tests and talos.

Comment 6

[Dustin J. Mitchell [:dustin] (he/him)]

And this is specifically for opt builds; bug 1330310 will show that this already works (just for unittests, not talos, but close)

Comment 7

[(not currently active) Ted Mielczarek]

bug 927061 is being scoped to making the debug builds Tier-1, so let's make this bug block a different bug.

Comment 8

[Joel Maher ( :jmaher ) (UTC -8)]

I just landed the patch to green up gtest, we should verify on try and then convert debug tests to be running via bbb.

Comment 9

[Kim Moir [:kmoir] ET]

I think this can be closed as we have migrated both macosx builds and tests on trunk to tc