1358188 - Run OS X BBB tests against OS X opt BBB builds

Status: RESOLVED FIXED

(Firefox Build System :: Task Configuration, task)

Description

[Greg Arndt [:garndt]]

Now that we're focusing on getting OS X builds scheduled by buildbot, one of the steps will be to take the existing tests and schedule them via BBB against those BBB builds.

Comment 1

[Greg Arndt [:garndt]]

Kim,

Once we support BBB tests against BBB builds, what are the next steps from a release side for doing this?

Comment 2

[Greg Arndt [:garndt]]

Successful run on Try https://treeherder.mozilla.org/#/jobs?repo=try&revision=b4deba9d0baa

\o/

Comment 3

[Wander Lairson Costa]

Attachment: Bug 1358188: Enable macosx64 opt tests on BBB.

Switch tests scheduling to buildbot-bridge.

Review commit: https://reviewboard.mozilla.org/r/132416/diff/#index_header
See other reviews: https://reviewboard.mozilla.org/r/132416/

Comment 4

[Dustin J. Mitchell [:dustin] (he/him)]

Comment on attachment 8860407 [details]
Bug 1358188: Enable macosx64 opt tests on BBB.

https://reviewboard.mozilla.org/r/132416/#review135292

Comment 5

[Kim Moir [:kmoir] ET]

To answer the question in comment 1, we need to 
stop scheduling tests via buildbot, I opened bug 1358566

From a release side, we need to figure out the solution for this bug 
 
determine details of release automation for macosx builds through buildbot bridge https://bugzilla.mozilla.org/show_bug.cgi?id=1355945

Comment 6

[Kim Moir [:kmoir] ET]

Comment on attachment 8860407 [details]
Bug 1358188: Enable macosx64 opt tests on BBB.

https://reviewboard.mozilla.org/r/132416/#review135346

Comment 7

[Kim Moir [:kmoir] ET]

Testing this on holly now that the build scheduling issues have been sorted

https://treeherder.allizom.org/#/jobs?repo=holly&revision=8acb8a52e6549a7dfee05bd42e058c3293f3dd30

Comment 8

[Kim Moir [:kmoir] ET]

So the opt tests ran against the buildbot bridge build and are green

https://treeherder.allizom.org/#/jobs?repo=holly&revision=8acb8a52e6549a7dfee05bd42e058c3293f3dd30&selectedJob=89170146

I notice that there are bc4 and bc5 issues on the debug build which depends on the taskcluster cross compile build. As a side, note in bug 1360964 the question was raised if we intend to promote the tc debug build to tier 1 since the debug tests aren't running against the buildbot one.  I assume this is the intent?

Comment 9

[Wander Lairson Costa]

(In reply to Kim Moir [:kmoir] from comment #8)
> So the opt tests ran against the buildbot bridge build and are green
> 
> https://treeherder.allizom.org/#/
> jobs?repo=holly&revision=8acb8a52e6549a7dfee05bd42e058c3293f3dd30&selectedJob
> =89170146
> 
> I notice that there are bc4 and bc5 issues on the debug build which depends
> on the taskcluster cross compile build. As a side, note in bug 1360964 the
> question was raised if we intend to promote the tc debug build to tier 1
> since the debug tests aren't running against the buildbot one.  I assume
> this is the intent?

No, jmaher prefered to keep debug builds cross, since they don't run talos.

Comment 10

[Kim Moir [:kmoir] ET]

Okay thanks wcosta.  I've enabled macosx cross compile builds on trunk as tier 1 as part of bug 1360964, so I'll open a bug to disable the buildbot ones.

Comment 11

[Kim Moir [:kmoir] ET]

previous comment should have been "macosx debug cross compile builds on trunk as tier 1"

Comment 12

[Greg Arndt [:garndt]]

Will this be a follow up patch to land now that it seems the patch to run opt builds via buildbot bridge has landed on m-c?

Comment 13

[Pulsebot]

Pushed by [e-mail]:
https://hg.mozilla.org/integration/autoland/rev/0e874f047cc8
Enable macosx64 opt tests on BBB. r=dustin,kmoir

Comment 14

[Wes Kocher (:KWierso) (Not reading bugmail; email directly if needed)]

https://hg.mozilla.org/mozilla-central/rev/0e874f047cc8