898439 - Please add additional platforms to the per-push builds on birch/b2g-inbound

Status: RESOLVED FIXED

(Release Engineering :: General, defect)

Description

[Ryan VanderMeulen [:RyanVM]]

We've had two recent instances of bustage resulting from merging birch to m-c where we didn't catch it prior due to it only occurring on platforms we intentionally don't run tests on. While we knew that the risk of this happening was also present, it has gotten worse now that birch is getting more heavily used.

Therefore, please add the following builds/tests to be run per-checkin on birch/b2g-inbound:
* OSX 10.8 debug
* Win8 debug
* Android 2.2 opt

This can be considered our last attempt at a reduced testing schedule before I think we'll be at the point of throwing in the towel and just making it 100% the same as inbound.

Comment 1

[Ryan VanderMeulen [:RyanVM]]

Can we get this done before b2g-inbound goes live please?

Comment 2

[Michael Wu [:mwu]]

FWIW, I think we share enough code with Android that we should always run all android tests/builds on birch. We can probably cut nearly everything that isn't b2g for gaia pushbot pushes though. (if it's possible to make decisions on that)

Comment 3

[Ryan VanderMeulen [:RyanVM]]

(In reply to Michael Wu [:mwu] from comment #2)
> We can probably cut nearly everything
> that isn't b2g for gaia pushbot pushes though. (if it's possible to make
> decisions on that)

That we already do.

Comment 4

[John O'Duinn [:joduinn] (please use "needinfo?" flag)]

(In reply to Ryan VanderMeulen [:RyanVM UTC-4] from comment #1)
> Can we get this done before b2g-inbound goes live please?

Yes, exactly why I added this bug as blocking bug#875989 :-)

Comment 5

[Hal Wine [:hwine] use NI!]

Attachment: don't delete the tests that are now wanted

passes test-masters.sh

Comment 6

[Justin Wood (:Callek)]

Comment on attachment 784106 [details] [diff] [review]
don't delete the tests that are now wanted

Review of attachment 784106 [details] [diff] [review]:
-----------------------------------------------------------------

This does as c#0 asks for, however I wonder if we really want to omit android armv6 and similar if we are actually including android itself. That said, I'll leave others to debate those points.

Comment 7

[Ryan VanderMeulen [:RyanVM]]

Per comment #2, the B2G team would like all Android builds running on b2g-inbound going forward.

Comment 8

[Hal Wine [:hwine] use NI!]

Attachment: don't delete the tests that are now wanted

updated per comment 7 to include all android tests

tests in progress, but "should pass"

Comment 9

[Justin Wood (:Callek)]

Comment on attachment 784110 [details] [diff] [review]
don't delete the tests that are now wanted

Review of attachment 784110 [details] [diff] [review]:
-----------------------------------------------------------------

::: mozilla/config.py
@@ +2127,5 @@
>          del BRANCHES[branch]['platforms']['linux64-dbg-st-an']
>  
>  # B2G's INBOUND
>  for b in ('b2g-inbound', 'birch',):
> +    # per bug 898439, stop disabling osx, win8, android *

This comment will just confuse us in a month, please drop it.

Comment 10

[Hal Wine [:hwine] use NI!]

Comment on attachment 784110 [details] [diff] [review]
don't delete the tests that are now wanted

https://hg.mozilla.org/build/buildbot-configs/rev/9744cde7c313

Comment 11

[Hal Wine [:hwine] use NI!]

in production, closing